elm.ords.llm.calling.BaseLLMCaller

class BaseLLMCaller(llm_service, usage_tracker=None, **kwargs)[source]

Bases: object

Class to support LLM calling functionality.

Parameters:

  • llm_service (elm.ords.services.base.Service) – LLM service used for queries.

  • usage_tracker (elm.ords.services.usage.UsageTracker, optional) – Optional tracker instance to monitor token usage during LLM calls. By default, None.

  • **kwargs – Keyword arguments to be passed to the underlying service processing function (i.e. llm_service.call(**kwargs)). Should not contain the following keys:

    • usage_tracker

    • usage_sub_label

    • messages

    These arguments are provided by this caller object.

Methods