llm

Novita AI LLM service implementation using OpenAI-compatible interface.

class pipecat.services.novita.llm.NovitaLLMSettings(model: str | None | _NotGiven = <factory>, extra: dict[str, Any]=<factory>, system_instruction: str | None | _NotGiven = <factory>, temperature: float | None | _NotGiven | NotGiven = <factory>, max_tokens: int | None | _NotGiven | NotGiven = <factory>, top_p: float | None | _NotGiven | NotGiven = <factory>, top_k: int | None | _NotGiven = <factory>, frequency_penalty: float | None | _NotGiven | NotGiven = <factory>, presence_penalty: float | None | _NotGiven | NotGiven = <factory>, seed: int | None | _NotGiven | NotGiven = <factory>, filter_incomplete_user_turns: bool | None | _NotGiven = <factory>, user_turn_completion_config: UserTurnCompletionConfig | None | _NotGiven = <factory>, max_completion_tokens: int | _NotGiven | NotGiven = <factory>)[source]

Bases: OpenAILLMSettings

Settings for NovitaLLMService.

class pipecat.services.novita.llm.NovitaLLMService(*, api_key: str, base_url: str = 'https://api.novita.ai/openai', settings: NovitaLLMSettings | None = None, **kwargs)[source]

Bases: OpenAILLMService

A service for interacting with Novita AI’s API using the OpenAI-compatible interface.

This service extends OpenAILLMService to connect to Novita AI’s API endpoint while maintaining full compatibility with OpenAI’s interface and functionality.

Settings

alias of NovitaLLMSettings

__init__(*, api_key: str, base_url: str = 'https://api.novita.ai/openai', settings: NovitaLLMSettings | None = None, **kwargs)[source]

Initialize Novita AI LLM service.

Parameters:

  • api_key – The API key for accessing Novita AI’s API.

  • base_url – The base URL for Novita AI API. Defaults to “https://api.novita.ai/openai”.

  • settings – Runtime-updatable settings. When provided alongside deprecated parameters, settings values take precedence.

  • **kwargs – Additional keyword arguments passed to OpenAILLMService.

create_client(api_key=None, base_url=None, **kwargs)[source]

Create OpenAI-compatible client for Novita AI API endpoint.

Parameters:

  • api_key – The API key to use for the client. If None, uses instance api_key.

  • base_url – The base URL for the API. If None, uses instance base_url.

  • **kwargs – Additional keyword arguments passed to the parent create_client method.

Returns:

An OpenAI-compatible client configured for Novita AI’s API.