Generative Ai Inference

oci.generative_ai_inference.GenerativeAiInferenceClient OCI Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases for text generation, summarization, and text embeddings.
oci.generative_ai_inference.GenerativeAiInferenceClientCompositeOperations This class provides a wrapper around GenerativeAiInferenceClient and offers convenience methods for operations that would otherwise need to be chained together.

Models

oci.generative_ai_inference.models.AssistantMessage Represents a single instance of assistant message.
oci.generative_ai_inference.models.BaseChatRequest The base class to use for the chat inference request.
oci.generative_ai_inference.models.BaseChatResponse The base class that creates the chat response.
oci.generative_ai_inference.models.ChatChoice Represents a single instance of the chat response.
oci.generative_ai_inference.models.ChatContent The base class for the chat content.
oci.generative_ai_inference.models.ChatDetails Details of the conversation for the model to respond.
oci.generative_ai_inference.models.ChatResult The response to the chat conversation.
oci.generative_ai_inference.models.Choice Represents a single instance of the generated text.
oci.generative_ai_inference.models.Citation A section of the generated response which cites the documents that were used for generating the response.
oci.generative_ai_inference.models.CohereChatBotMessage A message that represents a single chat dialog as CHATBOT role.
oci.generative_ai_inference.models.CohereChatRequest Details for the chat request for Cohere models.
oci.generative_ai_inference.models.CohereChatResponse The response to the chat conversation.
oci.generative_ai_inference.models.CohereLlmInferenceRequest Details for the text generation request for Cohere models.
oci.generative_ai_inference.models.CohereLlmInferenceResponse The generated text result to return.
oci.generative_ai_inference.models.CohereMessage A message that represents a single chat dialog.
oci.generative_ai_inference.models.CohereParameterDefinition A definition of tool parameter.
oci.generative_ai_inference.models.CohereResponseFormat Specify the format the model output is guaranteed to be of
oci.generative_ai_inference.models.CohereResponseJsonFormat The json object format for the model structured output
oci.generative_ai_inference.models.CohereResponseTextFormat The text format for cohere model response
oci.generative_ai_inference.models.CohereSystemMessage A message that represents a single chat dialog as SYSTEM role.
oci.generative_ai_inference.models.CohereTool A definition of tool (function).
oci.generative_ai_inference.models.CohereToolCall A tool call generated by the model.
oci.generative_ai_inference.models.CohereToolMessage A message that represents a single chat dialog as TOOL role.
oci.generative_ai_inference.models.CohereToolResult The result from invoking tools recommended by the model in the previous chat turn.
oci.generative_ai_inference.models.CohereUserMessage A message that represents a single chat dialog as USER role.
oci.generative_ai_inference.models.DedicatedServingMode The model’s serving mode is dedicated serving and has an endpoint on a dedicated AI cluster.
oci.generative_ai_inference.models.Document The input of the document to rerank.
oci.generative_ai_inference.models.DocumentRank An object that contains a relevance score, an index and the text for a document.
oci.generative_ai_inference.models.EmbedTextDetails Details for the request to embed texts.
oci.generative_ai_inference.models.EmbedTextResult The generated embedded result to return.
oci.generative_ai_inference.models.FunctionCall The function call generated by the model.
oci.generative_ai_inference.models.FunctionDefinition A function the model may call.
oci.generative_ai_inference.models.GenerateTextDetails Details for the request to generate text.
oci.generative_ai_inference.models.GenerateTextResult The generated text result to return.
oci.generative_ai_inference.models.GeneratedText The text generated during each run.
oci.generative_ai_inference.models.GenericChatRequest Details for the chat request.
oci.generative_ai_inference.models.GenericChatResponse The response for a chat conversation.
oci.generative_ai_inference.models.ImageContent Represents a single instance of chat image content.
oci.generative_ai_inference.models.ImageUrl Provide a base64 encoded image.
oci.generative_ai_inference.models.LlamaLlmInferenceRequest Details for the text generation request for Llama models.
oci.generative_ai_inference.models.LlamaLlmInferenceResponse The generated text result to return.
oci.generative_ai_inference.models.LlmInferenceRequest The base class for the inference requests.
oci.generative_ai_inference.models.LlmInferenceResponse The base class for inference responses.
oci.generative_ai_inference.models.Logprobs Includes the logarithmic probabilities for the most likely output tokens and the chosen tokens.
oci.generative_ai_inference.models.Message A message that represents a single chat dialog.
oci.generative_ai_inference.models.OnDemandServingMode The model’s serving mode is on-demand serving on a shared infrastructure.
oci.generative_ai_inference.models.RerankTextDetails Details required for a rerank request.
oci.generative_ai_inference.models.RerankTextResult The rerank response to return to the caller.
oci.generative_ai_inference.models.SearchQuery The generated search query.
oci.generative_ai_inference.models.ServingMode The model’s serving mode, which is either on-demand serving or dedicated serving.
oci.generative_ai_inference.models.SummarizeTextDetails Details for the request to summarize text.
oci.generative_ai_inference.models.SummarizeTextResult Summarize text result to return to caller.
oci.generative_ai_inference.models.SystemMessage Represents a single instance of system message.
oci.generative_ai_inference.models.TextContent Represents a single instance of text in the chat content.
oci.generative_ai_inference.models.TokenLikelihood An object that contains the returned token and its corresponding likelihood.
oci.generative_ai_inference.models.ToolCall The tool call generated by the model, such as function call.
oci.generative_ai_inference.models.ToolChoice The tool choice for a tool.
oci.generative_ai_inference.models.ToolChoiceAuto The model can pick between generating a message or calling one or more tools.
oci.generative_ai_inference.models.ToolChoiceFunction The tool choice for a function.
oci.generative_ai_inference.models.ToolChoiceNone The model will not call any tool and instead generates a message.
oci.generative_ai_inference.models.ToolChoiceRequired The model must call one or more tools.
oci.generative_ai_inference.models.ToolDefinition A tool the model may call.
oci.generative_ai_inference.models.ToolMessage Represents a single instance of tool message.
oci.generative_ai_inference.models.UserMessage Represents a single instance of user message.