Creating a Model Endpoint

• Console
• CLI
• API

• 1. Open the navigation menu and click Analytics & AI. Under AI Services, click Language.
  2. In the left-side navigation menu, click Projects.
  3. Click the name of the project.

     The project details page opens.

  4. Under Resources, click Model endpoints.

     The model endpoints in the project are displayed in the Model endpoints table.

  5. Click Create model endpoint.
  6. (Optional) Enter a unique name (255 character limit) for the resource.

     If you don't provide a name, one is automatically generated. For example, ailanguage<resource>20230825155844.

  7. (Optional) Enter a description (400 character limit) for the resource.
  8. Select a model to associate the model endpoint with.
  9. (Optional) Enter an Inference unit count. The maximum is 10.

     Inference units are Compute resources dedicated to the endpoint. You must have at least one inference unit allocated to an endpoint to perform inferences on it. You're charged for the number of hours each inference unit is associated with the endpoint.

  10. (Optional) Click Show advanced options to assign tags to the job. Tags help you to easily find and track resources by selecting a tag namespace, and then entering the key and value.

      To add more than one tag, click Add tag.

      Tagging describes the various tags that you can use organize and find resources including cost-tracking tags.

  11. (Optional) To use a different endpoint for the project, enter a unique alias name.
  12. (Optional) Click View detail page on clicking create to go directly to the resource details page after creation.
  13. Click Create model endpoint.

  The model endpoint is created. The create process can take a couple of minutes. When the model endpoint is created successfully, the model endpoint is in an ACTIVE state and can be used.

• Use the oci ai language endpoint create command and required parameters to create a model endpoint:

  Command

  CopyTry It

  oci ai language endpoint create --compartment-id <compartment-id> -c [<name>]... [OPTIONS]

  For a complete list of flags and variable options for CLI commands, see the CLI Command Reference.

• Run the CreateEndpoint operation to create model endpoints.