Creating a New Version of a Custom Model in Generative AI

Create a new version of an existing custom model in OCI Generative AI. For the new version, you can change the value of any fine-tuning attribute such as the base model, the dataset, and the hyperparameters for the fine-tuning method. The model name is the only common value that remains the same between the two versions.

  1. In the navigation bar of the Console, select a region with Generative AI, for example, US Midwest (Chicago) or UK South (London). See which models are offered in your region.
  2. Open the navigation menu and click Analytics & AI. Under AI Services, click Generative AI.
  3. Select a compartment to create the model in. The default compartment is the one that you selected in step 3, but you can select any compartment that you have permission to work in.
  4. Click Custom models.
  5. Click Create model.
  6. Click Create new version.
  7. Select the Model for which you want to create a new version.
  8. (Optional) Enter a version. If you don't enter a version, the system generates a version that you can change later.

    The generated version has the format v<timestamp>. For example: v20240531234930

  9. (Optional) Enter a description for the model.
  10. Click Next.
  11. Select a Base Model for the custom model. This base model can be different than the base model that you want to create a new version.
    For details about the base model, see the key features of the pretrained models.
  12. Select a Fine-tuning method.
    Important

    For guidelines, see Choosing a Fine-Tuning Method in Generative AI.
  13. elect a fine-tuning dedicated AI cluster by performing one of the following actions:
    • Select a Dedicated AI cluster from the drop-down list. If you just created a cluster, wait for that cluster to become active. Ensure that the base model that's associated with this cluster matches the base model in step 11.
    • In the Dedicated AI cluster drop-down list, click Create new dedicated AI cluster and perform the following steps:
      1. (Optional) Enter a name and description.
      2. Select a Base model that matches the base model in step 11.
      3. Read the commitment unit hours for the fine-tuning dedicated AI cluster and select the checkbox to agree with the commitment.
      4. Click Create and wait for the cluster to become active.
      5. From the Dedicated AI cluster drop-down list, select the dedicated AI cluster that you created.
  14. (Optional) Under Advanced options, click Show hyperparameters, review the tooltips and hint text and update the values as needed. Also see Hyperparameters for Fine-Tuning a Model in Generative AI. To reset the values, click Restore defaults.
  15. Click Next.
  16. Select the Object Storage bucket that contains the training dataset. If the bucket isn't listed, perform the following actions:
    • Ensure that the bucket is in the same region as the custom model.
    • Click Change compartment and select the compartment that hosts the bucket with the training data.
    • Ask an administrator to give you permission to buckets and objects in this compartment.
  17. Select the Training file to use for this model.
  18. Preview how the data in the training file is ingested.
    • If the data records parse correctly, click Submit.
    • Otherwise, fix the data.
After the model is created, you can get the custom model's details from the detail page.