Scenario 5: Text Embeddings Benchmarks in Generative AI

The text embedding scenario mimics embedding generation as part of the data ingestion pipeline of a vector database.

The text embedding scenario is only applicable to the embedding models. In this scenario, all requests are the same size, which is 96 documents, each one with 512 tokens. An example would be a collection of large PDF files, each file with 30,000+ words that a user wants to ingest into a vector DB.

Review the terms used in the hosting dedicated AI cluster benchmarks. For a list of scenarios and their descriptions, see Text Embedding Scenarios. The text embedding scenario is performed in the following region.