For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Sample appsIntegrationsDiscordPlaygroundDevEx repo
GuidesSDK ReferenceAPI Reference
GuidesSDK ReferenceAPI Reference
  • TwelveLabs API
    • Introduction
    • Authentication
  • API Reference
    • Manage indexes
    • Upload content
    • Index content
    • Manage videos
    • Manage entities
    • Any-to-video search
    • Create embeddings v2
    • Create embeddings v1
      • Create video embeddings
      • Create text, image, and audio embeddings
        • The embedding object
        • POSTCreate embeddings for text, image, and audio
    • Analyze and segment videos
    • Error codes
LogoLogo
Sample appsIntegrationsDiscordPlaygroundDevEx repo
API ReferenceCreate embeddings v1Create text, image, and audio embeddings

Create embeddings for text, image, and audio

POST
https://api.twelvelabs.io/v1.3/embed
POST
/v1.3/embed
$curl -X POST https://api.twelvelabs.io/v1.3/embed \
>     -H "x-api-key: <apiKey>" \
>     -H "Content-Type: multipart/form-data" \
>     -F model_name="marengo3.0" \
>     -F image_url="https://example.com/image.jpg" \
>     -F image_file=@<file1> \
>     -F audio_file=@<file1>
1{
2  "model_name": "marengo3.0",
3  "text_embedding": {
4    "segments": [
5      {
6        "float": [
7          -0.042632885,
8          0.014312328,
9          0.029209055
10        ]
11      }
12    ]
13  },
14  "image_embedding": {
15    "segments": [
16      {
17        "float": [
18          -0.042632885,
19          0.014312328,
20          0.029209055
21        ]
22      }
23    ],
24    "metadata": {
25      "input_filename": "01.jpg"
26    }
27  },
28  "audio_embedding": {
29    "segments": [
30      {
31        "end_offset_sec": 6,
32        "float": [
33          -0.042632885,
34          0.014312328,
35          0.029209055
36        ],
37        "start_offset_sec": 0
38      },
39      {
40        "end_offset_sec": 6,
41        "float": [
42          -0.042632885,
43          0.014312328,
44          0.029209055
45        ],
46        "start_offset_sec": 0
47      }
48    ],
49    "metadata": {
50      "input_filename": "01.mp3"
51    }
52  }
53}
<Note title="Note"> This endpoint will be deprecated in a future version. Migrate to the [Embed API v2](/v1.3/api-reference/create-embeddings-v2) for continued support and access to new features. </Note> This method creates embeddings for text, image, and audio content. Ensure your media files meet the following requirements: - [Audio files](/v1.3/docs/concepts/models/marengo#audio-requirements). - [Image files](/v1.3/docs/concepts/models/marengo#image-requirements). Parameters for embeddings: - **Common parameters**: - `model_name`: The video understanding model you want to use. Example: "marengo3.0". - **Text embeddings**: - `text`: Text for which to create an embedding. - **Image embeddings**: Provide one of the following: - `image_url`: Publicly accessible URL of your image file. - `image_file`: Local image file. - **Audio embeddings**: Provide one of the following: - `audio_url`: Publicly accessible URL of your audio file. - `audio_file`: Local audio file. <Note title="Notes"> - The Marengo video understanding model generates embeddings for all modalities in the same latent space. This shared space enables any-to-any searches across different types of content. - You can create multiple types of embeddings in a single API call. - Audio embeddings combine generic sound and human speech in a single embedding. For videos with transcriptions, you can retrieve transcriptions and then [create text embeddings](/v1.3/api-reference/create-embeddings-v1/text-image-audio-embeddings/create-text-image-audio-embeddings) from these - This endpoint is rate-limited. For details, see the [Rate limits](/v1.3/docs/get-started/rate-limits) page. </Note>
Was this page helpful?
Previous

Analyze and segment videos

Next
Built with
Note

This endpoint will be deprecated in a future version. Migrate to the Embed API v2 for continued support and access to new features.

This method creates embeddings for text, image, and audio content.

Ensure your media files meet the following requirements:

  • Audio files.
  • Image files.

Parameters for embeddings:

  • Common parameters:
    • model_name: The video understanding model you want to use. Example: “marengo3.0”.
  • Text embeddings:
    • text: Text for which to create an embedding.
  • Image embeddings: Provide one of the following:
    • image_url: Publicly accessible URL of your image file.
    • image_file: Local image file.
  • Audio embeddings: Provide one of the following:
    • audio_url: Publicly accessible URL of your audio file.
    • audio_file: Local audio file.
Notes
  • The Marengo video understanding model generates embeddings for all modalities in the same latent space. This shared space enables any-to-any searches across different types of content.
  • You can create multiple types of embeddings in a single API call.
  • Audio embeddings combine generic sound and human speech in a single embedding. For videos with transcriptions, you can retrieve transcriptions and then create text embeddings from these
  • This endpoint is rate-limited. For details, see the Rate limits page.

Authentication

x-api-keystring
Your API key. <Note title="Note"> You can find your API key on the <a href="https://playground.twelvelabs.io/dashboard/api-keys" target="_blank">API Keys</a> page. </Note>

Request

Request to create an embedding synchronously.
model_namestringRequired
The name of the model you want to use. The following models are available: - `marengo3.0`: Enhanced model with sports intelligence and extended content support.
textstringOptional

The text for which you wish to create an embedding.

Example: “Man with a dog crossing the street”

image_urlstringOptionalformat: "uri"

The publicly accessible URL of the image for which you wish to create an embedding. This parameter is required for image embeddings if image_file is not provided.

image_filefileOptional

The image file for which you wish to create an embedding as a local file. This parameter is required for image embeddings if image_url is not provided.

audio_urlstringOptionalformat: "uri"

The publicly accessible URL of the audio file for which you wish to creae an embedding. This parameter is required for audio embeddings if audio_file is not provided.

audio_filefileOptional

The audio file for which you wish to create an embedding as a local file. This parameter is required for audio embeddings if audio_url is not provided.

audio_start_offset_secdoubleOptionalDefaults to 0

Specifies the start time, in seconds, from which the platform generates the audio embeddings. This parameter allows you to skip the initial portion of the audio during processing. Default: 0.

Response

A text embedding has successfully been created.
model_namestring
The name of the video understanding model the platform has used to create this embedding.
text_embeddingobject
An object that contains the generated text embedding vector and associated information. Present when text was processed.
image_embeddingobject
An object that contains the generated image embedding vector and associated information. Present when image was processed.
audio_embeddingobject
An object that contains the generated audio embedding vector and associated information. Present when audio was processed.

Errors

400
Bad Request Error

Your API key.

Note

You can find your API key on the API Keys page.

The name of the model you want to use. The following models are available:

  • marengo3.0: Enhanced model with sports intelligence and extended content support.