Release notes

Marengo 3 video understanding model

TwelveLabs is proud to introduce the following new features and improvements:

• Sports intelligence: Improved recognition of soccer and basketball actions.
• Faster indexing: Significant performance improvement with the new indexing technology.
• Extended text processing: Maximum text length increased from 77 to 500 tokens for both search queries and text embeddings.
• Optimized embeddings: 512-dimensional embeddings for faster processing and reduced storage.
• Long content support: Process up to four hours of video content while maintaining context.

API Changes:

When using Marengo 3, this update affects the following existing endpoints:

• POST /embed

  • The text_truncate parameter is deprecated and the maximum length for text embeddings is now 500 tokens.

• GET /indexes/:index-id/videos/:video-id and GET /embed/tasks/:task_id

  • The embedding_option parameter can now take the following values: visual, audio, transcription. For details, see the Embedding options section.

• POST /search

  • The audio search option now excludes human speech. A new search option named transcription for finding specific spoken words and phrases will be available in a future release.
  • The maximum query length is now 500 tokens.
  • The platform no longer returns the score and confidence fields. Use the new rank field instead to determine the relevance of a result.

Entity Search API

The Entity Search API enables you to search for specific people performing actions. Use cases include finding players in sports footage, tracking characters in entertainment content, and analyzing individuals in surveillance videos.

To get started, see the Entity Search page.