Marengo 3.0 is now generally available
TwelveLabs is proud to announce that Marengo 3.0 is now generally available through the first-party API. This version improves accuracy and performance in the following areas:
- Composed text and image search: Combine text descriptions with images in a single search query for more precise results.
- Improved cinematography understanding: Enhanced search performance for cinematography terms like zoom, pan, and tracking shot.
- Sports intelligence: Improved recognition of soccer and basketball actions. Support for baseball, ice hockey, and American football.
- Faster indexing: Significant performance improvement with the new indexing technology.
- Extended text processing: Maximum text length increased from 77 to 500 tokens for both search queries and text embeddings.
- Optimized embeddings: 512-dimensional embeddings for faster processing and reduced storage.
- Long content support: Process up to four hours of video and audio content while maintaining context.
- Expanded language support: Query videos in 36 languages plus English (up from 12 plus English).
This release includes the following additional features:
-
Entity search: Find specific people performing actions in your videos, such as locating players in sports footage, tracking characters in entertainment content, and analyzing individuals in surveillance videos.
For details, see the Entity search page.
-
Composed text and image search: Search using text descriptions and images in a single query.
For concepts, see the Composed text and image queries page. For a how-to guide, see the Search page.
-
New methods for uploading content: The platform now provides two new methods for uploading your videos, images, and audio files. These methods create reusable assets that you can use across different workflows, including search, analysis, and embedding creation.
- Direct uploads: Upload whole files without splitting them. Use this method for a simple upload process. Direct uploads support files up to 4 GB.
- Multipart uploads: Upload large local files by dividing them into smaller chunks. This method enables reliable uploads of large files and supports parallel processing and resuming interrupted transfers. TwelveLabs recommends this method for local files larger than 200 MB, with a maximum file size of 4 GB.
For details, see the Upload content page.
-
Embed API v2: Create embeddings for text, images, audio, and video content using the new Embed API v2.This API provides two endpoints:
- Synchronous endpoint: Use for text, images, or audio and video content under 10 minutes.
- Asynchronous endpoint: Use for audio and video content up to 4 hours.
For details, see the Create embeddings v2 page.