Skip to navigation
Get Started

Release notes

December 2, 2024

Introducing Marengo 2.7 and API v1.3

TwelveLabs is proud to introduce the following new features and improvements:

  • Marengo 2.7: This new version of the Marengo video understanding engine improves accuracy and performance in the following areas:
    • Multimodal processing that combines visual, audio, and text elements.
    • Fine-grained image-to-video search: detect brand logos, text, and small objects (as small as 10% of the video frame).
    • Improvement in motion search capability.
    • Counting capabilities.
    • More nuanced audio comprehension: music, lyrics, sound, and silence. For more details on the new features and improvements in this version, refer to this blog post: Introducing Marengo 2.7: Pioneering Multi-Vector Embeddings for Advanced Video Understanding.
  • Simplified modalities:
    • visual: includes objects, actions, text OCR, logos.
    • audio: includes speech, music, and ambient sounds.
    • conversation has been deprecated.
    • text_in_video and logo are now part of visual.
  • Streamlined endpoint structure: Several endpoints and parameters have been deprecated, removed, or renamed.
Notes
  • The 1.3 version of the API version only supports Marengo 2.7.
  • Marengo 2.7 generates embeddings that are not backward compatible. You must reindex all your videos and regenerate all your embeddings with Marengo 2.7.
  • The audio search feature in Marengo 2.7 works best with full-sentence queries. Short queries may yield suboptimal results. This limitation is temporary and will be addressed in a future release.