This page provides an overview of common workflows for using the TwelveLabs JavaScript SDK. Each workflow consists of a series of steps, with links to detailed documentation for each step.

All workflows involving uploading video content to the platform require asynchronous processing. You must wait for the video processing to complete before proceeding with the subsequent steps.

Prerequisites

Ensure that the following prerequisites are met before using the JavaScript SDK:

• Node.js 14 or newer must be installed on your machine.
• You have an API key. If you don’t have an account, please sign up for a free account. Then, to retrieve your API key, go to the API Key page, and select the Copy icon to the right of the key to copy it to your clipboard.

Install the SDK

Install the twelvelabs-js package:

1
yarn add twelvelabs-js # or npm i twelvelabs-js

Initialize the SDK

1. Import the required packages:

1
import { TwelveLabs } from 'twelvelabs-js';

2. Instantiate the SDK client with your API key.:

1
const client = new TwelveLabs({ apiKey: '<YOUR_API_KEY>' });

Search

Follow the steps in this section to search through your video content and find specific moments, scenes, or information.

Steps:

1. Create an index, enabling the Marengo video understanding engine.
2. Upload videos and monitor the processing.
3. Perform a search request, using text or images as queries.

Classify

Create text, image, and audio embeddings

This workflow guides you through creating embeddings for text.

Steps:

1. Create text, image, and audio embeddings

Create video embeddings

This workflow guides you through creating embeddings for videos..

Steps:

1. Upload a video and monitor the processing.
2. Retrieve the embeddings.

Generate text from videos

Follow the steps in this section to generate texts based on your videos.

Steps:

1. Create an index, enabling the Pegasus video understanding engine.
2. Upload videos and monitor the processing.
3. Depending on your use case, generate one of the following:
   • Titles, topics, and hashtags
   • Summaries, chapters, and highlights
   • Open-ended texts.

Extract video data

Follow the steps in this guide to extract various types of data from your videos, such as transcriptions, on-screen text, logos, and thumbnails.

Steps:

1. Create an index, enabling the Marengo video understanding engine.
2. Upload videos and monitor the processing.
3. Depending on your use case:
   • Extract transcriptions
   • Extract text recognized in video
   • Extract logos
   • Extract thumbnails