General analysis for Pegasus 1.5
TwelveLabs is proud to introduce general analysis (prompt-based text generation) for Pegasus 1.5, along with the following new capabilities.
Set model_name to pegasus1.5 and analysis_mode to general to analyze videos with a prompt. Pegasus 1.5 accepts videos directly from a URL, an asset, or a base64 string, with no pre-indexing required.
Structured prompts with reference images
Use the new prompt_v2 field to include up to 4 reference images in your prompt. Assign a name to each image and insert <@name> placeholders in the prompt text (Example: "Is there a <@tiger-1> in the video?"). Requires model_name set to pegasus1.5.
Video clipping
Use the start_time and end_time fields to analyze only a portion of the video. The clip must be at least 4 seconds long. Requires model_name set to pegasus1.5.
Per-definition time ranges for segmentation
When using video segmentation (analysis_mode set to time_based_metadata), add the time_ranges to individual segment definitions to restrict segment extraction to specific parts of the video. This gives you finer control over which portions are analyzed for each definition. Requires model_name set to pegasus1.5.
Analysis task response echo
The request_params object in task responses now includes the full set of parameters you submitted when creating the task: prompt, prompt_v2, json_schema, segment_definitions, time_ranges, start_time, and end_time. The list endpoint returns compact versions (truncated prompts, omitted schemas), while the retrieve endpoint returns the full data.
For complete parameter specifications, see the Create an async analysis task and Retrieve analysis task status and results pages in the API Reference section.