Introducing Pegasus 1.6
Pegasus 1.6, a new video understanding model, analyzes videos and images to generate text. Key capabilities:
- Egocentric video understanding: Analyzes first-person footage from sources such as wearable cameras and teleoperated systems.
- Image analysis: Analyzes one to twenty images per request.
- Improved entity recognition: Identifies and names people, objects, and characters in a scene more consistently than Pegasus 1.5.
- Improved metadata extraction: Extracts metadata that is less dependent on the segment definitions, enabling richer fields in a single analysis.
- In-segment events: Extracts a list of timestamped events inside each segment when you use video segmentation.
- Segmentation without a token limit: Segments long videos and returns the segments it produced, even when the output is incomplete.
To use these features, upgrade to the latest version of the Python or Node.js SDK:
For a how-to guide, see the Analyze videos and images page. For complete details about the model, see the Pegasus 1.6 page.