Philipp Schmid
Gemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick frame rates, or chooses whether it needs speech transcripts, audio, or visual frames to answer your prompt. Result: Long videos get up to 88% fewer tokens and 66% lower costs, with ~7% higher accuracy on benchmarks. How it works: - Receives a lightweight URI reference (Files API or YouTube) and loads content via tool. - Scans speech transcripts to pinpoint relevant moments before fetching visual frames. - Navigates key timestamps and picks its own frame rate (0.1 or 10 FPS). - Pulls audio tracks directly when acoustic cues matter. Set `processing="agentic"`on `video` to enable. Keep `static` (none) for videos under 2 minutes. Available today in the Gemini API and Google AI Studio across Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash Lite. http://ai.dev/learn/agentic-video-understanding-with-gemini
