Skip to content

Backport: feat(provider/google): support Gemini Interactions video output#16842

Merged
joshualipman123 merged 1 commit into
release-v6.0from
backport/google-interactions-video-output-v6
Jul 7, 2026
Merged

Backport: feat(provider/google): support Gemini Interactions video output#16842
joshualipman123 merged 1 commit into
release-v6.0from
backport/google-interactions-video-output-v6

Conversation

@joshualipman123

Copy link
Copy Markdown
Contributor

Backport of

Summary

Backports the Interactions video output parsing and per-modality output token breakdown from #16526

Changes are adapted for the v3 provider spec:

  • Video output parsingvideo blocks from the Interactions API are emitted as file parts (mediaType: video/mp4) in both buffered (doGenerate) and streaming (doStream) paths
  • Inline base64 uses V3 data: string
  • URI-only delivery uses providerMetadata.google.videoUri (same workaround as image outputs on v6)
  • Per-modality output tokens — adds getGoogleInteractionsOutputTokensByModality() and surfaces the breakdown via providerMetadata.google.outputTokensByModality

…tput and per-modality usage (#16526)

Co-authored-by: Cursor <cursoragent@cursor.com>
@joshualipman123 joshualipman123 changed the title Backport: feat(provider/google): support Gemini Interactions video ou… Backport: feat(provider/google): support Gemini Interactions video output Jul 6, 2026
@joshualipman123 joshualipman123 requested a review from gr2m July 6, 2026 23:26
@joshualipman123 joshualipman123 merged commit b585445 into release-v6.0 Jul 7, 2026
50 checks passed
@joshualipman123 joshualipman123 deleted the backport/google-interactions-video-output-v6 branch July 7, 2026 18:53
@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🚀 Published in:

Package Version
ai 6.0.221 github npm
@ai-sdk/alibaba 1.0.36 github npm
@ai-sdk/amazon-bedrock 4.0.131 github npm
@ai-sdk/angular 2.0.222 github npm
@ai-sdk/anthropic 3.0.95 github npm
@ai-sdk/anthropic-aws 1.0.17 github npm
@ai-sdk/assemblyai 2.0.44 github npm
@ai-sdk/azure 3.0.86 github npm
@ai-sdk/baseten 1.0.61 github npm
@ai-sdk/black-forest-labs 1.0.45 github npm
@ai-sdk/bytedance 1.0.25 github npm
@ai-sdk/cerebras 2.0.64 github npm
@ai-sdk/cohere 3.0.46 github npm
@ai-sdk/deepgram 2.0.43 github npm
@ai-sdk/deepinfra 2.0.62 github npm
@ai-sdk/deepseek 2.0.46 github npm
@ai-sdk/elevenlabs 2.0.43 github npm
@ai-sdk/fal 2.0.44 github npm
@ai-sdk/fireworks 2.0.66 github npm
@ai-sdk/gateway 3.0.145 github npm
@ai-sdk/gladia 2.0.43 github npm
@ai-sdk/google 3.0.90 github npm
@ai-sdk/google-vertex 4.0.158 github npm
@ai-sdk/groq 3.0.49 github npm
@ai-sdk/huggingface 1.0.60 github npm
@ai-sdk/hume 2.0.43 github npm
@ai-sdk/klingai 3.0.28 github npm
@ai-sdk/langchain 2.0.229 github npm
@ai-sdk/llamaindex 2.0.221 github npm
@ai-sdk/lmnt 2.0.43 github npm
@ai-sdk/luma 2.0.43 github npm
@ai-sdk/mcp 1.0.60 github npm
@ai-sdk/mistral 3.0.47 github npm
@ai-sdk/moonshotai 2.0.34 github npm
@ai-sdk/open-responses 1.0.26 github npm
@ai-sdk/openai 3.0.82 github npm
@ai-sdk/openai-compatible 2.0.58 github npm
@ai-sdk/perplexity 3.0.44 github npm
@ai-sdk/prodia 1.0.42 github npm
@ai-sdk/provider-utils 4.0.37 github npm
@ai-sdk/quiverai 1.0.10 github npm
@ai-sdk/react 3.0.223 github npm
@ai-sdk/replicate 2.0.43 github npm
@ai-sdk/revai 2.0.43 github npm
@ai-sdk/rsc 2.0.221 github npm
@ai-sdk/svelte 4.0.221 github npm
@ai-sdk/togetherai 2.0.63 github npm
@ai-sdk/valibot 2.0.38 github npm
@ai-sdk/vercel 2.0.60 github npm
@ai-sdk/voyage 1.0.14 github npm
@ai-sdk/vue 3.0.221 github npm
@ai-sdk/xai 3.0.104 github npm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants