跳到正文
cccskills
免费在 GitHub 公开中文介绍

gemini-omni

根据文字或参考图生成带声音的短视频,并通过对话编辑。支持增删人物和物体、调整灯光与画面文字,以及按时间指定动作和文字显示。

原文查看原文说明

Generate and conversationally edit short videos with Google Gemini Omni Flash (`gemini-omni-flash-preview`). Use when: (1) iterating on a clip with natural-language edits instead of regenerating ("make the phone invisible, keep everything else the same"), (2) generating 3-10s 720p clips with synthesized audio, rendered on-screen text, or timecoded beats, (3) binding reference images to roles with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags, (4) editing an existing uploaded video. Accessed via the `gemini_omni_video` tool using the project's GEMINI_API_KEY/GOOGLE_API_KEY — the same key as Imagen and Google TTS.

集成工具Gemini

实测评分 未实测

查看安装方法

适用场景

  • 根据文字生成带声音的短视频
  • 用参考图指定人物或商品角色
  • 通过对话调整物体、灯光和文字
  • 按秒指定动作与文字显示

中文介绍

功能

使用Gemini Omni Flash,根据文字或参考图生成带声音的短视频,并通过后续对话修改。可以增删人物和物体、调整灯光与画面文字,为参考图指定人物、商品或画风等角色,也可以按秒安排动作和文字显示。

适用场景

适合查看生成结果后,逐项调整灯光或道具等细节。直接连接Google时,可通过标识上次生成结果的ID继续编辑。也介绍了上传本地视频进行编辑的方法。

使用示例

  • “使用这张参考图中的商品,制作一段配有舒缓背景音乐的5秒视频。”
  • “让灯光更有戏剧感,其他内容保持不变。”
  • “前3秒行走,接下来3秒停下并转身回望。”

注意事项

直接连接需要GEMINI_API_KEY或GOOGLE_API_KEY,并开通付费层级。输出为3至10秒、720p、24fps,带不可见的SynthID水印。延续对话历史的编辑须使用gemini_omni_video。音频仅完整支持英语,不支持编辑人声或延长视频。在欧洲经济区、瑞士和英国,无法编辑上传的视频。

本介绍由 AI(OpenAI Codex)根据公开的 SKILL.md 撰写。准确的规格请查看下方原文。

文档检查

AI 根据 SKILL.md 的内容检查了需要注意的操作和使用前提。评分只依据实际运行的结果(实测对比)。

安全性发送数据、删除文件、执行命令等是否有说明
B部分不足说明视频上传至外部服务及默认服务端存储,但未提供确认步骤。
安装难易度所需工具和 API 密钥是否少且有说明
B部分不足明确说明API密钥和付费层级要求,但未提供专用工具的安装步骤。

不计入评分。 由 AI(OpenAI Codex)于 2026年10月23日 评估。仅供参考,安装前请同时查看原文。

如果您认为评估有误,请申请复核

请写明哪一项有误以及原因。无需登录。我们会对照 SKILL.md 重新评估,并在此处更新结果。

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

包含的文件(1)

  • SKILL.md8.2 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Gemini Omni Flash (Google DeepMind)

Gemini Omni is Google DeepMind's video generation and editing model family, announced at I/O 2026. The first model, Gemini Omni Flash (gemini-omni-flash-preview, developer access since June 30, 2026), generates 3-10 second clips at 720p/24fps with synthesized audio via the Gemini Interactions API. Its differentiator in the OpenMontage fleet is stateful conversational editing: each generation returns an interaction_id, and a follow-up call with previous_interaction_id edits that video in place — no other wrapped provider can refine a clip without regenerating it.

OpenMontage wraps it as gemini_omni_video (native Gemini API, no gateway). It shares GOOGLE_API_KEY/GEMINI_API_KEY with google_imagen and google_tts — one key, three capabilities. Paid tier only: ~$0.10 per second of output video (billed as 5,792 output tokens/sec at $17.50/1M).

Other documented routes are available when the direct Google key is not the chosen provider:

RouteOpenMontage callImportant limitation
fal.aigemini_omni_falT2V, I2V, reference video, and edit endpoints; no Google interaction ID is returned
Runwayrunway_video, model: "gemini_omni_flash"T2V/I2V/V2V; video edits accept up to five image references
ComfyUI Partner Nodecomfyui_video, model_family: "gemini_omni_flash"Hosted paid node; requires network, Comfy login, and credits

Use the direct gemini_omni_video route for stateful conversational editing. Gateway routes return ordinary provider tasks and cannot preserve Google's previous_interaction_id workflow. The fal edit endpoint can still be iterated by feeding each output video URL into the next edit call.

When to pick it (and when not)

Use it forPrefer another provider for
Iterative refinement — generate, review, then edit the same clip in layersOne-shot cinematic hero clips (→ Seedance 2.0, see seedance-2-0)
Editing an existing/uploaded clip (restyle, add/remove objects, change text)Clips longer than 10s or above 720p
On-screen rendered text and word-by-word text beatsSeed-reproducible generations (no seed support)
Reference-image-bound subjects/styles via prompt tagsFirst/last-frame interpolation (→ veo_video)
Timecode-scheduled multi-beat clips from one promptNon-English narration (English only fully supported)

Route through video_selector for generation operations. Editing (edit_video) is a direct-tool operation — call gemini_omni_video from the registry, because the multi-turn interaction state lives outside the selector's model.

Generation prompting

Describe scene + camera + lighting + motion + audio. Official example:

Continuous, unbroken handheld shot of a fluffy tabby cat sitting on a sunny windowsill, looking out into a leafy garden. The cat's tail twitches slowly, and its ears rotate slightly toward ambient noises. Sunbeams illuminate dust motes in the air.

  • Force a single shot explicitly: "In a single continuous shot," / "No scene cuts." Otherwise the model may cut between scenes.
  • Negatives go in prose — there is no negative_prompt parameter: "No dialogue," "No extra sound effects."
  • No sampler controls: system instructions, temperature, top_p, and seeds are all unsupported. The prompt is the only lever.
  • Meta-prompt for quality: "Consider micro-detail, expression and timing to create a very rich, detailed but entirely natural scene."

Timecode syntax

Schedule beats with bracketed ranges or natural language — this maps directly onto OpenMontage scene-plan timings:

[0-3s] A person is walking [3-6s] They stop and turn around

"After 3 seconds, a woman enters the scene." / "At 5s the chorus starts in the background audio."

Audio and on-screen text

Audio is synthesized automatically; direct it in the prompt: "Include calm background music," "The audio is a low tinny radio broadcast in the background." Rendered text works and can be timed:

One word on the screen at a time: 'did, you, know, that, Omni, can, do, awesome, text?' Each word appears for 1s.

Reference images (<FIRST_FRAME> / <IMAGE_REF_N> tags)

Pass local images via reference_image_paths (they are sent in order), then bind them to roles inside the prompt with tags. <IMAGE_REF_N> indexes from 0 in the order supplied:

in the style of <IMAGE_REF_0> a woman <IMAGE_REF_1> is walking
[0-3s] A studio fashion sequence. Starting with woman <IMAGE_REF_0>, she is
holding <IMAGE_REF_1> [3-6s] Then we see the man <IMAGE_REF_2> holding <IMAGE_REF_3>
  • <FIRST_FRAME> makes an image the opening frame: <FIRST_FRAME> a woman is walking.
  • Use high-resolution images; describe the intended motion specifically rather than "make it move."
  • Say what each image is (product / character / style / background reference) — the model decides usage from context.

Conversational editing (the differentiator)

Editing prompts are the opposite of generation prompts: short and surgical. Overly descriptive edit prompts cause unintended changes.

  1. Generate the base clip (subject + scene + motion). The tool returns interaction_id in its result data.
  2. Pass it back as previous_interaction_id with operation="edit_video" and describe only the delta.
  3. Append "Keep everything else the same." to pin unmentioned elements.
  4. Refine in layers — one turn for lighting, one for camera, one for action, one for audio.

Official good/bad pairs:

AvoidInstead
"In the video of the man sitting on the sofa, please add a small black cat...""Add a cat that jumps onto his lap, he begins to pet it. Keep everything else the same."
"Please remove the cell phone... and fill in the background so it looks like...""Make the phone invisible. Keep everything else the same."

Other working edit prompts: "Make this video anime" / "Put a fashionable hat on this person" / "Change the lighting to be more dramatic" / "Change the text on the sign to say 'Omni Flash'".

Gotcha — store: editing via previous_interaction_id only works if the prior call kept the interaction server-side (store defaults to true in gemini_omni_video). Set store=false only for one-shot generations you will never edit.

Editing uploaded videos: pass input_video_path instead of previous_interaction_id; the tool uploads it via the Files API. Unavailable in the EEA, Switzerland, and the UK (editing generated videos works everywhere).

Hard limitations (preview)

  • Output: 3-10s, 720p, 24fps, MP4 with audio; aspect ratio 16:9 or 9:16. All output carries an invisible SynthID watermark.
  • No seed, negative prompt, temperature, top_p, or system instructions.
  • No video extension or first/last-frame interpolation; no voice editing.
  • Audio reference inputs unsupported. Video references ≤3s are accepted by the schema but not processed correctly — don't rely on them.
  • Multi-video prompting unsupported; may degrade output.
  • English fully supported; other languages untested.
  • Images of minors (EEA/CH/UK) and certain recognizable people are blocked for upload/editing.

Sources

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

3d-asset-generation

免费有简介

从文字或图像生成3D模型,并与目录素材搭配使用。在Blender中检查形状、材质、大小和接地情况,记录生成条件、来源及费用,再将素材加入场景。

  • 根据文字生成独特的3D道具
  • 将概念图中的物体转为3D模型
  • 用目录中的植被和岩石填充背景
calesthio/OpenMontage7.1万2026年10月17日 更新

acestep

免费有简介

使用ACE-Step 1.5生成视频背景音乐和带歌词的歌曲,可指定曲风、时长、速度与调性,也支持改编参考音频,以及从混合音频中分离人声或乐器。

  • 制作适合视频场景的背景音乐
  • 制作带歌词的短广告曲
  • 将参考音频改编为爵士风格
calesthio/OpenMontage7.1万2026年10月17日 更新

agents

免费有简介

使用ElevenLabs创建语音对话助手或角色,配置声音、应答规则、语言模型及外部工具,支持嵌入网站,并通过Twilio集成设置电话外呼。

  • 创建回答咨询的语音机器人
  • 在网站中嵌入语音引导
  • 制作可对话的语音角色原型
calesthio/OpenMontage7.1万2026年10月17日 更新

ai-video-gen

免费有简介

根据文字或参考图像生成AI视频,并按用途、可用服务和预算选择模型。可制作社交平台竖屏短片、让商品照片动起来,也可通过对话编辑已有片段。

  • 制作社交平台竖屏短片
  • 为商品照片添加动态效果
  • 按预算和风格选择生成服务
calesthio/OpenMontage7.1万2026年10月17日 更新

ai-video-gen

免费有简介

根据文字描述或参考图片生成AI视频,并按用途和费用选择生成服务。支持设置画面比例、查看生成进度,以及通过Gemini Omni对话修改现有视频。

  • 将文字描述的场景制作成视频
  • 为商品照片添加动态效果
  • 制作社交媒体竖屏视频
calesthio/OpenMontage7.1万2026年10月17日 更新

atlas-cloud

免费有简介

通过Atlas Cloud使用多种模型生成和编辑图像与视频,只需一个API密钥,即可保存生成素材,以及所用模型、提交设置和预估费用等记录。

  • 通过同一服务生成图像和视频
  • 利用参考素材编辑商品图
  • 参考图像、视频和音频生成视频
calesthio/OpenMontage7.1万2026年10月17日 更新

查看 calesthio 的全部技能

报告此技能的问题