Skip to content
cccskills
FreePublished on GitHubEnglish overview

gemini-omni

Generate short videos with audio from prompts and reference images, then refine them through conversational edits. The skill covers targeted object, lighting, and text changes, plus timed actions, using Gemini Omni Flash through documented video tools.

OriginalShow the original description

Generate and conversationally edit short videos with Google Gemini Omni Flash (`gemini-omni-flash-preview`). Use when: (1) iterating on a clip with natural-language edits instead of regenerating ("make the phone invisible, keep everything else the same"), (2) generating 3-10s 720p clips with synthesized audio, rendered on-screen text, or timecoded beats, (3) binding reference images to roles with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags, (4) editing an existing uploaded video. Accessed via the `gemini_omni_video` tool using the project's GEMINI_API_KEY/GOOGLE_API_KEY — the same key as Imagen and Google TTS.

Works withGemini
AI rating80/ 100See how to install

Good for

  • Creating short videos with sound from written prompts
  • Assigning reference images to characters, products, or styles
  • Refining objects, lighting, and text through conversation
  • Scheduling actions and on-screen text by time

Overview

What it does

This skill helps you create short videos with audio from text or reference images, then make changes through conversation. It uses Gemini Omni Flash to add or remove people and objects, adjust lighting, and edit on-screen text. You can assign reference images roles such as character, product, or visual style, and specify when actions or text should appear.

When it helps

Use it to review a generated clip and adjust details such as lighting or props one at a time. With a direct Google connection, an ID identifying the previous generation lets you continue editing. The skill also explains uploading a local video for editing.

Example requests

  • “Create a five-second video featuring the product in this reference image, with calm background music.”
  • “Make the lighting more dramatic. Keep everything else the same.”
  • “Have the person walk for three seconds, then stop and turn around over the next three seconds.”

Notes

Direct access requires GEMINI_API_KEY or GOOGLE_API_KEY and a paid tier. Output is 3–10 seconds at 720p and 24fps, with an invisible SynthID watermark. Use gemini_omni_video for edits that retain conversation history. Only English audio is fully supported. Voice editing and video extension are unsupported. Uploaded-video editing is unavailable in the EEA, Switzerland, and the UK.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Objective evaluation

AI rated this skill on four points using only the contents of its SKILL.md. Stars and popularity are not taken into account.

Clear instructionsIs it clear when to use it and what it does?
AGoodIt explicitly describes short-video generation, conversational editing, reference-image use cases, and limitations.
Concrete stepsAre steps, inputs, outputs, and examples spelled out?
AGoodIt specifies passing generation IDs into subsequent edits, timecode syntax, and output specifications.
SafetyAre sending data, deleting files, and running commands disclosed?
BPartly lackingExternal video uploads and default server-side storage are documented, but confirmation procedures are absent.
Easy setupDoes it need few tools or API keys, and are they documented?
BPartly lackingAPI keys and paid-tier requirements are stated, but installation instructions for the dedicated tools are absent.

The total counts each point as A = 25, B = 15, C = 5. Rated by AI (OpenAI Codex) as of Oct 23, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (1)

  • SKILL.md8.2 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Gemini Omni Flash (Google DeepMind)

Gemini Omni is Google DeepMind's video generation and editing model family, announced at I/O 2026. The first model, Gemini Omni Flash (gemini-omni-flash-preview, developer access since June 30, 2026), generates 3-10 second clips at 720p/24fps with synthesized audio via the Gemini Interactions API. Its differentiator in the OpenMontage fleet is stateful conversational editing: each generation returns an interaction_id, and a follow-up call with previous_interaction_id edits that video in place — no other wrapped provider can refine a clip without regenerating it.

OpenMontage wraps it as gemini_omni_video (native Gemini API, no gateway). It shares GOOGLE_API_KEY/GEMINI_API_KEY with google_imagen and google_tts — one key, three capabilities. Paid tier only: ~$0.10 per second of output video (billed as 5,792 output tokens/sec at $17.50/1M).

Other documented routes are available when the direct Google key is not the chosen provider:

RouteOpenMontage callImportant limitation
fal.aigemini_omni_falT2V, I2V, reference video, and edit endpoints; no Google interaction ID is returned
Runwayrunway_video, model: "gemini_omni_flash"T2V/I2V/V2V; video edits accept up to five image references
ComfyUI Partner Nodecomfyui_video, model_family: "gemini_omni_flash"Hosted paid node; requires network, Comfy login, and credits

Use the direct gemini_omni_video route for stateful conversational editing. Gateway routes return ordinary provider tasks and cannot preserve Google's previous_interaction_id workflow. The fal edit endpoint can still be iterated by feeding each output video URL into the next edit call.

When to pick it (and when not)

Use it forPrefer another provider for
Iterative refinement — generate, review, then edit the same clip in layersOne-shot cinematic hero clips (→ Seedance 2.0, see seedance-2-0)
Editing an existing/uploaded clip (restyle, add/remove objects, change text)Clips longer than 10s or above 720p
On-screen rendered text and word-by-word text beatsSeed-reproducible generations (no seed support)
Reference-image-bound subjects/styles via prompt tagsFirst/last-frame interpolation (→ veo_video)
Timecode-scheduled multi-beat clips from one promptNon-English narration (English only fully supported)

Route through video_selector for generation operations. Editing (edit_video) is a direct-tool operation — call gemini_omni_video from the registry, because the multi-turn interaction state lives outside the selector's model.

Generation prompting

Describe scene + camera + lighting + motion + audio. Official example:

Continuous, unbroken handheld shot of a fluffy tabby cat sitting on a sunny windowsill, looking out into a leafy garden. The cat's tail twitches slowly, and its ears rotate slightly toward ambient noises. Sunbeams illuminate dust motes in the air.

  • Force a single shot explicitly: "In a single continuous shot," / "No scene cuts." Otherwise the model may cut between scenes.
  • Negatives go in prose — there is no negative_prompt parameter: "No dialogue," "No extra sound effects."
  • No sampler controls: system instructions, temperature, top_p, and seeds are all unsupported. The prompt is the only lever.
  • Meta-prompt for quality: "Consider micro-detail, expression and timing to create a very rich, detailed but entirely natural scene."

Timecode syntax

Schedule beats with bracketed ranges or natural language — this maps directly onto OpenMontage scene-plan timings:

[0-3s] A person is walking [3-6s] They stop and turn around

"After 3 seconds, a woman enters the scene." / "At 5s the chorus starts in the background audio."

Audio and on-screen text

Audio is synthesized automatically; direct it in the prompt: "Include calm background music," "The audio is a low tinny radio broadcast in the background." Rendered text works and can be timed:

One word on the screen at a time: 'did, you, know, that, Omni, can, do, awesome, text?' Each word appears for 1s.

Reference images (<FIRST_FRAME> / <IMAGE_REF_N> tags)

Pass local images via reference_image_paths (they are sent in order), then bind them to roles inside the prompt with tags. <IMAGE_REF_N> indexes from 0 in the order supplied:

in the style of <IMAGE_REF_0> a woman <IMAGE_REF_1> is walking
[0-3s] A studio fashion sequence. Starting with woman <IMAGE_REF_0>, she is
holding <IMAGE_REF_1> [3-6s] Then we see the man <IMAGE_REF_2> holding <IMAGE_REF_3>
  • <FIRST_FRAME> makes an image the opening frame: <FIRST_FRAME> a woman is walking.
  • Use high-resolution images; describe the intended motion specifically rather than "make it move."
  • Say what each image is (product / character / style / background reference) — the model decides usage from context.

Conversational editing (the differentiator)

Editing prompts are the opposite of generation prompts: short and surgical. Overly descriptive edit prompts cause unintended changes.

  1. Generate the base clip (subject + scene + motion). The tool returns interaction_id in its result data.
  2. Pass it back as previous_interaction_id with operation="edit_video" and describe only the delta.
  3. Append "Keep everything else the same." to pin unmentioned elements.
  4. Refine in layers — one turn for lighting, one for camera, one for action, one for audio.

Official good/bad pairs:

AvoidInstead
"In the video of the man sitting on the sofa, please add a small black cat...""Add a cat that jumps onto his lap, he begins to pet it. Keep everything else the same."
"Please remove the cell phone... and fill in the background so it looks like...""Make the phone invisible. Keep everything else the same."

Other working edit prompts: "Make this video anime" / "Put a fashionable hat on this person" / "Change the lighting to be more dramatic" / "Change the text on the sign to say 'Omni Flash'".

Gotcha — store: editing via previous_interaction_id only works if the prior call kept the interaction server-side (store defaults to true in gemini_omni_video). Set store=false only for one-shot generations you will never edit.

Editing uploaded videos: pass input_video_path instead of previous_interaction_id; the tool uploads it via the Files API. Unavailable in the EEA, Switzerland, and the UK (editing generated videos works everywhere).

Hard limitations (preview)

  • Output: 3-10s, 720p, 24fps, MP4 with audio; aspect ratio 16:9 or 9:16. All output carries an invisible SynthID watermark.
  • No seed, negative prompt, temperature, top_p, or system instructions.
  • No video extension or first/last-frame interpolation; no voice editing.
  • Audio reference inputs unsupported. Video references ≤3s are accepted by the schema but not processed correctly — don't rely on them.
  • Multi-video prompting unsupported; may degrade output.
  • English fully supported; other languages untested.
  • Images of minors (EEA/CH/UK) and certain recognizable people are blocked for upload/editing.

Sources

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

3d-asset-generation

FreeSummaryAI rating 90

Create 3D objects from text or images, choose catalog assets for repeated scenery, and inspect the results in Blender. The workflow checks geometry, materials, scale, and ground contact while recording asset sources and generation costs.

  • Create a unique 3D object from a text description
  • Reconstruct a 3D object from a concept image
  • Populate scenery with catalog vegetation and rocks
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

acestep

FreeSummaryAI rating 80

Generate background music and songs with lyrics using ACE-Step 1.5, with controls for duration, tempo, and musical key. You can also restyle reference audio and separate vocals or individual instruments from mixed tracks.

  • Generate background music to match a video scene
  • Create a short jingle with supplied lyrics
  • Make a jazz arrangement of reference audio
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

agents

FreeSummaryAI rating 80

Build voice assistants and conversational characters with ElevenLabs. Configure voices, language models, and external tools, then connect conversations to a website widget or use Twilio integration for outbound phone calls.

  • Creating a voice bot for customer support
  • Embedding a voice assistant on a website
  • Building an interactive voice character
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

ai-video-gen

FreeSummaryAI rating 90

Generate video clips from text descriptions or reference images through multiple API services. Compare available providers by cost and task needs, choose aspect ratios, track generation progress, and refine existing clips through conversational editing with Gemini Omni.

  • Generating clips from written scene descriptions
  • Animating a product photo
  • Creating vertical videos for social media
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

ai-video-gen

FreeSummaryAI rating 70

Create AI video clips from text or reference images, choosing among providers to match the task and budget. Supports vertical social videos, product photo animation, and conversational editing of existing clips with Gemini Omni Flash.

  • Create vertical video clips for social media
  • Animate product photos
  • Choose a video provider for a budget and visual style
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

atlas-cloud

FreeSummaryAI rating 90

Generate and edit images and videos through Atlas Cloud using one API key across multiple model families. Choose supported models for each task, download the results, and retain details about the model, inputs, and estimated cost.

  • Generate images and videos through one service
  • Edit product images using reference materials
  • Create videos from images, video, or audio references
calesthio/OpenMontage71.1KUpdated Oct 17, 2026

See all skills by calesthio

Report a problem with this skill