Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.
The English summary is being prepared. Showing the original description.
Run score Not tested
See how to installReview the instructions the agent will receive before you install.
Read setup first. Needs the comfyui plugin and an installed i2v model
(wan22-5b by default; minimax-h3-int8 for frame-matched continuity).
generate_music_videosong: document id or a filesystem path to mp3/wav/flac/ogg. A path is uploaded for the user.style_prompt: mood, palette, movement, era ("grainy 16 mm, neon rain, slow dolly, 1984").name (defaults to the song file name), i2v_model (defaults to the active i2v model).B=${GUAARDVARK_URL:-http://localhost:5000}, ID = the project id the tool returned.
| step | call | what it does |
|---|---|---|
| read the plan | GET $B/api/music-video/$ID | cuts, prompts, status, storyboard state |
| edit prompts | POST $B/api/music-video/$ID/plan with the edited cut prompts (and optional global style) | operator edits before render |
| regenerate the plan | POST $B/api/music-video/$ID/regenerate-plan or /replan | new prompts from the Director |
| storyboards first | POST $B/api/music-video/$ID/generate-storyboards | one keyframe still per cut, thumbnails-first review |
| redo one keyframe | POST $B/api/music-video/$ID/regen-storyboard/<idx> | keeps the others |
| approve | POST $B/api/music-video/$ID/approve | releases per-clip generation. Only on the user's explicit yes |
| re-analyse | POST $B/api/music-video/$ID/analyze | restart song analysis |
| cancel | POST $B/api/music-video/$ID/cancel | |
| list all | GET $B/api/music-video (?project_id=<id> or ?project_id=none to filter) | |
| progress | GET $B/api/music-video/$ID/progress | stages, the clip in flight (sampler step/steps), ETA. Report this instead of guessing |
| rename / file under a project | PATCH $B/api/music-video/$ID with {name?, project_id?, notes?, tags?} | the finished video joins that project's Documents |
| edit one cut | POST $B/api/music-video/$ID/cut/<idx> with {prompt?, seed?, locked?} | at the approval gate it only changes the plan; while generating it re-renders that cut: ask first |
| reopen a finished video | POST $B/api/music-video/$ID/revise | back to the approval gate, rendered clips kept; on approve only changed cuts render. /replan re-renders all |
| copy | POST $B/api/music-video/$ID/duplicate with {name?, project_id?, keep_clips?} | new video at the approval gate |
| versions | GET/POST $B/api/music-video/$ID/revisions, POST .../revisions/<rid>/restore | saved on approve, reassemble, revise, restore; restore lands at the approval gate |
| a project's videos | GET $B/api/projects/<id>/videos | music videos and Film Crew filed under it |
Creating a project without the MCP tool: POST $B/api/music-video with
{"name", "song_document_id", "style_prompt", "settings": {"i2v_model": "..."}, "user_treatment": "optional short story", "project_id": optional}.
The MCP tool takes project (a Project id or exact name).
user_treatment becomes the creative source the Director writes cuts from.
GET $B/api/music-video/$ID
shows current_stage awaiting_approval with cuts: before analysis finishes the approve
route answers 409.No reviews yet. Tell others what you thought.
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
Build consistent characters, environments and props in Guaardvark's Cast Library and train LoRAs for them locally (reference photos → vision bible → sample plan → approved samples → training). Use when the user wants the same face or object across images, videos, a music video, or a Film Crew production, or asks to "train a LoRA".
The English summary is being prepared. Showing the original description.
Code intelligence over repositories Guaardvark has indexed: semantic code search, exact-text search, file listing, PageRank repository map, import dependency graph, reading one class or function, analysis and generated rewrites, plus the System Mapper and self-improvement status. Use when the user asks where something is implemented, how modules depend on each other, or wants an architecture map of an indexed repo.
The English summary is being prepared. Showing the original description.
Run Guaardvark's five-role Film Crew locally: screenwriter, casting (Cast Library LoRAs), cinematographer storyboards, keyframe renders, editor. Turns a logline or screenplay into a finished short video with human gates at casting and storyboard. Use when the user says "film this", "make a short film", "storyboard this script", or "start the film crew".
The English summary is being prepared. Showing the original description.
Generate or edit images on the user's own GPU through Guaardvark: single images, instruction edits, background cut-outs, inpaint and outpaint, consistent characters from the Cast Library, and batch runs of many prompts. Use when the user asks to create, draw, render, visualize, edit, or batch-generate images locally.
The English summary is being prepared. Showing the original description.
Answer from the user's own indexed documents with Guaardvark's local RAG, browse and read indexed files section by section, remember facts across sessions, and process or fetch new material. Use when the user asks what their documents say, wants a source-cited answer from their files, says "remember this", or asks to index a PDF, DOCX, spreadsheet, image or URL.
The English summary is being prepared. Showing the original description.
Add any Hugging Face image or video model, checkpoint or LoRA to Guaardvark from a URL, list what is installed, and download registry models on request. Use when the user pastes a huggingface.co link or a .safetensors URL, asks "can it run <model>", or wants a new LoRA or checkpoint available in the Studio.
The English summary is being prepared. Showing the original description.