Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.
中文简介正在准备中。当前显示原文说明。
查看安装方法安装前可以查看交给 AI 代理的指令内容。
Read setup first. Needs the comfyui plugin and an installed i2v model
(wan22-5b by default; minimax-h3-int8 for frame-matched continuity).
generate_music_videosong: document id or a filesystem path to mp3/wav/flac/ogg. A path is uploaded for the user.style_prompt: mood, palette, movement, era ("grainy 16 mm, neon rain, slow dolly, 1984").name (defaults to the song file name), i2v_model (defaults to the active i2v model).B=${GUAARDVARK_URL:-http://localhost:5000}, ID = the project id the tool returned.
| step | call | what it does |
|---|---|---|
| read the plan | GET $B/api/music-video/$ID | cuts, prompts, status, storyboard state |
| edit prompts | POST $B/api/music-video/$ID/plan with the edited cut prompts (and optional global style) | operator edits before render |
| regenerate the plan | POST $B/api/music-video/$ID/regenerate-plan or /replan | new prompts from the Director |
| storyboards first | POST $B/api/music-video/$ID/generate-storyboards | one keyframe still per cut, thumbnails-first review |
| redo one keyframe | POST $B/api/music-video/$ID/regen-storyboard/<idx> | keeps the others |
| approve | POST $B/api/music-video/$ID/approve | releases per-clip generation. Only on the user's explicit yes |
| re-analyse | POST $B/api/music-video/$ID/analyze | restart song analysis |
| cancel | POST $B/api/music-video/$ID/cancel | |
| list all | GET $B/api/music-video (?project_id=<id> or ?project_id=none to filter) | |
| progress | GET $B/api/music-video/$ID/progress | stages, the clip in flight (sampler step/steps), ETA. Report this instead of guessing |
| rename / file under a project | PATCH $B/api/music-video/$ID with {name?, project_id?, notes?, tags?} | the finished video joins that project's Documents |
| edit one cut | POST $B/api/music-video/$ID/cut/<idx> with {prompt?, seed?, locked?} | at the approval gate it only changes the plan; while generating it re-renders that cut: ask first |
| reopen a finished video | POST $B/api/music-video/$ID/revise | back to the approval gate, rendered clips kept; on approve only changed cuts render. /replan re-renders all |
| copy | POST $B/api/music-video/$ID/duplicate with {name?, project_id?, keep_clips?} | new video at the approval gate |
| versions | GET/POST $B/api/music-video/$ID/revisions, POST .../revisions/<rid>/restore | saved on approve, reassemble, revise, restore; restore lands at the approval gate |
| a project's videos | GET $B/api/projects/<id>/videos | music videos and Film Crew filed under it |
Creating a project without the MCP tool: POST $B/api/music-video with
{"name", "song_document_id", "style_prompt", "settings": {"i2v_model": "..."}, "user_treatment": "optional short story", "project_id": optional}.
The MCP tool takes project (a Project id or exact name).
user_treatment becomes the creative source the Director writes cuts from.
GET $B/api/music-video/$ID
shows current_stage awaiting_approval with cuts: before analysis finishes the approve
route answers 409.还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Build consistent characters, environments and props in Guaardvark's Cast Library and train LoRAs for them locally (reference photos → vision bible → sample plan → approved samples → training). Use when the user wants the same face or object across images, videos, a music video, or a Film Crew production, or asks to "train a LoRA".
中文简介正在准备中。当前显示原文说明。
Code intelligence over repositories Guaardvark has indexed: semantic code search, exact-text search, file listing, PageRank repository map, import dependency graph, reading one class or function, analysis and generated rewrites, plus the System Mapper and self-improvement status. Use when the user asks where something is implemented, how modules depend on each other, or wants an architecture map of an indexed repo.
中文简介正在准备中。当前显示原文说明。
Run Guaardvark's five-role Film Crew locally: screenwriter, casting (Cast Library LoRAs), cinematographer storyboards, keyframe renders, editor. Turns a logline or screenplay into a finished short video with human gates at casting and storyboard. Use when the user says "film this", "make a short film", "storyboard this script", or "start the film crew".
中文简介正在准备中。当前显示原文说明。
Generate or edit images on the user's own GPU through Guaardvark: single images, instruction edits, background cut-outs, inpaint and outpaint, consistent characters from the Cast Library, and batch runs of many prompts. Use when the user asks to create, draw, render, visualize, edit, or batch-generate images locally.
中文简介正在准备中。当前显示原文说明。
Answer from the user's own indexed documents with Guaardvark's local RAG, browse and read indexed files section by section, remember facts across sessions, and process or fetch new material. Use when the user asks what their documents say, wants a source-cited answer from their files, says "remember this", or asks to index a PDF, DOCX, spreadsheet, image or URL.
中文简介正在准备中。当前显示原文说明。
Add any Hugging Face image or video model, checkpoint or LoRA to Guaardvark from a URL, list what is installed, and download registry models on request. Use when the user pastes a huggingface.co link or a .safetensors URL, asks "can it run <model>", or wants a new LoRA or checkpoint available in the Studio.
中文简介正在准备中。当前显示原文说明。