Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
실행 점수 미검증
설치 방법 보기설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.
Read setup first. Needs the comfyui plugin and an installed i2v model
(wan22-5b by default; minimax-h3-int8 for frame-matched continuity).
generate_music_videosong: document id or a filesystem path to mp3/wav/flac/ogg. A path is uploaded for the user.style_prompt: mood, palette, movement, era ("grainy 16 mm, neon rain, slow dolly, 1984").name (defaults to the song file name), i2v_model (defaults to the active i2v model).B=${GUAARDVARK_URL:-http://localhost:5000}, ID = the project id the tool returned.
| step | call | what it does |
|---|---|---|
| read the plan | GET $B/api/music-video/$ID | cuts, prompts, status, storyboard state |
| edit prompts | POST $B/api/music-video/$ID/plan with the edited cut prompts (and optional global style) | operator edits before render |
| regenerate the plan | POST $B/api/music-video/$ID/regenerate-plan or /replan | new prompts from the Director |
| storyboards first | POST $B/api/music-video/$ID/generate-storyboards | one keyframe still per cut, thumbnails-first review |
| redo one keyframe | POST $B/api/music-video/$ID/regen-storyboard/<idx> | keeps the others |
| approve | POST $B/api/music-video/$ID/approve | releases per-clip generation. Only on the user's explicit yes |
| re-analyse | POST $B/api/music-video/$ID/analyze | restart song analysis |
| cancel | POST $B/api/music-video/$ID/cancel | |
| list all | GET $B/api/music-video (?project_id=<id> or ?project_id=none to filter) | |
| progress | GET $B/api/music-video/$ID/progress | stages, the clip in flight (sampler step/steps), ETA. Report this instead of guessing |
| rename / file under a project | PATCH $B/api/music-video/$ID with {name?, project_id?, notes?, tags?} | the finished video joins that project's Documents |
| edit one cut | POST $B/api/music-video/$ID/cut/<idx> with {prompt?, seed?, locked?} | at the approval gate it only changes the plan; while generating it re-renders that cut: ask first |
| reopen a finished video | POST $B/api/music-video/$ID/revise | back to the approval gate, rendered clips kept; on approve only changed cuts render. /replan re-renders all |
| copy | POST $B/api/music-video/$ID/duplicate with {name?, project_id?, keep_clips?} | new video at the approval gate |
| versions | GET/POST $B/api/music-video/$ID/revisions, POST .../revisions/<rid>/restore | saved on approve, reassemble, revise, restore; restore lands at the approval gate |
| a project's videos | GET $B/api/projects/<id>/videos | music videos and Film Crew filed under it |
Creating a project without the MCP tool: POST $B/api/music-video with
{"name", "song_document_id", "style_prompt", "settings": {"i2v_model": "..."}, "user_treatment": "optional short story", "project_id": optional}.
The MCP tool takes project (a Project id or exact name).
user_treatment becomes the creative source the Director writes cuts from.
GET $B/api/music-video/$ID
shows current_stage awaiting_approval with cuts: before analysis finishes the approve
route answers 409.아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.
로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.
아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.
Build consistent characters, environments and props in Guaardvark's Cast Library and train LoRAs for them locally (reference photos → vision bible → sample plan → approved samples → training). Use when the user wants the same face or object across images, videos, a music video, or a Film Crew production, or asks to "train a LoRA".
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Code intelligence over repositories Guaardvark has indexed: semantic code search, exact-text search, file listing, PageRank repository map, import dependency graph, reading one class or function, analysis and generated rewrites, plus the System Mapper and self-improvement status. Use when the user asks where something is implemented, how modules depend on each other, or wants an architecture map of an indexed repo.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Run Guaardvark's five-role Film Crew locally: screenwriter, casting (Cast Library LoRAs), cinematographer storyboards, keyframe renders, editor. Turns a logline or screenplay into a finished short video with human gates at casting and storyboard. Use when the user says "film this", "make a short film", "storyboard this script", or "start the film crew".
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Generate or edit images on the user's own GPU through Guaardvark: single images, instruction edits, background cut-outs, inpaint and outpaint, consistent characters from the Cast Library, and batch runs of many prompts. Use when the user asks to create, draw, render, visualize, edit, or batch-generate images locally.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Answer from the user's own indexed documents with Guaardvark's local RAG, browse and read indexed files section by section, remember facts across sessions, and process or fetch new material. Use when the user asks what their documents say, wants a source-cited answer from their files, says "remember this", or asks to index a PDF, DOCX, spreadsheet, image or URL.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Add any Hugging Face image or video model, checkpoint or LoRA to Guaardvark from a URL, list what is installed, and download registry models on request. Use when the user pastes a huggingface.co link or a .safetensors URL, asks "can it run <model>", or wants a new LoRA or checkpoint available in the Studio.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.