Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.
インストールする前に、エージェントに与えられる指示の中身を確認できます。
Read setup first. Needs the comfyui plugin and an installed i2v model
(wan22-5b by default; minimax-h3-int8 for frame-matched continuity).
generate_music_videosong: document id or a filesystem path to mp3/wav/flac/ogg. A path is uploaded for the user.style_prompt: mood, palette, movement, era ("grainy 16 mm, neon rain, slow dolly, 1984").name (defaults to the song file name), i2v_model (defaults to the active i2v model).B=${GUAARDVARK_URL:-http://localhost:5000}, ID = the project id the tool returned.
| step | call | what it does |
|---|---|---|
| read the plan | GET $B/api/music-video/$ID | cuts, prompts, status, storyboard state |
| edit prompts | POST $B/api/music-video/$ID/plan with the edited cut prompts (and optional global style) | operator edits before render |
| regenerate the plan | POST $B/api/music-video/$ID/regenerate-plan or /replan | new prompts from the Director |
| storyboards first | POST $B/api/music-video/$ID/generate-storyboards | one keyframe still per cut, thumbnails-first review |
| redo one keyframe | POST $B/api/music-video/$ID/regen-storyboard/<idx> | keeps the others |
| approve | POST $B/api/music-video/$ID/approve | releases per-clip generation. Only on the user's explicit yes |
| re-analyse | POST $B/api/music-video/$ID/analyze | restart song analysis |
| cancel | POST $B/api/music-video/$ID/cancel | |
| list all | GET $B/api/music-video |
Creating a project without the MCP tool: POST $B/api/music-video with
{"name", "song_document_id", "style_prompt", "settings": {"i2v_model": "..."}, "user_treatment": "optional short story"}.
user_treatment becomes the creative source the Director writes cuts from.
GET $B/api/music-video/$ID
shows current_stage awaiting_approval with cuts: before analysis finishes the approve
route answers 409.まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Build consistent characters, environments and props in Guaardvark's Cast Library and train LoRAs for them locally (reference photos → vision bible → sample plan → approved samples → training). Use when the user wants the same face or object across images, videos, a music video, or a Film Crew production, or asks to "train a LoRA".
日本語の概要は準備中です。原文の説明を表示しています。
Code intelligence over repositories Guaardvark has indexed: semantic code search, exact-text search, file listing, PageRank repository map, import dependency graph, reading one class or function, analysis and generated rewrites, plus the System Mapper and self-improvement status. Use when the user asks where something is implemented, how modules depend on each other, or wants an architecture map of an indexed repo.
日本語の概要は準備中です。原文の説明を表示しています。
Run Guaardvark's five-role Film Crew locally: screenwriter, casting (Cast Library LoRAs), cinematographer storyboards, keyframe renders, editor. Turns a logline or screenplay into a finished short video with human gates at casting and storyboard. Use when the user says "film this", "make a short film", "storyboard this script", or "start the film crew".
日本語の概要は準備中です。原文の説明を表示しています。
Generate or edit images on the user's own GPU through Guaardvark: single images, instruction edits, background cut-outs, inpaint and outpaint, consistent characters from the Cast Library, and batch runs of many prompts. Use when the user asks to create, draw, render, visualize, edit, or batch-generate images locally.
日本語の概要は準備中です。原文の説明を表示しています。
Answer from the user's own indexed documents with Guaardvark's local RAG, browse and read indexed files section by section, remember facts across sessions, and process or fetch new material. Use when the user asks what their documents say, wants a source-cited answer from their files, says "remember this", or asks to index a PDF, DOCX, spreadsheet, image or URL.
日本語の概要は準備中です。原文の説明を表示しています。
Add any Hugging Face image or video model, checkpoint or LoRA to Guaardvark from a URL, list what is installed, and download registry models on request. Use when the user pastes a huggingface.co link or a .safetensors URL, asks "can it run <model>", or wants a new LoRA or checkpoint available in the Studio.
日本語の概要は準備中です。原文の説明を表示しています。