FreePublished on GitHub

mk:multimodal

Process images, video, audio, PDFs with Gemini API. Generate images (Nano Banana 2), videos (Veo 3), speech (MiniMax TTS), music (MiniMax). Convert documents to Markdown. Multi-provider fallback (Gemini → MiniMax → OpenRouter). Activate when task references media files, asks to analyze/describe/transcribe/extract/generate/convert, or involves non-text binary files.

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit

Works withGemini

See how to install

Files included (33)

SKILL.md6.9 KB
.env.example465 B
references/audio-processing.md1.4 KB
references/document-conversion.md1.4 KB
references/image-generation.md1.9 KB
references/minimax-generation.md1.9 KB
references/models-and-pricing.md2.2 KB
references/video-analysis.md2.0 KB
references/video-generation.md1.4 KB
references/vision-understanding.md1.5 KB
scripts/analyze_constants.py4.6 KB
scripts/analyze_core.py6.9 KB
scripts/api_key_rotator.py1.7 KB
scripts/check_setup.py3.9 KB
scripts/document_converter.py5.1 KB
scripts/env_utils.py2.0 KB
scripts/gemini_analyze.py3.0 KB
scripts/gemini_generate.py6.1 KB
scripts/media_optimizer.py2.9 KB
scripts/minimax_api_client.py4.6 KB
scripts/minimax_generate.py7.8 KB
scripts/openrouter_fallback.py3.9 KB
scripts/provider_router.py6.7 KB
scripts/requirements.txt244 B
scripts/tests/env_isolation.py250 B
scripts/tests/run_tests.py1.3 KB
scripts/tests/test_check_setup.py3.8 KB
scripts/tests/test_gemini_analyze.py13.9 KB
scripts/tests/test_gemini_generate.py9.1 KB
scripts/video_generator.py2.7 KB
workflows/audio-transcription.md1.2 KB
workflows/document-extraction.md1.3 KB
workflows/image-analysis.md1.2 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Multimodal Analysis & Generation

Path convention: Commands below assume cwd is $CLAUDE_PROJECT_DIR (project root). Prefix paths with "$CLAUDE_PROJECT_DIR/" when invoking from subdirectories.

Model selection and commands

Use the configured analysis default for media understanding. Generation routes Gemini → MiniMax → OpenRouter as keys permit. Provider model IDs, preview availability, and pricing change frequently: load references/models-and-pricing.md at execution time and verify preview IDs against the provider dashboard before relying on one.

Task	Script
Analyze, transcribe, extract	`scripts/gemini_analyze.py`
Generate image or video with routing	`scripts/gemini_generate.py`
Generate MiniMax image, video, speech, music	`scripts/minimax_generate.py`
Convert document to Markdown	`scripts/document_converter.py`
Validate keys and dependencies	`scripts/check_setup.py`

.claude/skills/.venv/bin/python3 .claude/skills/multimodal/scripts/gemini_analyze.py \
  --files <path> --task <analyze|transcribe|extract> [--resolution low-res] [--json]

References

Load only when executing the corresponding step.

Reference	When to load	Content
vision-understanding.md	Image analysis	Detection, segmentation, OCR
audio-processing.md	Audio/video transcription	Formats, splitting, timestamps
models-and-pricing.md	Model selection, cost	Full model table, pricing
image-generation.md	Image generation	Nano Banana 2, OpenRouter fallback
video-generation.md	Video generation	Veo 3.1, async polling
video-analysis.md	Video analysis	Resolution modes, cost math
minimax-generation.md	MiniMax generation	Image, video, TTS, music
document-conversion.md	Document conversion	Formats, batch mode

When to Use

Auto-activate on these patterns:

Task references image (.png, .jpg, .webp), video (.mp4, .mov), audio (.mp3, .wav), or document (.pdf, .docx) files
Task asks to "analyze", "describe", "transcribe", "extract", "OCR"
Task asks to "generate image", "generate video", "create image"
Task asks to "generate speech", "text to speech", "TTS"
Task asks to "generate music", "create music"
Task asks to "convert document", "convert PDF to markdown"
User references a non-text binary file for processing

Do NOT invoke when: text-only files (use Read), Gemini API docs (use mk:docs-finder), already-described image in context.

API key check

Use MEOWKIT_GEMINI_API_KEY (or legacy GEMINI_API_KEY); without it, generation may use MEOWKIT_MINIMAX_API_KEY. If neither is present, stop with setup instructions.

Analysis Process

Detect media format → select model (default: gemini-2.5-flash) → run script. For >20MB files, use File API. Use --resolution low-res for video (62% savings, video only). Output capped at ~3000 tokens; prefer structured JSON/Markdown.

Generation Process

Provider router auto-selects best available provider by checking API keys:

Image: Gemini → MiniMax → OpenRouter
Video: Gemini → MiniMax
TTS: MiniMax only
Music: MiniMax only

Force a provider: --provider gemini|minimax|openrouter. Override chain order via MEOWKIT_IMAGE_PROVIDER_CHAIN etc.

Gotchas

Python venv required: if you get python3: command not found or import errors, run .claude/scripts/bin/setup-workflow once from the project root.
Audio >15 min: Gemini truncates silently. Split first.
PDF >100 pages: Quality degrades. Process in 20-page chunks.
Video cost: ~263 tokens/sec at default resolution. Use --verbose for cost estimate.
Image gen requires billing: Free tier = no gen. Use MiniMax/OpenRouter as fallback.
MiniMax video timeout: Hailuo takes 60-180s. Max 600s.
TTS voices: load the provider catalog at execution time; voice inventories change.
Temperature: Keep Gemini at 1.0. Lowering causes degraded output.

Failure Handling

Missing API key → STOP + setup instructions
Invalid key (401) → STOP + re-check key
Rate limit (429) → key rotation (MEOWKIT_GEMINI_API_KEY_2/3/4), else wait 60s
Billing required → provider router tries MiniMax/OpenRouter fallback

Setup

Set MEOWKIT_GEMINI_API_KEY in env or .env file. Legacy GEMINI_API_KEY also works. Optional: MEOWKIT_MINIMAX_API_KEY for TTS/music and alternative generation.

Budget rule: ≤3000 tokens inline. If response exceeds budget, summarize key findings before returning.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

More skills from this repository

meowkit-design

Free

Use this skill to generate well-branded interfaces and assets for MeowKit (AI Agent Toolkit for Claude Code), either for production or throwaway prototypes/mocks/etc. Contains essential design guidelines, colors, type, fonts, assets, and UI kit components for prototyping.

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

mk-advise

Free

Turn a raw idea into ONE honest recommendation: interview one question at a time until confirmed, then give a verdict with trade-offs and a checklist. Not for options or debate.

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

mk-agent-browser

Free

Browser automation CLI for agents: navigate, click/fill, screenshot, extract data, test apps, Electron/Slack, cloud browsers. NOT for the user's real Chrome profile/cookies (mk:chrome-profile).

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

mk-agent-detector

Free

Detects the right agent and complexity tier at Phase 0 orient; runs first in every workflow. NOT for runtime agent routing inside a single skill.

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

mk-angular

Free

Angular v20+ patterns: components, signals, services, forms, routing, HTTP, testing, SSR. Auto-activates on .ts files in Angular projects (angular.json detected).

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

mk-api-design-principles

Free

Design and review durable REST, GraphQL, RPC, or event API contracts: shape, compatibility, pagination, error semantics. Discovers existing consumers first. Not implementation, schema, or release.

The English summary is being prepared. Showing the original description.

ngocsangyem/MeowKit15Updated Jul 28, 2026

See all skills by ngocsangyem

Report a problem with this skill

Install

Install with a command

npx skills add https://github.com/ngocsangyem/MeowKit --skill mk:multimodal

Paste it into your terminal and run it (requires Node.js). You can choose which agents to install it for, such as Claude Code or Codex.

Ask your agent

Please install the following Agent Skill.
https://github.com/ngocsangyem/MeowKit/tree/main/.claude/skills/multimodal

First review SKILL.md and the bundled files and confirm there is nothing suspicious (such as sending data externally or reading credentials). Then place it in ~/.claude/skills/mk:multimodal/ for Claude Code, or ~/.agents/skills/mk:multimodal/ for Codex.

Send this text to Claude Code or Codex as is. It checks the contents before installing.

View source on GitHub

Repository: ngocsangyem/MeowKit
Stars: 15
Forks: 2
Category: Media
License: MIT
Original language: English
Last updated: Jul 28, 2026

A skill is a set of instructions and scripts for an agent. cccskills does not guarantee that skills are safe. Review the contents before you install.