Generate accessibility alt text for an image with a local vision LLM. Wraps kuzco's tool_llm_image_alt_text() ellmer tool. Use when the task needs a short textual description of an image, e.g. for accessibility, captions, or image indexing.
The English summary is being prepared. Showing the original description.
See how to installReview the instructions the agent will receive before you install.
Generate alt text for an image using a local vision language model, exposed as an ellmer tool by the kuzco R package.
The user wants a textual description of an image: accessibility alt text, a caption, or a quick summary of image contents for indexing or search.
Register the tool on an ellmer chat. The model and provider are fixed at registration; the LLM controls the image path, extra prompt text, and output language per call.
library(kuzco)
library(ellmer)
chat <- chat_ollama(model = "qwen2.5vl")
chat$register_tool(tool_llm_image_alt_text())
To use a different model or a hosted provider, pass them to the constructor:
chat$register_tool(tool_llm_image_alt_text(
llm_model = "qwen2.5vl",
provider = "ollama"
))
image (required): local file path to a jpeg, jpg, or png image.additional_prompt (optional): extra instructions appended to the image prompt,
e.g. "focus on the people in the foreground".language (optional): output language, e.g. "English", "Spanish".Compact JSON text describing the image, returned to the model as the tool result. Relay the description to the user; do not invent details beyond what the tool returned.
User: "Write alt text for img/photo.jpg"
- Call
kuzco_image_alt_textwithimage = "img/photo.jpg".- Return the description as the alt text.
No reviews yet. Tell others what you thought.
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
Classify an image and describe its contents with a local vision LLM. Wraps kuzco's tool_llm_image_classification() ellmer tool. Use when the task needs image classification, object identification, or a structured description of what an image contains.
The English summary is being prepared. Showing the original description.
Run a custom computer-vision prompt against an image with a local vision LLM. Wraps kuzco's tool_llm_image_custom() ellmer tool. Use when none of the specialized kuzco image skills (classification, OCR, recognition, sentiment, alt text) fit the task.
The English summary is being prepared. Showing the original description.
Extract text visible in an image (OCR) with a local vision LLM. Wraps kuzco's tool_llm_image_extract_text() ellmer tool. Use when the task needs reading text from screenshots, documents, signs, labels, or any image containing writing.
The English summary is being prepared. Showing the original description.
Recognize and locate instances of an object in an image with a local vision LLM. Wraps kuzco's tool_llm_image_recognition() ellmer tool. Use when the task needs finding, counting, or locating specific objects (faces, cars, animals) in an image.
The English summary is being prepared. Showing the original description.
Analyze the sentiment or mood conveyed by an image with a local vision LLM. Wraps kuzco's tool_llm_image_sentiment() ellmer tool. Use when the task needs the emotional tone of an image, e.g. for content moderation, marketing, or curation.
The English summary is being prepared. Showing the original description.