Classify an image and describe its contents with a local vision LLM. Wraps kuzco's tool_llm_image_classification() ellmer tool. Use when the task needs image classification, object identification, or a structured description of what an image contains.
インストールする前に、エージェントに与えられる指示の中身を確認できます。
Classify an image and describe its contents using a local vision language model, exposed as an ellmer tool by the kuzco R package.
The user wants to know what an image shows: its category, the primary and secondary objects, a description, dominant colors, or class probabilities. This is the default skill for "what is in this image?" questions.
library(kuzco)
library(ellmer)
chat <- chat_ollama(model = "qwen2.5vl")
chat$register_tool(tool_llm_image_classification())
image (required): local file path to a jpeg, jpg, or png image.additional_prompt (optional): extra instructions, e.g. "pay special attention to text on signs".language (optional): output language, e.g. "English".Compact JSON text with image_classification, primary_object, secondary_object,
image_description, image_colors, and image_proba_names / image_proba_values.
Summarize the key fields for the user; quote the description verbatim when asked for detail.
User: "What animal is in img/puppy.jpg?"
- Call
kuzco_image_classificationwithimage = "img/puppy.jpg".- Answer from
primary_objectandimage_description, mentioning the classification and confidence.
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Generate accessibility alt text for an image with a local vision LLM. Wraps kuzco's tool_llm_image_alt_text() ellmer tool. Use when the task needs a short textual description of an image, e.g. for accessibility, captions, or image indexing.
日本語の概要は準備中です。原文の説明を表示しています。
Run a custom computer-vision prompt against an image with a local vision LLM. Wraps kuzco's tool_llm_image_custom() ellmer tool. Use when none of the specialized kuzco image skills (classification, OCR, recognition, sentiment, alt text) fit the task.
日本語の概要は準備中です。原文の説明を表示しています。
Extract text visible in an image (OCR) with a local vision LLM. Wraps kuzco's tool_llm_image_extract_text() ellmer tool. Use when the task needs reading text from screenshots, documents, signs, labels, or any image containing writing.
日本語の概要は準備中です。原文の説明を表示しています。
Recognize and locate instances of an object in an image with a local vision LLM. Wraps kuzco's tool_llm_image_recognition() ellmer tool. Use when the task needs finding, counting, or locating specific objects (faces, cars, animals) in an image.
日本語の概要は準備中です。原文の説明を表示しています。
Analyze the sentiment or mood conveyed by an image with a local vision LLM. Wraps kuzco's tool_llm_image_sentiment() ellmer tool. Use when the task needs the emotional tone of an image, e.g. for content moderation, marketing, or curation.
日本語の概要は準備中です。原文の説明を表示しています。