Run a custom computer-vision prompt against an image with a local vision LLM. Wraps kuzco's tool_llm_image_custom() ellmer tool. Use when none of the specialized kuzco image skills (classification, OCR, recognition, sentiment, alt text) fit the task.
中文简介正在准备中。当前显示原文说明。
查看安装方法安装前可以查看交给 AI 代理的指令内容。
Run an arbitrary computer-vision prompt against an image using a local vision language model, exposed as an ellmer tool by the kuzco R package. This is the escape hatch for image tasks the specialized skills do not cover.
The task needs something from an image that classification, OCR, object recognition, sentiment analysis, or alt text do not capture — e.g. "count the windows", "is anyone wearing a red hat?", "describe the chart axes". Prefer a specialized skill when one fits; use this one otherwise.
library(kuzco)
library(ellmer)
chat <- chat_ollama(model = "qwen2.5vl")
chat$register_tool(tool_llm_image_custom())
image (required): local file path to a jpeg, jpg, or png image.image_prompt (required): the prompt describing what to extract or describe about
the image. Be specific: state exactly what to look for and what shape the answer
should take.system_prompt (optional): persona/style steering, defaults to a terse computer
vision assistant.Compact JSON text with the model's structured response to the custom prompt. Present it directly; do not reformat structured fields the user asked for.
User: "How many bicycles are in img/street.jpg?"
- Call
kuzco_image_customwithimage = "img/street.jpg"andimage_prompt = "Count the bicycles visible in the image. Return the count and briefly describe where each one is.".- Report the count and locations.
还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Generate accessibility alt text for an image with a local vision LLM. Wraps kuzco's tool_llm_image_alt_text() ellmer tool. Use when the task needs a short textual description of an image, e.g. for accessibility, captions, or image indexing.
中文简介正在准备中。当前显示原文说明。
Classify an image and describe its contents with a local vision LLM. Wraps kuzco's tool_llm_image_classification() ellmer tool. Use when the task needs image classification, object identification, or a structured description of what an image contains.
中文简介正在准备中。当前显示原文说明。
Extract text visible in an image (OCR) with a local vision LLM. Wraps kuzco's tool_llm_image_extract_text() ellmer tool. Use when the task needs reading text from screenshots, documents, signs, labels, or any image containing writing.
中文简介正在准备中。当前显示原文说明。
Recognize and locate instances of an object in an image with a local vision LLM. Wraps kuzco's tool_llm_image_recognition() ellmer tool. Use when the task needs finding, counting, or locating specific objects (faces, cars, animals) in an image.
中文简介正在准备中。当前显示原文说明。
Analyze the sentiment or mood conveyed by an image with a local vision LLM. Wraps kuzco's tool_llm_image_sentiment() ellmer tool. Use when the task needs the emotional tone of an image, e.g. for content moderation, marketing, or curation.
中文简介正在准备中。当前显示原文说明。