Use this skill to understand image contents with GPT-4 Vision. It can describe a picture, extract text from screenshots, identify visible objects, and answer questions about an image, returning the result in a structured format.
中文简介正在准备中。当前显示英语简介。
Analyze images using GPT-4 Vision for detailed description, OCR text extraction, object recognition, and visual Q&A. Use when the user needs to understand image content, extract text from screenshots, identify objects in photos, or ask questions about images via OpenAI GPT-4 Vision API.
实测评分 未实测
查看安装方法安装前可以查看交给 AI 代理的指令内容。
一个基于 OpenAI GPT-4 Vision 的图片理解工具，支持图片描述、文字识别(OCR)、物体识别和图片问答。
| 功能 | 命令 | 说明 |
|---|---|---|
| 图片描述 | -m describe | 详细描述图片内容 |
| 文字提取 | -m ocr | 提取图片中的所有文字 |
| 物体识别 | -m objects | 识别并列出图片中的物体 |
| 图片问答 | -m qa | 针对图片回答问题 |
# 安装依赖
pip install openai pillow requests
set OPENAI_API_KEY=sk-your-api-key-here
python scripts/main.py -i photo.jpg -a sk-your-key
# 描述图片
python scripts/main.py -i photo.jpg -m describe
# 提取文字（OCR）
python scripts/main.py -i screenshot.png -m ocr
# 识别物体
python scripts/main.py -i photo.jpg -m objects
# 图片问答
python scripts/main.py -i photo.jpg -m qa -q "这个图片里有什么？"
python scripts/main.py \
--image PATH_TO_IMAGE \
--mode describe|ocr|objects|qa \
--api-key YOUR_API_KEY \
--prompt "你的问题" \
--output OUTPUT.json \
--verbose
{
"mode": "describe",
"image": "photo.jpg",
"result": "A beautiful sunset over the ocean with orange and purple sky...",
"objects": [],
"text": ""
}
还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Save useful facts, user preferences, skills, rules, and lessons from errors to long-term memory. Each entry can include an importance level to indicate whether it should be retained as a lasting preference, a common pattern, or temporary information.
中文简介正在准备中。当前显示英语简介。
Click a button, link, or other page element by providing a CSS selector or matching text. First open the target page with `browser_navigate`, then use this skill to select the element to click.
中文简介正在准备中。当前显示英语简介。
Read text from the current webpage, either across the whole page or from an element selected with a CSS selector. Use it to check page information, retrieve displayed element values, extract text, or verify what a page contains.
中文简介正在准备中。当前显示英语简介。
See every open browser tab with its zero-based index, URL, and page title. This makes it easier to find a specific page, review what is open, or identify a tab before switching to it during browser work.
中文简介正在准备中。当前显示英语简介。
Open a web page at a specified URL and prepare the browser for later interaction. Use it before clicking page elements or typing into fields; the browser starts automatically if it is not already running.
中文简介正在准备中。当前显示英语简介。
Open a URL in a new browser tab while keeping the current page available. Use it to work across multiple pages without losing your place; the browser must already be running before the new tab can be opened.
中文简介正在准备中。当前显示英语简介。