Use Caliper to run real agent tasks with and without a skill, MCP server, or rule change so reliability and token cost are measurable.
日本語の概要は準備中です。原文の説明を表示しています。
Run realistic enterprise-style IT scenarios before trusting an automation agent in production operations.
インストールする前に、エージェントに与えられる指示の中身を確認できます。
Run realistic enterprise-style IT scenarios before trusting an automation agent in production operations.
Python environment, benchmark dependencies, access to supported scenario environments or self-hosted setup tooling, target agent implementation
Basic usage or getting-started notes:
The ITBench Leaderboard tracks agent performance across SRE, FinOps, and CISO scenarios. We provide fully managed scenario environments while researchers/developers run their agents on their own systems and submit the...
Have questions or need help getting started with ITBench?
Extracted from upstream docs: https://raw.githubusercontent.com/itbench-hub/ITBench/HEAD/README.md
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Use Caliper to run real agent tasks with and without a skill, MCP server, or rule change so reliability and token cost are measurable.
日本語の概要は準備中です。原文の説明を表示しています。
Builds citation networks from Semantic Scholar API and CrossRef DOI metadata. Visualizes paper influence graphs using NetworkX, identifies seminal works, and tracks research lineage across fields.
日本語の概要は準備中です。原文の説明を表示しています。
Exposes Advanced Custom Fields data through the WordPress REST API using register_rest_field and acf_format_value. Handles repeater fields, flexible content layouts, and gallery fields with proper serialization.
日本語の概要は準備中です。原文の説明を表示しています。
An ASE skill built around ACF Extended, the WordPress enhancement suite for Advanced Custom Fields that adds field types, admin improvements, front-end forms, options pages, and developer tooling. It is a practical fit for agents working inside complex WordPress content models and custom field workflows.
日本語の概要は準備中です。原文の説明を表示しています。
Converts Advanced Custom Fields field groups into native Gutenberg blocks using the ACF Block API v2 and @wordpress/scripts build pipeline. Maps ACF repeaters, groups, and flexible content to InnerBlocks and block attributes with server-side rendering via acf_register_block_type().
日本語の概要は準備中です。原文の説明を表示しています。
act is an open-source CLI tool that runs GitHub Actions workflows locally using Docker, enabling fast feedback on workflow changes without pushing to GitHub. It is a standard tool for local Actions development and testing.
日本語の概要は準備中です。原文の説明を表示しています。