Skip to content
cccskills

Results for “benchmarking”

202 skills · sorted by relevance

data-throughput-accelerator

FreeSummaryAI rating 90

Find bottlenecks in large data transfers, imports, transformations, and historical data catch-up. Benchmark alternative processing methods, turn the fastest correct approach into a repeatable workflow, and verify file counts, row counts, and timestamps after execution.

  • Speeding up large data imports and exports
  • Reducing the time needed to load historical data
  • Comparing batch sizes and worker counts
affaan-m/ECC284.6KUpdated Oct 20, 2026

eval-harness

FreeSummaryAI rating 90

Define success criteria before AI coding, then assess new capabilities and check that existing behavior still works using code, rules, models, or human review. Track repeated-attempt success metrics and reports to compare prompt changes, agent changes, or model versions.

  • Defining success criteria before AI implementation
  • Checking existing behavior after prompt or agent changes
  • Measuring reliability across repeated attempts
affaan-m/ECC284.6KUpdated Oct 20, 2026

benchmark-methodology

FreeSummaryAI rating 100

Compare competitors using evidence-backed scores for positioning, brand expression, services, credibility, and other dimensions. Produce consistent profile cards and a two-axis chart showing which rivals occupy the market position your client wants to claim.

  • Comparing competitors with consistent scoring criteria
  • Preparing evidence-backed competitor profile cards
  • Mapping rivals against two strategic goals
affaan-m/ECC284.6KUpdated Oct 20, 2026

competitive-report-structure

FreeSummaryAI rating 100

Turn scored competitor profiles into a report for strategic decisions. Organize market maps, comparison tables, unoccupied positions, threats, and prioritized recommendations so leaders can decide whom to compete with and how to differentiate.

  • Preparing a competitive report for leadership or a board
  • Combining completed competitor profiles
  • Assessing room for differentiation and competitive threats
affaan-m/ECC284.6KUpdated Oct 20, 2026

Measure and optimize claude-flow v3 startup, search, attention processing, and memory use. Compare benchmarks against performance targets, track changes over time, and identify regressions to guide further optimization.

  • Compare performance before and after v3 optimization
  • Evaluate vector search speed and memory use
  • Track performance regressions over time
ruvnet/RuView98.9KUpdated Oct 20, 2026

Measure Storybook startup from launching the process to displaying the first story. Separate server readiness from browser rendering, summarize repeated runs, and compare versions or feature flags to investigate slower startup.

  • Measure startup through the first story render
  • Compare Storybook versions or feature flags
  • Summarize repeated startup measurements
storybookjs/storybook91.3KUpdated Oct 20, 2026

Measure code performance and run benchmarks to investigate slow operations, regressions, or memory pressure. Establish a baseline, compare results under matching conditions, report variability, and rerun correctness tests after optimization.

  • Investigate slow operations
  • Compare performance before and after a change
  • Measure performance when memory pressure occurs
ruvnet/ruflo77.6KUpdated Oct 20, 2026

Measure and optimize claude-flow v3 startup, search, attention processing, and memory use. Compare benchmarks against performance targets, track changes over time, and identify regressions to guide further optimization.

  • Compare performance before and after v3 optimization
  • Evaluate vector search speed and memory use
  • Track performance regressions over time
ruvnet/ruflo77.6KUpdated Oct 20, 2026

add-lang

FreeSummary

Add support for a programming language to codegraph, from connecting its parser and implementing code extraction to writing tests. Evaluate extraction quality and compare agent effort with and without codegraph across three real codebases.

  • Adding a new programming language to codegraph
  • Testing extraction of functions, imports, and calls
  • Comparing agent effort across three real codebases
colbymchenry/codegraph74.5KUpdated Oct 20, 2026

waypoint-bio

FreeSummary

Work with Waypoint models to analyze microbiome samples, the communities of microbes in a sample. Convert taxonomic abundance tables, generate numerical sample representations, configure further training for prediction tasks, and evaluate models on the Compass benchmark.

  • Convert microbiome abundance tables into Waypoint inputs
  • Generate sample vectors for clustering and visualization
  • Configure further training with sample labels
K-Dense-AI/scientific-agent-skills53.2KUpdated Oct 19, 2026

pymoo

FreeSummary

Solve optimization problems in Python with one or several competing goals. Define constraints, compare search algorithms, visualize trade-offs, and assess candidate solutions before choosing an option that fits your priorities.

  • Comparing designs with competing cost and performance goals
  • Searching for solutions under explicit constraints
  • Benchmarking optimization algorithms
K-Dense-AI/scientific-agent-skills53.2KUpdated Oct 19, 2026

Create consistent records for evaluating AI agents, including task success, invalid tool calls, token use, and actual costs. Produce CSV tables, database definitions, and JSON validation schemas to support reproducible comparisons and checks for performance declines.

  • Recording agent evaluation results in a shared format
  • Comparing a candidate agent with a baseline
  • Tracking actual cost per solved task
sickn33/agentic-awesome-skills48.1KUpdated Oct 19, 2026

Compare prompt revisions on a fixed set of test cases to identify regressions, meaning behavior that gets worse after a change. Record model settings, case-level evidence, missing results, costs, and evaluation limits for a reviewable decision.

  • Comparing original and revised prompts
  • Checking required JSON fields after prompt changes
  • Reviewing tool selection and task completion
sickn33/agentic-awesome-skills48.1KUpdated Oct 19, 2026

Turns supplied AI agent evaluation results into reports that distinguish autonomous success, human-assisted success, failure, timeout, and invalid runs. Makes metric denominators, retries, timing, costs, and comparison conditions explicit to support evidence-based decisions.

  • Separating autonomous and human-assisted success rates
  • Reporting evaluations with retries and invalid runs
  • Comparing agents or releases under matched conditions
sickn33/agentic-awesome-skills48.1KUpdated Oct 19, 2026

Choose and track startup metrics suited to the business model and funding stage. Calculate customer acquisition cost, customer lifetime value, retention, and cash usage, then organize trends and targets for operational reviews and investor reporting.

  • Choose core metrics for a startup's stage and business model
  • Calculate customer acquisition cost and lifetime value
  • Review retention, growth efficiency, and cash usage
wshobson/agents41.2KUpdated Oct 20, 2026

llm-evaluation

FreeSummary

Evaluate LLM applications using automated scores, human reviews, and model-based judging. Build repeatable checks to compare models or prompts, assess answer quality, and detect declines in performance before deployment.

  • Comparing models and prompts
  • Checking quality after prompt changes
  • Detecting performance declines before deployment
wshobson/agents41.2KUpdated Oct 20, 2026

add-sgl-kernel

FreeSummary

Add a CUDA/C++ GPU operation to sgl-kernel using AOT, meaning compilation before use. Follow the implementation through PyTorch registration, Python API exposure, SGLang integration, correctness tests, and benchmarks that account for cache reuse.

  • Adding a CUDA/C++ operation to sgl-kernel
  • Registering an operation with PyTorch and exposing a Python API
  • Testing numerical results and invalid inputs
sgl-project/sglang37.5KUpdated Oct 20, 2026

Measure denoising latency in SGLang diffusion models and identify slow operations with profiler traces. Compare performance and output quality on the same GPUs, check existing optimizations, and gather evidence before starting low-level kernel work.

  • Measuring diffusion denoising latency
  • Ranking slow operations from profiler traces
  • Checking whether existing optimizations address a bottleneck
sgl-project/sglang37.5KUpdated Oct 20, 2026

Set up and run kube-bench to check Kubernetes configuration against CIS security benchmarks. Select the appropriate benchmark and cluster components, then export JSON or JUnit results for automated pipelines and troubleshoot skipped checks or incorrect detection.

  • Setting up kube-bench for the first time
  • Selecting benchmark versions and scan targets
  • Exporting JSON or JUnit results for CI
mukul975/Anthropic-Cybersecurity-Skills34.8KUpdated Aug 31, 2026

agent-evaluation

FreeSummary

Design tests that assess an AI agent's capabilities and reliability. Covers repeated runs to measure variation, checks for required behavior, and adversarial testing to expose failures that ordinary successful examples may miss.

  • Measuring variation across repeated runs of the same test
  • Checking whether an agent follows required behavior
  • Testing responses to unexpected or adversarial inputs
davila7/claude-code-templates32.8KUpdated Oct 20, 2026

comp-analysis

FreeSummary

Compare compensation with market benchmarks by role, level, and location. Analyze salary band placement, flag outliers and retention risks, and model equity grants, meaning share-based compensation, to support hiring offers and compensation reviews.

  • Compare a hiring offer with market compensation
  • Review employee placement within salary bands
  • Identify compensation outliers and retention risks
anthropics/knowledge-work-plugins30.7KUpdated Oct 20, 2026

Analyze social media post data to calculate engagement, click rates, and estimated returns on advertising spend. Compare results with supplied platform benchmarks, identify strong and weak posts, and generate recommendations for improving campaign performance.

  • Review social campaign performance
  • Identify posts with strong or weak engagement
  • Estimate advertising returns and interaction costs
alirezarezvani/claude-skills28.4KUpdated Aug 30, 2026

hivemind

FreeSummary

Delegate research, coding, and testing from Claude Code to opencode workers. Run independent tasks in parallel with separate Git working directories, combine findings, track token use, and compare solo execution with coordinated workers.

  • Delegate a small task to one opencode worker
  • Implement independent changes in parallel
  • Review a diff from four perspectives
alirezarezvani/claude-skills28.4KUpdated Aug 30, 2026

ml-engineering

FreeSummary

Plan and troubleshoot large language and vision model training and inference. This guide uses hardware measurements to identify bottlenecks, address memory shortages and unstable training, and improve checkpointing, recovery, and performance across multiple GPUs and machines.

  • Diagnosing slow training and GPU memory shortages
  • Investigating loss spikes and invalid numerical values
  • Debugging communication hangs across GPUs and machines
stas00/ml-engineering19.6KUpdated Oct 17, 2026