Investigate LLM application failures with Phoenix CLI by reviewing execution records, recording observations, and grouping mistakes into counted categories. Inspect datasets and experiments to identify which failure types deserve evaluation tests first.
- Investigating failures in LLM applications
- Grouping observed mistakes into failure categories
- Choosing which evaluation tests to build first
github/awesome-copilot☆ 40.3KUpdated Oct 21, 2026
Create shareable links that open specific Arize resources, including traces, datasets, and evaluators. Use IDs from logs or exported data, with suitable time ranges, to direct teammates to the relevant view.
- Share a trace with teammates
- Open an Arize view from IDs in logs
- Link directly to a dataset or evaluator
github/awesome-copilot☆ 40.3KUpdated Oct 21, 2026
Improve LLM prompts using Arize production traces, evaluation results, and human feedback. Extract current instructions, identify recurring failures, revise the prompt, and compare experiments to measure changes in output quality and catch regressions.
- Improve a prompt using failed production traces
- Fix responses that use the wrong output format
- Review unsupported answers in retrieval-based responses
github/awesome-copilot☆ 40.3KUpdated Oct 21, 2026
Navigate the Composio SDK monorepo, a repository containing multiple packages, and follow its shared development rules. Use it to decide where changes belong, handle generated files and release metadata, and prepare branches and pull requests.
- Planning changes across multiple packages
- Deciding where code belongs
- Checking generated-file and release metadata rules
ComposioHQ/composio☆ 30.7KUpdated Oct 21, 2026
Evaluate a strategic choice through multiple executive roles, each forming an independent view before discussion. Produce a board memo with recommendations, votes, dissent, risks, and success or stop conditions for the founder's decision.
- Reviewing a pricing change across business functions
- Comparing fundraising with spending cuts
- Gathering independent views from executive roles
alirezarezvani/claude-skills☆ 28.5KUpdated Aug 30, 2026
Track work across sessions with persistent issues, dependencies, and progress notes. Use the bd command-line tool to find unblocked work, claim issues, record completion, and recover task context after conversation compaction.
- Track feature work across multiple sessions
- Find work that has no unresolved blockers
- Recover task context after conversation compaction
gastownhall/beads☆ 28.1KUpdated Oct 21, 2026
Explore relationships between functions and files using a prebuilt code graph, a map of code dependencies. Trace bugs, inspect callers and execution paths, and assess the impact of refactoring or proposed changes.
- Explore callers and dependencies in unfamiliar code
- Trace a bug across multiple files
- Assess the impact of renaming or removing code
handsontable/handsontable☆ 22.1KUpdated Oct 21, 2026
Add DeepEval tracing to Python AI applications so execution steps appear in Confident AI. Choose a supported integration or manual @observe instrumentation, then capture inputs, outputs, step types, tags, and metadata.
- Trace execution steps in a Python AI application
- Select tracing integrations for an existing framework
- Add manual tracing with @observe
confident-ai/deepeval☆ 19KUpdated Oct 19, 2026
Keep context for work that spans multiple sessions without belonging to a specific project phase. The skill manages lightweight persistent threads, letting you create, list, resume, check, and close them as work progresses.
- Keeping context for work across sessions
- Recording work outside a specific phase
- Listing open or resolved threads
open-gsd/gsd-core☆ 10.7KUpdated Oct 21, 2026
Add Sentry error reporting and performance monitoring to services, scheduled jobs, and database operations. Follow examples for capturing exceptions with useful context and measuring execution time through spans, which record individual operations for investigation.
- Adding error reporting to an API
- Recording failures and execution time for scheduled jobs
- Measuring database and asynchronous operations
diet103/claude-code-infrastructure-showcase☆ 10KUpdated Jul 14, 2026
Official · CodexFreeSummary Design, review, and implement Gantt charts for project schedules. Assess source data, task dependencies, and resource needs, then define suitable views, editing behavior, rendering tools, accessibility, exports, and tests—or recommend a clearer alternative.
- Choose between a Gantt chart, Kanban board, or timeline
- Map project-management exports into schedule data
- Review dependencies, critical path, and baseline variance
openai/plugins☆ 7.5KUpdated Oct 8, 2026
Coordinate Cloud Claw workflows from launching an agent deployment to managing its virtual machine. It routes work to focused skills for setup, starting and stopping machines, viewing logs, renewing usage, and accessing dashboards through local altllm commands.
- Launch an agent deployment and manage it afterward
- Inspect, start, or stop an existing virtual machine
- Review logs and access a deployment dashboard
internet-court/internet-court-skill☆ 6.8KUpdated Aug 20, 2026
Coordinate AltLLM Portal CLI tasks across wallet login, API key management, credit balances, billing history, and crypto top-ups. This umbrella skill routes each part of a broader workflow to the relevant specialized skill.
- Log in with a wallet and create an API key
- Review credit balance, transactions, and usage together
- Create a payment link and check its status
internet-court/internet-court-skill☆ 6.8KUpdated Aug 20, 2026
Turn a multi-file development task or technology migration into a specification with acceptance criteria, then launch background implementation and verification. The workflow clarifies missing requirements, reviews the specification, and tracks progress and blockers through linked jobs.
- Implementing a feature across multiple files
- Migrating a framework or programming language
- Replacing authentication, storage, or API layers
Q00/ouroboros☆ 6.3KUpdated Oct 21, 2026
Official · VercelFreeSummary Plan complex coding changes by exploring existing code, clarifying requirements, and tracing effects across the system. Produce a PLAN.md with recommended changes, affected files, and verification steps, then implement after the user approves.
- Planning a feature that spans multiple files
- Comparing architectural approaches
- Clarifying requirements before coding
vercel-labs/open-agents☆ 5.9KUpdated Aug 29, 2026
Review explicitly selected tests or bounded pull request changes without running or editing code. Receive a follow-up decision for each test, A–F quality bands where assessable, evidence-based notes, and concrete suggestions for improvement.
- Reviewing a named test method
- Assessing every test in explicitly selected files
- Preparing per-test feedback for pull request changes
dotnet/skills☆ 5.7KUpdated Oct 21, 2026
Assign incoming support tickets to the team best placed to resolve them and set priority based on customer impact. Handle cases involving two teams, and write brief internal summaries describing the problem and what the customer already tried.
- Choose the team responsible for an incoming ticket
- Set priority based on customer impact
- Route tickets that involve two teams
Kiln-AI/Kiln☆ 5.2KUpdated Oct 21, 2026
Add OpenTelemetry tracing to frontend and backend flows. Connect execution records across services and background jobs, record phase durations and entity IDs, and mark failures so developers can investigate slow or broken operations.
- Tracing a user action across multiple services
- Investigating slow queues and background jobs
- Connecting missing or disconnected traces
macro-inc/macro☆ 4.8KUpdated Oct 21, 2026
Instrument browser/web apps with the Application Insights JavaScript SDK (@microsoft/applicationinsights-web). Use for Real User Monitoring (RUM) — page views, clicks, AJAX/fetch dependencies, exceptions, custom events, and browser-side GenAI agent traces correlated to backend OpenTelemetry traces. Covers SDK Loader Script and npm setup, framework extensions (React, React Native, Angular), Click Analytics, telemetry initializers, and OTel GenAI semantic conventions for agent/tool/model spans emitted from the browser.
The English summary is being prepared. Showing the original description.
microsoft/skills☆ 3.1KUpdated Oct 21, 2026
Map the full ecosystem of touchpoints, channels, and relationships across a service. Use when the experience spans more than one product. For one persona's linear journey use `journey-map` (design-research); for backstage operations use `service-blueprint`.
The English summary is being prepared. Showing the original description.
Owl-Listener/designer-skills☆ 3KUpdated Sep 6, 2026
Use when measuring or improving agent quality and performance — set up evaluators, online monitoring, CI/CD quality gates, observability, or cost optimization. Triggers on: "evaluate my agent", "add evaluator", "measure quality", "quality gate", "run evals", "agent too slow", "why is it slow", "reduce latency", "set up observability", "CloudWatch dashboard", "how much does my agent cost", "cost optimization", "logs not showing up", "logs missing", "spans not found", "eval failing", "eval error", "dev traces", "local traces", "agentcore dev traces", "traces to CloudWatch". Not for debugging errors or crashes — use agents-debug. Slow but correct routes here; broken routes to debug.
The English summary is being prepared. Showing the original description.
aws/agent-toolkit-for-aws☆ 2.9KUpdated Oct 21, 2026
Guides migration, provisioning, search, log-analytics, trace-analytics, and Agentic AI Assistant workflows for Amazon OpenSearch Service and Serverless across six capabilities — migration (Solr/ES/self-managed into AOS/AOSS, schema/query translation, sizing, cutover); provisioning (domain + AOSS lifecycle, upgrades, FGAC, monitoring); search (vector / semantic / hybrid / RAG with Bedrock); log-analytics (PPL, OSI, anomaly detection, Dashboards); trace-analytics (OTel spans, service maps, Data Prepper); ai-assistant (natural language data exploration, incident investigation, root cause analysis). Triggers on OpenSearch, AOS, AOSS, Elasticsearch, Solr, vector/k-NN/semantic/hybrid search, RAG, log analytics, PPL, trace analytics, ISM, FAISS, HNSW, Migration Assistant, UltraWarm, OR1, query my data, analyze logs, investigate errors, root cause analysis.
The English summary is being prepared. Showing the original description.
aws/agent-toolkit-for-aws☆ 2.9KUpdated Oct 21, 2026
Route broad or ambiguous AgentKit SEO work to the right module while keeping context scoped. Use when a request spans multiple surfaces, asks for overall digital-presence strategy, involves provider or install architecture, needs agent-context planning, or the correct platform skill is unclear.
The English summary is being prepared. Showing the original description.
rohitg00/awesome-claude-code-toolkit☆ 2.7KUpdated May 12, 2026
Designs how an organization is structured — reporting lines, team boundaries, spans and layers, role definition, and workforce planning against the strategy. Use this to structure a new team, restructure an existing one, resolve unclear ownership between teams, plan headcount, or diagnose why a team underperforms for structural rather than individual reasons.
The English summary is being prepared. Showing the original description.
cbrock84/headcount☆ 2.1KUpdated Oct 19, 2026