Skip to content
cccskills
FreePublished on GitHubEnglish overview

omni-cache

Manage cached LLM responses, which are saved answers available for reuse. Inspect statistics and stored entries, clear cached data, and configure expiration policies and similarity thresholds that govern when answers can be reused.

OriginalShow the original description

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

cheaper-inference/OmniRoute
AI rating80/ 100See how to install

Good for

  • Inspecting response cache statistics
  • Clearing saved responses
  • Adjusting cache expiration policies
  • Tuning similarity thresholds for response reuse

Overview

What it does

Manages a cache that stores LLM responses for reuse. It works with APIs for viewing overall statistics, detailed statistics for each cache layer, and stored entries, as well as deleting cached data or statistics. Its scope also includes TTL, the period for which a saved response remains valid, and the semantic similarity threshold that determines how close two requests must be for an answer to be reused.

When it helps

Use it when you want to inspect saved responses or understand cache usage in a service that uses LLMs. Clearing the entire cache and clearing only its statistics are separate operations, so you can choose the operation for the data you want to manage.

Example requests

  • “Show overall cache statistics and detailed statistics for each layer.”
  • “Delete all saved cache data.”
  • “Check the TTL and semantic similarity settings used to reuse responses.”

Notes

API access requires a valid Bearer token or session cookie. Obtain a token through POST /api/auth/login. The material also describes setting REQUIRE_API_KEY=false for local development. See GET /api/openapi/spec or docs/openapi.yaml for detailed request and response formats.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Objective evaluation

AI rated this skill on four points using only the contents of its SKILL.md. Stars and popularity are not taken into account.

Clear instructionsIs it clear when to use it and what it does?
AGoodIt explicitly identifies LLM response cache statistics, deletion, TTL policies, and similarity thresholds as its scope.
Concrete stepsAre steps, inputs, outputs, and examples spelled out?
BPartly lackingIt gives curl examples for statistics and deletion but no procedures for changing TTL or similarity thresholds.
SafetyAre sending data, deleting files, and running commands disclosed?
BPartly lackingDELETE /api/cache clears all caches, but no confirmation procedure is described.
Easy setupDoes it need few tools or API keys, and are they documented?
AGoodIt specifies Bearer token or cookie authentication and provides the token endpoint and local development setting.

The total counts each point as A = 25, B = 15, C = 5. Rated by AI (OpenAI Codex) as of Oct 22, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (1)

  • SKILL.md2.1 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten -->

Overview

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Authentication

All requests require a valid Bearer token or session cookie. Obtain a token via POST /api/auth/login or configure REQUIRE_API_KEY=false for local development.

Endpoints

GET /api/cache

Get cache statistics

curl http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache

Clear all caches

curl -X DELETE http://localhost:20128/api/cache \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/stats

Get detailed cache statistics

Returns detailed statistics for all cache layers.

curl http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/stats

Clear cache statistics

curl -X DELETE http://localhost:20128/api/cache/stats \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/entries

GET cache › entries

curl http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/entries

DELETE cache › entries

curl -X DELETE http://localhost:20128/api/cache/entries \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

GET /api/cache/reasoning

GET cache › reasoning

curl http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

DELETE /api/cache/reasoning

DELETE cache › reasoning

curl -X DELETE http://localhost:20128/api/cache/reasoning \
  -H "Authorization: Bearer $OMNIROUTE_TOKEN"

Payloads

See the full OpenAPI specification at GET /api/openapi/spec or docs/openapi.yaml for detailed request/response schemas.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

cli-a2a

FreeSummaryAI rating 90

Use the command line to send tasks to OmniRoute's A2A server, which supports communication between agents. Inspect execution history and logs, monitor or cancel tasks, and interactively test the JSON-RPC 2.0 communication protocol.

  • Check server status and available skills
  • Invoke a skill with JSON input
  • Inspect task history and logs
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

cli-backup-sync

FreeSummaryAI rating 70

Back up and restore OmniRoute data from the command line. Covers incremental snapshots, encryption, cloud synchronization, scheduled backups, and archive import and export, with options for retention and previewing an import.

  • Create a backup before changing settings
  • Schedule recurring backups and set retention
  • Synchronize data with cloud storage
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

cli-batches

FreeSummary

Submit groups of AI requests as batch jobs with the OmniRoute command line. Manage input files, monitor or cancel jobs, save results and errors, and incorporate batch processing into automated build and deployment workflows.

  • Submitting AI requests from a JSONL file
  • Monitoring batch jobs and waiting for completion
  • Saving batch results and error details
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

cli-chat

FreeSummaryAI rating 90

Send prompts to LLMs from a terminal, display answers as they arrive, or hold an ongoing conversation. Use files or standard input for prompts, choose models, and set system instructions through OmniRoute.

  • Sending a prompt from a terminal
  • Using file contents as a prompt
  • Displaying and saving streaming responses
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

cli-compression

FreeSummaryAI rating 80

Configure prompt compression, which shortens text sent to AI models, through the OmniRoute command line. Adjust RTK filters, Caveman rules, and combined compression modes, then preview the results using real prompts.

  • Preview compression results with real prompts
  • Adjust RTK filters and Caveman rules
  • Compare combined compression modes
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

cli-contexts

FreeSummaryAI rating 80

Manage OmniRoute context settings from the command line, including token budgets and RTK filters for processing context. Switch saved server connections, import or export configurations, and inspect or expire conversation sessions.

  • Adjust context token budgets and filtering rules
  • Switch between saved server connections
  • Import or export connection settings as JSON
cheaper-inference/OmniRoute79.8KUpdated Oct 22, 2026

See all skills by cheaper-inference

Report a problem with this skill