“llm”的搜索结果

帮助设计表单、发票和题集的信息提取流程，先用正则表达式提取并清理文本，再评估置信度，仅将不确定的条目交给LLM检查和修正，同时介绍测试与指标记录。

• 提取题干、选项和答案
• 设计表单或发票提取流程
• 选择正则表达式或LLM

Add checks to LLM prompts and responses using Llama Guard 3, NeMo Guardrails, and LLM Guard. Configure content screening, conversation boundaries, and sensitive-data filtering, then measure blocking and false-positive rates with labeled test prompts.

中文简介正在准备中。当前显示英语简介。

• Adding runtime safety checks to LLM, RAG, or agent apps
• Screening prompts for injection and jailbreak attempts
• Filtering sensitive or toxic model responses

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

中文简介正在准备中。当前显示英语简介。

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

中文简介正在准备中。当前显示英语简介。

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs

Set up Langfuse to record LLM application activity, costs, and response times. Manage prompt versions, organize evaluation datasets, and compare results to investigate failures and guide improvements using recorded evidence.

中文简介正在准备中。当前显示英语简介。

• Investigating failures in LLM applications
• Comparing prompt versions and evaluation scores
• Monitoring LLM costs and response times

提供LLM API费用管理的设计示例，将按任务复杂度选择模型、记录预算、重试临时错误和缓存共用提示词结合起来，用于检查累计费用与调整调用方式。

• 检查LLM应用的API费用
• 按批处理难度选择模型
• 对照预算检查累计费用

Build an llms.txt file, a navigation guide for AI models, from a repository's structure. Summarize the project and organize links to essential documentation, specifications, examples, and configuration resources.

中文简介正在准备中。当前显示英语简介。

• Creating an AI-readable guide to a repository
• Organizing links to documentation and specifications
• Prioritizing essential project information

Create or review llms.txt, a Markdown guide to a website for AI systems. Discover important pages, write factual summaries, check links and formatting, and produce a ready-to-save file or an improvement report.

中文简介正在准备中。当前显示英语简介。

• Create llms.txt from a website's public pages
• Check an existing file's format and links
• Find important pages missing from the guide

Assess language models with over 60 academic benchmark tests using consistent prompts and scoring. Compare models, track performance during training, and organize research results with support for HuggingFace models, vLLM, and APIs.

中文简介正在准备中。当前显示英语简介。

• Compare models on standard knowledge and reasoning tests
• Track model performance across training checkpoints
• Organize evaluation results for research reports

Build safety checks for LLM prompts and responses using Meta's LlamaGuard. This skill covers content classification, batch moderation, serving a moderation API, and connecting checks to NeMo Guardrails.

中文简介正在准备中。当前显示英语简介。

• Screening user prompts before sending them to an LLM
• Checking generated responses before displaying them
• Building an API for content safety checks

Assess language models with over 60 academic benchmark tests using consistent prompts and scoring. Compare models, track performance during training, and organize research results with support for HuggingFace models, vLLM, and APIs.

中文简介正在准备中。当前显示英语简介。

• Compare models on standard knowledge and reasoning tests
• Track model performance across training checkpoints
• Organize evaluation results for research reports

Compress large language model weights to four bits with AWQ, a method that uses model activation patterns to limit quality loss. Follow workflows for quantization, loading compressed models, and serving them with vLLM using less GPU memory.

中文简介正在准备中。当前显示英语简介。

• Running large language models with limited GPU memory
• Quantizing a model with domain-specific text
• Serving an AWQ model with vLLM

Connect an application's LLM calls through the Caveman Cloud gateway to measure usage and cost without changing request content. The skill updates connection settings and verifies the integration with one small, real provider request.

中文简介正在准备中。当前显示英语简介。

• Start measuring an LLM application's usage and cost
• Route existing LLM calls through the gateway
• Verify a connection with a real request

Find LLM workflows in a codebase and label them by the job they perform, so Caveman Cloud can separate spending by workflow. Present a labeling proposal for approval, apply focused code changes, and check an affected execution path.

中文简介正在准备中。当前显示英语简介。

• Breaking down LLM spending by job
• Inventorying LLM use in APIs, scheduled jobs, and scripts
• Separating evaluation spending from other workflows

Audit and improve `/llms.txt`, a curated starting point for AI tools browsing documentation. Check its location, the usefulness and accessibility of linked pages, and its separation from existing crawl and indexing controls.

中文简介正在准备中。当前显示英语简介。

• Audit llms.txt on a public documentation site
• Select useful API references and getting-started guides
• Check documentation links for availability

Analyze LLM serving traces to identify GPU time usage, opportunities to run operations concurrently, and known patterns for combining operations. Produce three consistent tables from saved traces or live captures on supported servers.

中文简介正在准备中。当前显示英语简介。

• Identify GPU operations that dominate inference time
• Compare input processing and token generation
• Trace GPU operations back to Python code

Compress LLM weights using HQQ quantization, which stores weights with fewer bits without calibration datasets. Follow workflows for precision settings, model saving, inference integration, and LoRA fine-tuning of quantized models.

中文简介正在准备中。当前显示英语简介。

• Compressing LLMs without calibration datasets
• Serving quantized models with vLLM or HuggingFace Transformers
• Comparing bit widths and inference backends

Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.

中文简介正在准备中。当前显示英语简介。

• Deploy an OpenAI-compatible language model API
• Generate text from many prompts in a batch
• Serve quantized models with limited GPU memory

Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.

中文简介正在准备中。当前显示英语简介。

• Running large models with limited GPU memory
• Compressing a model with domain-specific sample text
• Serving AWQ models with vLLM

Helps speed up LLM text generation by comparing methods that predict and verify multiple tokens at once. Covers draft model selection, Medusa prediction heads, Lookahead Decoding settings, and deployment examples for inference services.

中文简介正在准备中。当前显示英语简介。

• Reducing chatbot response latency
• Comparing methods for faster code generation
• Selecting a small draft model for a larger LLM

Choose a serving container for models deployed on SageMaker. Match the model type to a compatible image, retrieve its address from the AWS catalog, and check regional availability, CPU or GPU variants, and required host settings.

中文简介正在准备中。当前显示英语简介。

• Choose a container for an LLM deployment
• Select images for embeddings and rerankers
• Check regional image addresses and GPU compatibility

协助配置vLLM，将大语言模型作为API提供服务或批量生成文本，涵盖部署、性能监控、量化和多GPU分工，也用于排查显存不足与响应缓慢。

• 提供兼容OpenAI的API
• 批量处理大量提示词
• 在有限显存下运行模型

Plan security controls for LLM applications and AI agents, covering malicious instructions, data leakage, model tampering, and API access. Includes guidance and code examples for filtering outputs, enforcing permissions, isolating networks, and recording audit events.

中文简介正在准备中。当前显示英语简介。

• Reviewing defenses against prompt injection in AI agents
• Filtering personal information from LLM responses
• Designing authentication and rate limits for LLM APIs

Manage the credentials Arize uses to call LLM providers such as OpenAI and Anthropic. Create, inspect, update, or delete connections, configure allowed models and authentication methods, and retrieve connection IDs for use in evaluations.

中文简介正在准备中。当前显示英语简介。

• Connect an LLM provider to Arize
• Review existing connections and allowed models
• Rotate stored provider API keys