'llm applications' 검색 결과

Set up Langfuse to record LLM application activity, costs, and response times. Manage prompt versions, organize evaluation datasets, and compare results to investigate failures and guide improvements using recorded evidence.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Comparing prompt versions and evaluation scores
• Monitoring LLM costs and response times

Design LLM applications using patterns for answers grounded in documents, agents that use tools, and prompt testing. Implementation examples also cover monitoring response quality, latency, costs, and failures during operation.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Building an assistant that answers from internal documents
• Choosing an architecture for an agent that uses tools
• Comparing and versioning prompts

Use LangSmith to record LLM application inputs, outputs, and timing, investigate failures, evaluate answers against test datasets, and monitor production usage. It also guides automated quality checks and analysis of token usage and costs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Evaluating answers against test datasets
• Monitoring production latency and costs

Helps speed up LLM text generation by comparing methods that predict and verify multiple tokens at once. Covers draft model selection, Medusa prediction heads, Lookahead Decoding settings, and deployment examples for inference services.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reducing chatbot response latency
• Comparing methods for faster code generation
• Selecting a small draft model for a larger LLM

Use LangSmith to record LLM application inputs, outputs, and timing, investigate failures, evaluate answers against test datasets, and monitor production usage. It also guides automated quality checks and analysis of token usage and costs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Evaluating answers against test datasets
• Monitoring production latency and costs

Plan security controls for LLM applications and AI agents, covering malicious instructions, data leakage, model tampering, and API access. Includes guidance and code examples for filtering outputs, enforcing permissions, isolating networks, and recording audit events.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reviewing defenses against prompt injection in AI agents
• Filtering personal information from LLM responses
• Designing authentication and rate limits for LLM APIs

Evaluate LLM applications using automated scores, human reviews, and model-based judging. Build repeatable checks to compare models or prompts, assess answer quality, and detect declines in performance before deployment.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing models and prompts
• Checking quality after prompt changes
• Detecting performance declines before deployment

Build and operate LLM applications with guidance on RAG, which uses retrieved documents to inform answers. Covers document indexing, vector database selection, prompt improvement, response evaluation, caching, and estimates of model usage costs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Building an assistant that answers from documents
• Choosing a vector database for document search
• Comparing answer quality after prompt changes

Investigate LLM application failures with Phoenix CLI by reviewing execution records, recording observations, and grouping mistakes into counted categories. Inspect datasets and experiments to identify which failure types deserve evaluation tests first.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Grouping observed mistakes into failure categories
• Choosing which evaluation tests to build first

Evaluate LLM application quality using automated scores, human reviews, and another language model as a judge. Compare models or prompts, establish baseline results, and detect quality drops through repeatable tests and statistical comparisons.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing models and prompts
• Checking quality before deployment
• Evaluating search quality in RAG applications

Manage AltLLM Portal API keys for external agents and applications through the local CLI. Covers creation, model access limits, disabling, and revocation, while documenting production failures that currently restrict working operations to listing and creating keys.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• List active and disabled API keys
• Create an API key for an external application
• Specify which models a new key can access

Set up Phoenix tracing for LLM applications in Python or TypeScript. The skill guides automatic and custom recording of individual operations, conversation grouping, metadata, feedback, and production settings such as batching and personal data masking.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Set up tracing for an LLM application
• Record document retrieval and tool calls
• Group conversation traces by session

Guides background processing in Node.js and TypeScript with BullMQ and Redis. Covers job queues, which hold tasks for later execution, along with scheduling, priorities, rate limits, worker concurrency, and dependencies between processing steps.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Design a queue for background tasks
• Schedule jobs for later or repeated execution
• Organize dependent steps into a job flow

Design and refine prompts for LLM applications by organizing roles, context, instructions, constraints, and output formats. Develop representative examples, manage the information supplied to the model, and evaluate changes to improve how consistently responses match expectations.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Structuring a system prompt for an LLM application
• Specifying response formats and constraints
• Creating examples that include edge cases

Reduce LLM generation delays with speculative decoding, which proposes tokens ahead of verification. This skill compares small draft models, Medusa, and Lookahead Decoding, with implementation examples, tuning guidance, and deployment using vLLM.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reducing response delays in chatbots
• Speeding up code generation
• Choosing a small model to draft candidate tokens

Design and implement LLM applications, AI agents, and RAG systems that retrieve documents to support answers. Cover model selection, search quality, testing, monitoring, safety measures, and cost controls for applications intended for production use.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Building an AI assistant that answers from company documents
• Improving search with keyword and vector retrieval
• Designing AI agents with multiple specialized roles

Build an end-to-end evaluation pipeline for Python AI applications using pixie-qa and real language-model calls. Define criteria, prepare realistic test data, score application runs, and analyze the evidence to produce a prioritized improvement plan.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up quality checks for Python AI applications
• Creating realistic scenarios for known failure modes
• Scoring full application runs with real language-model calls

Design RAG systems that retrieve relevant documents to support LLM answers. The skill guides document splitting, meaning-based and keyword search, result reranking, and separate retrieval evaluation to improve the context passed to the model.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing document retrieval for LLM answers
• Reviewing document splitting strategies
• Combining keyword and meaning-based search

Build LlamaIndex applications that retrieve relevant material before generating answers, a method called RAG. Connect documents, websites, and databases to support document questions, conversational search, structured summaries, and checks of answer relevance and source consistency.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Building question answering over internal documents
• Creating a chatbot that remembers the conversation
• Searching information across files, websites, and databases

Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production. Use when "langfuse, llm observability, llm tracing, prompt management, llm evaluation, monitor llm, debug llm, langfuse, observability, tracing, llm-monitoring, evaluation, prompt-management, debugging, analytics" mentioned.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Assess the security of LLM applications and AI agents by tracing inputs, retrieved content, tool calls, and outputs. Covers prompt injection, where content carries unwanted instructions, along with permission misuse, memory poisoning, and supply-chain risks.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Testing chatbot resistance to prompt injection
• Auditing agent tool permissions and approval steps
• Checking retrieval access controls and memory poisoning

Use Phoenix to record execution traces, detailed records of an AI application's operations, and investigate problems. Evaluate answers on datasets, compare prompts and models, and set up monitoring through a self-hosted server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigate AI application problems using execution traces
• Evaluate answer quality across a test dataset
• Compare prompts and models through experiments

Use Phoenix to record execution traces, detailed records of an AI application's operations, and investigate problems. Evaluate answers on datasets, compare prompts and models, and set up monitoring through a self-hosted server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigate AI application problems using execution traces
• Evaluate answer quality across a test dataset
• Compare prompts and models through experiments

Add safety checks to LLM applications with NeMo Guardrails. This skill guides input and output validation, detection of attempts to bypass safety rules, personal information masking, and checks for unsupported or inaccurate answers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Detect attempts to bypass an AI app's safety rules
• Mask personal information before processing
• Add fact-checking to generated answers