데이터·AI 스킬

Use Phoenix to record execution traces, detailed records of an AI application's operations, and investigate problems. Evaluate answers on datasets, compare prompts and models, and set up monitoring through a self-hosted server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigate AI application problems using execution traces
• Evaluate answer quality across a test dataset
• Compare prompts and models through experiments

Use W&B to record machine learning experiments, visualize training, and compare results. The skill also covers automated searches for training settings and version tracking for datasets and models, helping teams share experiments and trace their inputs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Logging training metrics and viewing progress in real time
• Comparing experiments with different training settings
• Searching automatically for better training settings

Use LangSmith to record LLM application inputs, outputs, and timing, investigate failures, evaluate answers against test datasets, and monitor production usage. It also guides automated quality checks and analysis of token usage and costs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Evaluating answers against test datasets
• Monitoring production latency and costs

Assess language models with over 60 academic benchmark tests using consistent prompts and scoring. Compare models, track performance during training, and organize research results with support for HuggingFace models, vLLM, and APIs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Compare models on standard knowledge and reasoning tests
• Track model performance across training checkpoints
• Organize evaluation results for research reports

Build image classification and search workflows by comparing images with text descriptions. Covers classification without additional training, similarity scoring, batch processing, and storing image representations in a vector database for retrieval.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Classifying images without additional training
• Searching image collections with text descriptions
• Comparing images with candidate descriptions

Use LitGPT to explore language model implementations and train models on custom data. Covers pretrained model loading, LoRA fine-tuning that updates a small set of parameters, pretraining, and preparing trained models for deployment.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Studying language model architecture through readable code
• Fine-tuning a model on custom instruction data
• Configuring LoRA training for a single GPU

Build and evaluate Mamba models for long sequences using state-space models, which summarize past inputs in an internal state. Covers setup, pretrained text generation, differences between Mamba-1 and Mamba-2, and speed comparisons with Transformers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Generate text with pretrained Mamba models
• Compare Mamba-1 and Mamba-2 configurations
• Benchmark generation speed against Transformers

Learn how GPT language models work by preparing text, training a small model, and generating samples. Covers CPU experiments, custom datasets, further training of pretrained GPT-2 models, and reproducing GPT-2 with multiple GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a small model on Shakespeare using a CPU
• Prepare custom text for model training
• Further train a pretrained GPT-2 model

Get guidance on adapting large language models with Axolotl. Covers YAML configuration files, LoRA and QLoRA methods for training fewer parameters, distributed training settings, dataset formats, and debugging training code.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Write YAML settings for model fine-tuning
• Explore training with LoRA or QLoRA
• Configure training across multiple GPUs

Guides the use of RWKV, a language model architecture that carries information forward in a compact state. Covers streaming text generation, long document processing, fine-tuning, and memory comparisons with Transformers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build streaming text generation
• Process long documents in chunks
• Compare memory needs with Transformers

Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running large models with limited GPU memory
• Compressing a model with domain-specific sample text
• Serving AWQ models with vLLM

Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Pretraining Llama 3.1 8B on eight GPUs
• Configuring multi-node training with SLURM
• Enabling Float8 training on H100 GPUs

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs

Reduce GPU memory use by loading language models in 8-bit or 4-bit formats with bitsandbytes and HuggingFace Transformers. Includes configuration examples, QLoRA fine-tuning of compressed models, and optimizers that reduce memory needed during training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Load larger models within limited GPU memory
• Compare 8-bit and 4-bit model settings
• Fine-tune a model with QLoRA

Helps adapt LLMs to specific tasks with LLaMA-Factory, including training through a web interface and memory-saving methods such as QLoRA. Provides documentation references for learning features, implementing workflows, and investigating code problems.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring LLM fine-tuning through a web interface
• Checking LoRA and QLoRA training options
• Investigating LLaMA-Factory implementation problems

Design and implement machine learning systems for production use. Cover data preparation, training, prediction services, model comparisons, monitoring, and retraining, with attention to reliability, response time, resource costs, and both technical and business evaluation metrics.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing a real-time recommendation service
• Comparing model versions with A/B testing
• Detecting changes in data and model performance

Evaluate LLM application quality using automated scores, human reviews, and another language model as a judge. Compare models or prompts, establish baseline results, and detect quality drops through repeatable tests and statistical comparisons.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing models and prompts
• Checking quality before deployment
• Evaluating search quality in RAG applications

Use TensorBoard to visualize training loss and accuracy, compare experiments, and inspect model structure. Includes PyTorch and TensorFlow logging examples for examining weight distributions, predictions, and performance bottlenecks during machine learning training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing loss and accuracy across training runs
• Inspecting weight and gradient distributions
• Exploring embeddings in two or three dimensions

Build image-based conversations with LLaVA, an AI model that combines image understanding with language. Covers setup, model selection, image descriptions, follow-up questions, and memory-saving options for running models on a GPU.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Building a chatbot that answers questions about images
• Generating image descriptions and captions
• Exploring a scene through follow-up questions

Investigate how transformer language models produce predictions with TransformerLens. This skill guides inspection of intermediate values and attention patterns, plus experiments that replace internal values to test their effects and identify components involved in model behavior.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Inspecting attention patterns and intermediate values
• Testing output changes by replacing internal activations
• Analyzing attention head contributions to predictions

Set up Langfuse to record LLM application activity, costs, and response times. Manage prompt versions, organize evaluation datasets, and compare results to investigate failures and guide improvements using recorded evidence.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating failures in LLM applications
• Comparing prompt versions and evaluation scores
• Monitoring LLM costs and response times

Integrate the Gemini API on Agent Platform using the Google Gen AI SDK. Guidance covers authentication, text and multimedia tasks, structured JSON responses, live voice interactions, context caching, and batch prediction across five programming languages.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Adding document and multimedia understanding to an application
• Generating JSON that matches a defined schema
• Building live voice and video interactions

Fine-tune large language models with LoRA and QLoRA while limiting GPU memory use. Guides training settings and adapter management, using small sets of task-specific weights that can be saved, switched, or merged into a base model.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tuning an LLM with limited GPU memory
• Choosing LoRA settings and training layers
• Switching task-specific adapters on one base model

Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Deploy an OpenAI-compatible language model API
• Generate text from many prompts in a batch
• Serve quantized models with limited GPU memory