데이터·AI 스킬

Convert language models to GGUF and reduce their size through quantization, which stores model weights at lower precision. Guides cover compression choices, local inference on CPUs and Apple Silicon, and integration with tools such as Ollama.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running a language model on a CPU-only computer
• Choosing model compression for available memory
• Configuring Metal acceleration on Apple Silicon

Add safety checks to LLM applications with NeMo Guardrails. This skill guides input and output validation, detection of attempts to bypass safety rules, personal information masking, and checks for unsupported or inaccurate answers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Detect attempts to bypass an AI app's safety rules
• Mask personal information before processing
• Add fact-checking to generated answers

Guide large language model training with OpenRLHF using human preference feedback. Covers training method selection, distributed GPU setup, reward model training, and memory tuning, with examples for PPO, GRPO, and DPO.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choosing a training method for human preference alignment
• Setting up distributed training across multiple GPUs
• Training a reward model before PPO

Explore training workflows that reduce harmful model responses using a written set of principles. The skill covers self-critique, revised training examples, and RLAIF, reinforcement learning from AI feedback, with implementation examples and hardware guidance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing principles for model safety training
• Creating training examples through self-critique and revision
• Planning reinforcement learning with AI-rated responses

Build data processing pipelines for machine learning, from preprocessing to batch predictions. Uses Ray Data to handle datasets larger than memory, distribute work across CPUs and GPUs, and feed data into training frameworks.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Preprocessing datasets larger than memory
• Running batch predictions across multiple GPUs
• Preparing image and tabular data for training

Get guidance on fine-tuning language models with Unsloth, including LoRA and QLoRA methods for training with fewer resources. The skill points to documentation for understanding APIs, implementing training code, debugging problems, and exploring speed and memory optimizations.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring faster training with lower memory use
• Learning about LoRA and QLoRA fine-tuning
• Checking Unsloth features and APIs

Learn how GPT language models work by preparing text, training a small model, and generating samples. Covers CPU experiments, custom datasets, further training of pretrained GPT-2 models, and reproducing GPT-2 with multiple GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a small model on Shakespeare using a CPU
• Prepare custom text for model training
• Further train a pretrained GPT-2 model

Guides you through setting up RWKV, generating text, processing long documents in chunks, and fine-tuning models. Explains how to carry context between steps and compare memory use with Transformer models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build streaming text generation
• Process long documents in chunks
• Plan RWKV fine-tuning

Investigate how transformer language models produce predictions with TransformerLens. This skill guides inspection of intermediate values and attention patterns, plus experiments that replace internal values to test their effects and identify components involved in model behavior.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Inspecting attention patterns and intermediate values
• Testing output changes by replacing internal activations
• Analyzing attention head contributions to predictions

Helps fine-tune large language models with LoRA and QLoRA, methods that train small sets of additional parameters. Covers memory-conscious training, configuration choices, saving adapters, and switching task-specific adapters on a shared base model.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tune a model with limited GPU memory
• Choose LoRA settings for a specific task
• Switch task-specific adapters on one base model

Get guidance on adapting LLMs through additional training with LLaMA-Factory. The skill covers a visual interface requiring no code, LoRA and QLoRA training methods, and documentation-based help with implementation, features, and debugging.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Learning additional training through a visual interface
• Exploring LoRA and QLoRA training methods
• Checking supported models and multimodal features

Implement Mamba, a model architecture that processes sequences through an internal state with computation scaling linearly with input length. Covers pretrained text generation, Mamba-1 and Mamba-2 configuration, speed comparisons with Transformers, and GPU memory troubleshooting.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Explore models for long sequences or streaming applications
• Generate text with pretrained Mamba models
• Compare Mamba-1 and Mamba-2 configurations

Use SAELens to train and analyze sparse autoencoders, which break model activations into a small set of interpretable features. Explore pretrained features, evaluate reconstruction quality, troubleshoot training, and test how individual features influence generated text.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring features in a pretrained SAE
• Training an SAE for a selected model layer
• Investigating inactive features and reconstruction errors

Build text tokenizers, which split text into units for AI models, directly from raw multilingual text. Learn custom vocabularies with BPE or Unigram, convert text to pieces or numeric IDs, and decode the results.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Preparing text for multilingual AI models
• Training a vocabulary from Japanese text
• Reusing a tokenizer for reproducible text splitting

Guides experiments that inspect and modify internal values in PyTorch models to study their effects on predictions. Covers local analysis and remote experiments through NDIF for models too large for local GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Inspect internal values and attention patterns across layers
• Replace internal values to compare changes in predictions
• Run large-model experiments without local GPUs

Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up reinforcement learning for large MoE models
• Configuring FP8 or INT4 training
• Checking consistency between training and inference

Set up, configure, update, and troubleshoot persistent memory for OpenClaw agents. The plugin stores conversations locally and supports automatic recall, task summaries, reusable skills derived from successful tasks, and a visual memory manager.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up persistent memory for OpenClaw
• Updating or troubleshooting the memory plugin
• Choosing local or external memory search models

Build Apache Spark pipelines for large datasets, including transformations, aggregations, and streaming analysis. Get PySpark or Scala code, partitioning strategies for dividing data across workers, and configuration advice to investigate slow jobs and resource usage.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build a pipeline to transform and aggregate large datasets
• Investigate slow Spark jobs and uneven data distribution
• Tune memory settings and data partitions

Build machine learning workflows that connect data checks, training, evaluation, and deployment. The skill implements experiment tracking, model version management, and automated retraining, with reproducible environments and explicit validation thresholds before models enter production.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Automate model training and retraining workflows
• Record and compare machine learning experiments
• Build a feature store for model input data

Design and implement RAG systems, which retrieve documents to inform AI answers. Get document preparation strategies, vector database comparisons, combined keyword and meaning-based search, result reranking, and an evaluation plan for retrieval quality.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Design an AI application that answers using internal documents
• Compare vector databases and document splitting strategies
• Improve search through keyword matching and result reranking

Design and improve prompts for language models, then test their accuracy and consistency. Create reusable templates, JSON output schemas that define response structure, evaluation criteria, and test cases while considering token use and model differences.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing prompts for a new AI application
• Improving inconsistent model responses
• Defining JSON response formats

Clean, combine, summarize, and reshape tabular data with pandas DataFrames, Python's table-like data structures. Produces transformation code and validation checks, including time series processing and memory-conscious approaches for large datasets.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fill missing values and correct data types
• Combine tables using multiple matching columns
• Create grouped summaries and pivot tables

Adapt large language models to specific tasks through fine-tuning, or additional training. Prepares and validates datasets, configures LoRA or QLoRA to train a small subset of parameters, and supplies training settings, evaluation scripts, and deployment optimization guidance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Preparing and validating JSONL training data
• Choosing LoRA or QLoRA for available GPU memory
• Configuring training and monitoring overfitting

Turn books, transcripts, courses, and interviews into reusable agent skills. Extract practical frameworks and procedures, verify their source support, test representative tasks, and compile the results into a single entry or a skill pack.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Turning a book's methods into reusable agent skills
• Extracting practical procedures from course or podcast transcripts
• Creating a single entry for studying and consulting source material