본문으로 건너뛰기
cccskills

'transformers' 검색 결과

205건 · 관련도순

Guides fine-tuning and evaluation of OpenVLA-OFT robot models that turn images and language into actions. Covers LIBERO simulation, ALOHA deployment, LoRA adaptation that updates a small set of parameters, and troubleshooting action scaling or configuration mismatches.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Evaluate pretrained models in LIBERO
  • Fine-tune robot action models with LoRA
  • Deploy server-client inference for ALOHA
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Reduce LLM generation delays with speculative decoding, which proposes tokens ahead of verification. This skill compares small draft models, Medusa, and Lookahead Decoding, with implementation examples, tuning guidance, and deployment using vLLM.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Reducing response delays in chatbots
  • Speeding up code generation
  • Choosing a small model to draft candidate tokens
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Compressing a large language model into a smaller model
  • Training a specialized model from teacher-generated examples
  • Comparing distillation methods and training settings
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

sglang

무료

Build LLM serving workflows that produce JSON or other required formats. The skill covers reusing computation for shared prompts, tool calls, and ongoing conversations, with examples for server setup and structured output.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Extracting article details into JSON
  • Building agents that call tools
  • Reusing shared prompts across conversations
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Combine specialized language models without retraining using mergekit. The skill explains how to choose merging methods, configure each model’s contribution, compare resulting variants, and prepare a merged model for evaluation and deployment.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Combine math, coding, and conversation capabilities
  • Compare model variants with different merge weights
  • Choose a method for merging several models
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Train Mixture of Experts models, which activate selected specialist networks for each input. The skill guides architecture, input routing, workload balancing, and GPU distribution using DeepSpeed or HuggingFace, with examples for training configuration and inference optimization.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Designing a model that activates only selected expert networks
  • Balancing workloads across expert networks
  • Distributing experts across multiple GPUs
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Set up W&B to record machine learning metrics and settings, visualize training progress, and compare experiments. Includes automated searches for training settings, version tracking for datasets and models, and shared reports for team collaboration.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Recording and visualizing training metrics
  • Comparing experiments with different training settings
  • Automatically searching for better training settings
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Deploy language model APIs and run batch generation with vLLM. Configure GPU memory use, quantization—lower precision model storage—and distribution across GPUs, then test response times and monitor how many requests the server handles.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Deploying an OpenAI-compatible language model API
  • Generating responses for a large set of prompts
  • Fitting a large model into limited GPU memory
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

chroma

무료

Build document search and AI retrieval workflows with Chroma, a database for numerical representations of text. Cover document storage, meaning-based search, metadata filters, persistence, and connections to LangChain and LlamaIndex.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Building document search based on meaning
  • Adding document retrieval to AI answers
  • Filtering search results by document attributes
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Build image generation workflows in Python with Stable Diffusion and HuggingFace Diffusers. The guide covers text prompts, transforming existing images, replacing selected regions, controlling composition, applying learned styles, and adjusting memory use during generation.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Generating images from text descriptions
  • Changing the style of an existing image
  • Replacing a selected region of an image
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Guides adapting OpenPI robot models to custom datasets and serving them to produce actions from observations. Covers JAX and PyTorch training, checkpoint conversion, and troubleshooting for normalization statistics and GPU memory.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Fine-tune OpenPI models on custom robot datasets
  • Convert JAX checkpoints to PyTorch
  • Serve policies for ALOHA, DROID, or LIBERO
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Build image captioning, visual question answering, and text-based image search with BLIP-2. The skill guides model selection, batch processing, and memory optimization, with examples for understanding images without training for each specific task.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Generate captions for multiple images
  • Build a question-answering system for images
  • Search an image collection using text
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Generate music and sound effects from written descriptions with AudioCraft. Covers MusicGen and AudioGen, using reference melodies or musical styles, producing stereo audio, adjusting generation settings, and saving generated sounds as audio files.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Generate music from a written description
  • Create sound effects and environmental audio
  • Generate music using a reference melody or style
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Guides LLM compression through pruning, which removes selected model weights. Covers Wanda and SparseGPT methods without retraining, accuracy comparisons, and structured weight patterns that can accelerate inference on compatible hardware.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Trying model compression without retraining
  • Comparing accuracy before and after pruning
  • Choosing between Wanda and SparseGPT
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

unsloth

무료

Get guidance on fine-tuning language models with Unsloth, including LoRA and QLoRA methods for training with fewer resources. The skill points to documentation for understanding APIs, implementing training code, debugging problems, and exploring speed and memory optimizations.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Exploring faster training with lower memory use
  • Learning about LoRA and QLoRA fine-tuning
  • Checking Unsloth features and APIs
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Build text tokenizers, which split text into units for AI models, directly from raw multilingual text. Learn custom vocabularies with BPE or Unigram, convert text to pieces or numeric IDs, and decode the results.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Preparing text for multilingual AI models
  • Training a vocabulary from Japanese text
  • Reusing a tokenizer for reproducible text splitting
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Explore training workflows that reduce harmful model responses using a written set of principles. The skill covers self-critique, revised training examples, and RLAIF, reinforcement learning from AI feedback, with implementation examples and hardware guidance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Designing principles for model safety training
  • Creating training examples through self-critique and revision
  • Planning reinforcement learning with AI-rated responses
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Adapt existing PyTorch training scripts to run across multiple GPUs or machines with Accelerate. This skill covers device setup, distributed training configuration, and mixed precision, which uses lower-precision numbers to reduce memory use.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Adapt a single-GPU training script for multiple GPUs
  • Configure mixed precision to reduce training memory use
  • Set up training with DeepSpeed or FSDP
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Build safety checks for LLM prompts and responses using Meta's LlamaGuard. This skill covers content classification, batch moderation, serving a moderation API, and connecting checks to NeMo Guardrails.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Screening user prompts before sending them to an LLM
  • Checking generated responses before displaying them
  • Building an API for content safety checks
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

axolotl

무료

Guides LLM fine-tuning with Axolotl, from YAML configuration and dataset formats to distributed training across GPUs. Covers LoRA and QLoRA, methods that train on preferences, multimodal support, and troubleshooting using documentation references and code examples.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Prepare YAML settings for LLM fine-tuning
  • Explore LoRA, QLoRA, and preference training options
  • Check dataset formats and input handling
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

deepspeed

무료

Implement and troubleshoot large-model training with DeepSpeed across multiple GPUs. The skill covers memory optimization, parallel training, and numerical precision choices, alongside examples for storage transfers and models that divide work among specialized components.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Review settings for distributed model training
  • Tune transfers between NVMe storage and tensors
  • Configure training with specialized model components
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Guides you through setting up RWKV, generating text, processing long documents in chunks, and fine-tuning models. Explains how to carry context between steps and compare memory use with Transformer models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Build streaming text generation
  • Process long documents in chunks
  • Plan RWKV fine-tuning
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Setting up reinforcement learning for large MoE models
  • Configuring FP8 or INT4 training
  • Checking consistency between training and inference
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트

Fine-tune language models with TRL using GRPO, a method that compares scored responses to the same prompt. Covers training data, scoring functions, GPU-conscious settings, and monitoring for tasks with measurable correctness or required output formats.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

  • Train models to follow JSON or XML output formats
  • Reward correct answers in math or coding tasks
  • Balance correctness, format, and style during training
Orchestra-Research/AI-Research-SKILLs1.4만2026년 10월 11일 업데이트