“transformers”的搜索结果

Write and debug code for further training large language models with TRL. Match training methods to dataset formats, configure supervised or preference-based training, and set up reward functions through Python or the command line.

中文简介正在准备中。当前显示英语简介。

• Training a language model on example responses
• Training with preferred and rejected response pairs
• Debugging GRPO reward functions and batch settings

Helps design semantic search and RAG, where an AI answers using retrieved documents. Covers embeddings, numerical representations of content, plus document splitting, search indexes, keyword search combinations, and evaluation of retrieval quality.

中文简介正在准备中。当前显示英语简介。

• Design document retrieval for AI answers
• Compare embedding models and document splitting strategies
• Combine semantic search with keyword search

Add support for a new language model in MNN, from downloading and analyzing it to mapping model fields, comparing intermediate results, and exporting files. Follow staged tests, with additional paths for image, audio, and unusual architectures.

中文简介正在准备中。当前显示英语简介。

• Adding a new text model to MNN
• Exporting a model from HuggingFace or ModelScope to MNN
• Checking intermediate outputs against the original model

Train Mixture of Experts models, which activate selected specialist networks for each input. The skill guides architecture, input routing, workload balancing, and GPU distribution using DeepSpeed or HuggingFace, with examples for training configuration and inference optimization.

中文简介正在准备中。当前显示英语简介。

• Designing a model that activates only selected expert networks
• Balancing workloads across expert networks
• Distributing experts across multiple GPUs

Generate music and sound effects from written descriptions with AudioCraft. Covers MusicGen and AudioGen, using reference melodies or musical styles, producing stereo audio, adjusting generation settings, and saving generated sounds as audio files.

中文简介正在准备中。当前显示英语简介。

• Generate music from a written description
• Create sound effects and environmental audio
• Generate music using a reference melody or style

Build image captioning, visual question answering, and text-based image search with BLIP-2. The skill guides model selection, batch processing, and memory optimization, with examples for understanding images without training for each specific task.

中文简介正在准备中。当前显示英语简介。

• Generate captions for multiple images
• Build a question-answering system for images
• Search an image collection using text

Reduce LLM generation delays with speculative decoding, which proposes tokens ahead of verification. This skill compares small draft models, Medusa, and Lookahead Decoding, with implementation examples, tuning guidance, and deployment using vLLM.

中文简介正在准备中。当前显示英语简介。

• Reducing response delays in chatbots
• Speeding up code generation
• Choosing a small model to draft candidate tokens

Deploy language model APIs and run batch generation with vLLM. Configure GPU memory use, quantization—lower precision model storage—and distribution across GPUs, then test response times and monitor how many requests the server handles.

中文简介正在准备中。当前显示英语简介。

• Deploying an OpenAI-compatible language model API
• Generating responses for a large set of prompts
• Fitting a large model into limited GPU memory

Build image generation workflows in Python with Stable Diffusion and HuggingFace Diffusers. The guide covers text prompts, transforming existing images, replacing selected regions, controlling composition, applying learned styles, and adjusting memory use during generation.

中文简介正在准备中。当前显示英语简介。

• Generating images from text descriptions
• Changing the style of an existing image
• Replacing a selected region of an image

Build document search and AI retrieval workflows with Chroma, a database for numerical representations of text. Cover document storage, meaning-based search, metadata filters, persistence, and connections to LangChain and LlamaIndex.

中文简介正在准备中。当前显示英语简介。

• Building document search based on meaning
• Adding document retrieval to AI answers
• Filtering search results by document attributes

Build LLM serving workflows that produce JSON or other required formats. The skill covers reusing computation for shared prompts, tool calls, and ongoing conversations, with examples for server setup and structured output.

中文简介正在准备中。当前显示英语简介。

• Extracting article details into JSON
• Building agents that call tools
• Reusing shared prompts across conversations

Guides fine-tuning and evaluation of OpenVLA-OFT robot models that turn images and language into actions. Covers LIBERO simulation, ALOHA deployment, LoRA adaptation that updates a small set of parameters, and troubleshooting action scaling or configuration mismatches.

中文简介正在准备中。当前显示英语简介。

• Evaluate pretrained models in LIBERO
• Fine-tune robot action models with LoRA
• Deploy server-client inference for ALOHA

Guides LLM compression through pruning, which removes selected model weights. Covers Wanda and SparseGPT methods without retraining, accuracy comparisons, and structured weight patterns that can accelerate inference on compatible hardware.

中文简介正在准备中。当前显示英语简介。

• Trying model compression without retraining
• Comparing accuracy before and after pruning
• Choosing between Wanda and SparseGPT

Combine specialized language models without retraining using mergekit. The skill explains how to choose merging methods, configure each model’s contribution, compare resulting variants, and prepare a merged model for evaluation and deployment.

中文简介正在准备中。当前显示英语简介。

• Combine math, coding, and conversation capabilities
• Compare model variants with different merge weights
• Choose a method for merging several models

Guides adapting OpenPI robot models to custom datasets and serving them to produce actions from observations. Covers JAX and PyTorch training, checkpoint conversion, and troubleshooting for normalization statistics and GPU memory.

中文简介正在准备中。当前显示英语简介。

• Fine-tune OpenPI models on custom robot datasets
• Convert JAX checkpoints to PyTorch
• Serve policies for ALOHA, DROID, or LIBERO

Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.

中文简介正在准备中。当前显示英语简介。

• Compressing a large language model into a smaller model
• Training a specialized model from teacher-generated examples
• Comparing distillation methods and training settings

Set up W&B to record machine learning metrics and settings, visualize training progress, and compare experiments. Includes automated searches for training settings, version tracking for datasets and models, and shared reports for team collaboration.

中文简介正在准备中。当前显示英语简介。

• Recording and visualizing training metrics
• Comparing experiments with different training settings
• Automatically searching for better training settings

Get guidance on fine-tuning language models with Unsloth, including LoRA and QLoRA methods for training with fewer resources. The skill points to documentation for understanding APIs, implementing training code, debugging problems, and exploring speed and memory optimizations.

中文简介正在准备中。当前显示英语简介。

• Exploring faster training with lower memory use
• Learning about LoRA and QLoRA fine-tuning
• Checking Unsloth features and APIs

Guides experiments that change internal values in PyTorch models to test what causes their behavior. Uses pyvene to swap or remove activations, locate influential components, train interventions, and save experiments for reuse.

中文简介正在准备中。当前显示英语简介。

• Locating model components that affect an answer
• Comparing outputs after swapping internal activations
• Training interventions to investigate causal structure

Explore training workflows that reduce harmful model responses using a written set of principles. The skill covers self-critique, revised training examples, and RLAIF, reinforcement learning from AI feedback, with implementation examples and hardware guidance.

中文简介正在准备中。当前显示英语简介。

• Designing principles for model safety training
• Creating training examples through self-critique and revision
• Planning reinforcement learning with AI-rated responses

Use LitGPT to explore language model implementations and train models on custom data. Covers pretrained model loading, LoRA fine-tuning that updates a small set of parameters, pretraining, and preparing trained models for deployment.

中文简介正在准备中。当前显示英语简介。

• Studying language model architecture through readable code
• Fine-tuning a model on custom instruction data
• Configuring LoRA training for a single GPU

Fine-tune language models with TRL using GRPO, a method that compares scored responses to the same prompt. Covers training data, scoring functions, GPU-conscious settings, and monitoring for tasks with measurable correctness or required output formats.

中文简介正在准备中。当前显示英语简介。

• Train models to follow JSON or XML output formats
• Reward correct answers in math or coding tasks
• Balance correctness, format, and style during training

Organize PyTorch training code with LightningModule and Trainer. This skill guides training, validation, logging, model checkpoint saving, early stopping when progress stalls, and configuration for running the same model across multiple GPUs.

中文简介正在准备中。当前显示英语简介。

• Organize existing PyTorch training code
• Add validation and metric logging
• Save the best models and stop stalled training

Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.

中文简介正在准备中。当前显示英语简介。

• Setting up reinforcement learning for large MoE models
• Configuring FP8 or INT4 training
• Checking consistency between training and inference