“transformers”的搜索结果

Assess language models with over 60 academic benchmark tests using consistent prompts and scoring. Compare models, track performance during training, and organize research results with support for HuggingFace models, vLLM, and APIs.

中文简介正在准备中。当前显示英语简介。

• Compare models on standard knowledge and reasoning tests
• Track model performance across training checkpoints
• Organize evaluation results for research reports

Use LitGPT to explore language model implementations and train models on custom data. Covers pretrained model loading, LoRA fine-tuning that updates a small set of parameters, pretraining, and preparing trained models for deployment.

中文简介正在准备中。当前显示英语简介。

• Studying language model architecture through readable code
• Fine-tuning a model on custom instruction data
• Configuring LoRA training for a single GPU

Helps adapt LLMs to specific tasks with LLaMA-Factory, including training through a web interface and memory-saving methods such as QLoRA. Provides documentation references for learning features, implementing workflows, and investigating code problems.

中文简介正在准备中。当前显示英语简介。

• Exploring LLM fine-tuning through a web interface
• Checking LoRA and QLoRA training options
• Investigating LLaMA-Factory implementation problems

Get guidance on adapting large language models with Axolotl. Covers YAML configuration files, LoRA and QLoRA methods for training fewer parameters, distributed training settings, dataset formats, and debugging training code.

中文简介正在准备中。当前显示英语简介。

• Write YAML settings for model fine-tuning
• Explore training with LoRA or QLoRA
• Configure training across multiple GPUs

Get guidance on adapting LLMs with Unsloth, including implementation, API usage, and debugging. Covers LoRA and QLoRA, methods for adjusting models with fewer trainable parameters, with a focus on training speed and memory use.

中文简介正在准备中。当前显示英语简介。

• Learning how to fine-tune models with Unsloth
• Exploring LoRA and QLoRA for efficient training
• Implementing features using Unsloth APIs

Set up LLM serving with structured responses, including JSON and outputs restricted to specified patterns. Covers reusing shared prompt calculations, tool calling, and multi-turn conversations through SGLang, with examples for server setup and application integration.

中文简介正在准备中。当前显示英语简介。

• Extract information into JSON with a defined schema
• Build agents that call tools
• Reuse shared prompts across chat requests

Build image captioning, visual question answering, and text-based image search with BLIP-2. The skill explains model selection, batch processing, and memory-saving settings, with Python examples for connecting image understanding to language models.

中文简介正在准备中。当前显示英语简介。

• Generating captions for multiple images
• Building a question-answering system for images
• Searching an image collection with text

Build image-based conversations with LLaVA, an AI model that combines image understanding with language. Covers setup, model selection, image descriptions, follow-up questions, and memory-saving options for running models on a GPU.

中文简介正在准备中。当前显示英语简介。

• Building a chatbot that answers questions about images
• Generating image descriptions and captions
• Exploring a scene through follow-up questions

Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.

中文简介正在准备中。当前显示英语简介。

• Deploy an OpenAI-compatible language model API
• Generate text from many prompts in a batch
• Serve quantized models with limited GPU memory

Build image generation workflows in Python with Stable Diffusion and HuggingFace Diffusers. The guide covers text prompts, transforming existing images, replacing selected regions, controlling composition, applying learned styles, and adjusting memory use during generation.

中文简介正在准备中。当前显示英语简介。

• Generating images from text descriptions
• Changing the style of an existing image
• Replacing a selected region of an image

Use SAM to identify object regions in images from points, boxes, or existing masks. The skill provides implementation examples for transparent cutouts, automatic mask generation, annotation tools, and model selection based on available resources.

中文简介正在准备中。当前显示英语简介。

• Extracting objects with transparent backgrounds
• Building annotation tools with point or box selection
• Generating object masks automatically

Generate music and sound effects from written descriptions with AudioCraft. Covers MusicGen and AudioGen, using reference melodies or musical styles, producing stereo audio, adjusting generation settings, and saving generated sounds as audio files.

中文简介正在准备中。当前显示英语简介。

• Generate music from a written description
• Create sound effects and environmental audio
• Generate music using a reference melody or style

Use W&B to record machine learning experiments, visualize training, and compare results. The skill also covers automated searches for training settings and version tracking for datasets and models, helping teams share experiments and trace their inputs.

中文简介正在准备中。当前显示英语简介。

• Logging training metrics and viewing progress in real time
• Comparing experiments with different training settings
• Searching automatically for better training settings

Investigate why a PyTorch model behaves a certain way by changing its internal values with pyvene. The skill guides experiments that swap or remove activations, train interventions, compare outputs, and save or share intervention configurations.

中文简介正在准备中。当前显示英语简介。

• Locating model components that affect an output
• Swapping activations to test behavioral hypotheses
• Training interventions to investigate causal structure

Combine capabilities from multiple fine-tuned LLMs without retraining using mergekit. Choose a merging method, configure how models are blended, and evaluate the resulting model on tasks such as math, code generation, and conversation.

中文简介正在准备中。当前显示英语简介。

• Combining math, coding, and conversation capabilities
• Blending two models at different ratios
• Comparing variants made with different merging methods

Build and train Mixture of Experts models, which activate selected specialist networks for each input. Use DeepSpeed or HuggingFace workflows to configure routing, balance workloads, distribute experts across GPUs, and optimize inference.

中文简介正在准备中。当前显示英语简介。

• Designing MoE models for a limited compute budget
• Implementing Mixtral-style expert routing
• Adjusting expert workloads and training stability

Evaluate code generation models with HumanEval, MBPP, and other benchmarks. Test generated programs, compare models across programming languages, and record pass@k scores, which estimate the chance that at least one of k solutions passes the tests.

中文简介正在准备中。当前显示英语简介。

• Comparing code generation models on shared benchmarks
• Measuring correctness across programming languages
• Evaluating models trained to follow instructions

Get guidance on distributed training with PyTorch FSDP, which splits model parameters across devices. The skill covers implementation, mixed precision, moving data to CPU memory, communication setup, and debugging distributed training code.

中文简介正在准备中。当前显示英语简介。

• Implement distributed training with FSDP
• Review mixed precision and CPU offloading settings
• Choose a distributed communication backend

Adapt PyTorch training scripts for multiple GPUs or machines with Accelerate. This skill guides code changes, configuration, and launch commands, including mixed precision, which combines numerical formats, and DeepSpeed or FSDP integration for distributed training.

中文简介正在准备中。当前显示英语简介。

• Moving single-GPU training to multiple GPUs
• Configuring mixed precision training
• Setting up DeepSpeed or FSDP

Helps configure and troubleshoot DeepSpeed for training large models across multiple devices. Covers memory optimization, parallel training, and DeepNVMe storage transfers, with examples for tuning data movement and configuring models that divide work among specialized components.

中文简介正在准备中。当前显示英语简介。

• Configuring distributed training for large models
• Tuning tensor transfers to NVMe storage
• Setting up models with specialized expert components

Reduce LLM weight usage through pruning, which removes selected model parameters. Explore Wanda and SparseGPT for compression without retraining, choose hardware-friendly patterns for faster inference, and compare the compressed model's accuracy with the original.

中文简介正在准备中。当前显示英语简介。

• Compressing an LLM without retraining
• Comparing pruning methods
• Exploring faster inference on supported hardware

Train smaller language models using knowledge distillation, where a larger model supplies examples or prediction targets. This skill covers training losses, generated training data, parameter choices, and output comparisons to support model compression and specialized student models.

中文简介正在准备中。当前显示英语简介。

• Training a smaller model from a larger teacher
• Fine-tuning with teacher-generated responses
• Distilling domain knowledge into a specialized model

Helps speed up LLM text generation by comparing methods that predict and verify multiple tokens at once. Covers draft model selection, Medusa prediction heads, Lookahead Decoding settings, and deployment examples for inference services.

中文简介正在准备中。当前显示英语简介。

• Reducing chatbot response latency
• Comparing methods for faster code generation
• Selecting a small draft model for a larger LLM

Organize PyTorch training code with LightningModule and Trainer. Follow examples for validation, logging, model saving, and distributed training across multiple GPUs, with callbacks that add monitoring or stop training when progress stalls.

中文简介正在准备中。当前显示英语简介。

• Converting an existing PyTorch training loop
• Adding validation, logs, and model checkpoints
• Configuring training across multiple GPUs