50 skills · sorted by relevance
Prepare and review LoRA or QLoRA settings for adapting language models using example responses. Choose trainable layers, adapter capacity, learning rate, and memory-related options, then produce configuration values for a downstream training script.
Get guidance on adapting LLMs with Unsloth, including implementation, API usage, and debugging. Covers LoRA and QLoRA, methods for adjusting models with fewer trainable parameters, with a focus on training speed and memory use.
Reduce GPU memory use by loading language models in 8-bit or 4-bit formats with bitsandbytes and HuggingFace Transformers. Includes configuration examples, QLoRA fine-tuning of compressed models, and optimizers that reduce memory needed during training.
Get guidance on fine-tuning language models with Unsloth, including LoRA and QLoRA methods for training with fewer resources. The skill points to documentation for understanding APIs, implementing training code, debugging problems, and exploring speed and memory optimizations.
Get guidance on adapting LLMs through additional training with LLaMA-Factory. The skill covers a visual interface requiring no code, LoRA and QLoRA training methods, and documentation-based help with implementation, features, and debugging.
Adapt large language models to specific tasks through fine-tuning, or additional training. Prepares and validates datasets, configures LoRA or QLoRA to train a small subset of parameters, and supplies training settings, evaluation scripts, and deployment optimization guidance.
Get guidance on adapting large language models with Axolotl. Covers YAML configuration files, LoRA and QLoRA methods for training fewer parameters, distributed training settings, dataset formats, and debugging training code.
Helps adapt LLMs to specific tasks with LLaMA-Factory, including training through a web interface and memory-saving methods such as QLoRA. Provides documentation references for learning features, implementing workflows, and investigating code problems.
Helps you use Unsloth for language model fine-tuning with LoRA and QLoRA, methods that adapt models with fewer trainable parameters. Supports API questions, implementation, and debugging using reference material drawn from official documentation.
Fine-tune large language models with LoRA and QLoRA while limiting GPU memory use. Guides training settings and adapter management, using small sets of task-specific weights that can be saved, switched, or merged into a base model.
Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.
Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.
Adapt large language models to specific tasks using LoRA and QLoRA, methods that train a small set of added parameters. Get guidance on preparing examples, choosing training settings, evaluating outputs, and saving or merging trained adapters.
Helps fine-tune large language models with LoRA and QLoRA, methods that train small sets of additional parameters. Covers memory-conscious training, configuration choices, saving adapters, and switching task-specific adapters on a shared base model.
Guides LLM fine-tuning with Axolotl, from YAML configuration and dataset formats to distributed training across GPUs. Covers LoRA and QLoRA, methods that train on preferences, multimodal support, and troubleshooting using documentation references and code examples.
Fine-tune large language models with LoRA and QLoRA, methods that train small additions to a base model while limiting GPU memory use. Configure training, save task-specific adapters, switch between them, and merge them for deployment.
Get guidance for fine-tuning large language models with Axolotl, adapting them through additional training. Use YAML configuration examples, dataset references, and training methods such as LoRA to set up training and investigate problems.
Use LitGPT to explore language model implementations and train models on custom data. Covers pretrained model loading, LoRA fine-tuning that updates a small set of parameters, pretraining, and preparing trained models for deployment.
Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.
Use LitGPT to explore language model implementations and train models on custom data. Covers pretrained model loading, LoRA fine-tuning that updates a small set of parameters, pretraining, and preparing trained models for deployment.
Configure supervised fine-tuning for models that process images and text. Define which components remain unchanged, set LoRA adapters for updating selected model weights, choose image resolution limits, and investigate training runs whose evaluation results fail to improve.
Plan memory use and monitor long training jobs on NVIDIA DGX Spark. It guides troubleshooting for out-of-memory failures, tracks temperature and power alongside training logs, and helps assess competition between training and inference workloads.
Expert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimization
The English summary is being prepared. Showing the original description.
Expert guidance for fast fine-tuning with Unsloth - 2-5x faster training, 50-80% less memory, LoRA/QLoRA optimization
The English summary is being prepared. Showing the original description.