Skip to content
cccskills

Results for “peft”

38 skills · sorted by relevance

Check that changes to existing PEFT methods still work with saved training checkpoints. The skill guides compatibility tests, configuration checks, benchmark comparisons, and reporting, including comparisons of model outputs before and after a change.

  • Checking compatibility after a forward method rewrite
  • Changing state_dict structure while supporting old checkpoints
  • Reviewing defaults for new configuration fields
huggingface/peft21.8KUpdated Oct 19, 2026

peft-fine-tuning

FreeSummary

Fine-tune large language models with LoRA and QLoRA while limiting GPU memory use. Guides training settings and adapter management, using small sets of task-specific weights that can be saved, switched, or merged into a base model.

  • Fine-tuning an LLM with limited GPU memory
  • Choosing LoRA settings and training layers
  • Switching task-specific adapters on one base model
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

peft-fine-tuning

FreeSummary

Helps fine-tune large language models with LoRA and QLoRA, methods that train small sets of additional parameters. Covers memory-conscious training, configuration choices, saving adapters, and switching task-specific adapters on a shared base model.

  • Fine-tune a model with limited GPU memory
  • Choose LoRA settings for a specific task
  • Switch task-specific adapters on one base model
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

Adapt large language models to specific tasks through fine-tuning, or additional training. Prepares and validates datasets, configures LoRA or QLoRA to train a small subset of parameters, and supplies training settings, evaluation scripts, and deployment optimization guidance.

  • Preparing and validating JSONL training data
  • Choosing LoRA or QLoRA for available GPU memory
  • Configuring training and monitoring overfitting
Jeffallan/claude-skills11.9KUpdated Oct 17, 2026

gptq

FreeSummary

Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.

  • Run language models with limited GPU memory
  • Convert your own model to 4-bit weights
  • Compare compression settings for quality and speed
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

peft

FreeSummaryAI rating 80

Fine-tune large language models with LoRA and QLoRA, methods that train small additions to a base model while limiting GPU memory use. Configure training, save task-specific adapters, switch between them, and merge them for deployment.

  • Fine-tuning a language model with limited GPU memory
  • Choosing LoRA settings for a training task
  • Switching between task-specific adapters
NousResearch/hermes-agent255.3KUpdated Oct 19, 2026

llm-finetuning

FreeSummary

Adapt large language models to specific tasks using LoRA and QLoRA, methods that train a small set of added parameters. Get guidance on preparing examples, choosing training settings, evaluating outputs, and saving or merging trained adapters.

  • Adapting models to specialized terminology and output formats
  • Planning training with limited GPU memory
  • Preparing instruction-response datasets
RightNow-AI/openfang18.2KUpdated Jul 2, 2026

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

The English summary is being prepared. Showing the original description.

OpenRaiser/NanoResearch1.3KUpdated Oct 9, 2026

Hugging Face Hub operations, model inference, dataset management, PEFT/LoRA fine-tuning, and Spaces deployment via MCP tools and Python APIs

The English summary is being prepared. Showing the original description.

oimiragieo/agent-studio42Updated Jul 14, 2026

Ajuste fino com eficiência de parâmetros para LLMs usando LoRA, QLoRA e 25+ métodos. Use ao fazer fine-tuning de modelos grandes (7B-70B) com memória GPU limitada, quando precisa treinar <1% dos parâmetros com perda mínima de precisão, ou para serviços multi-adapter. Biblioteca oficial do HuggingFace integrada ao ecossistema transformers.

The English summary is being prepared. Showing the original description.

artubss/SKILLS-CLAUDE-CODE11Updated May 17, 2026

peft

Free

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

The English summary is being prepared. Showing the original description.

huang-sh/DeepScience4Updated Jul 15, 2026

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.

The English summary is being prepared. Showing the original description.

Lord1Egypt/awesome-skill-forge2Updated Jun 10, 2026

axolotl

FreeSummaryAI rating 70

Get guidance for fine-tuning large language models with Axolotl, adapting them through additional training. Use YAML configuration examples, dataset references, and training methods such as LoRA to set up training and investigate problems.

  • Preparing YAML configuration for model fine-tuning
  • Exploring LoRA and QLoRA training methods
  • Checking dataset formats and API usage
NousResearch/hermes-agent255.3KUpdated Oct 19, 2026

trl-fine-tuning

FreeSummaryAI rating 80

Guide language model training with TRL using example answers, preferred response pairs, or reward scores. The skill covers data preparation, method selection, reward model training, evaluation, and adjustments for memory limits or unstable training.

  • Train a language model to follow instructions using example answers
  • Train on preferred and rejected responses with DPO
  • Build a reward model and run an RLHF training pipeline
NousResearch/hermes-agent255.3KUpdated Oct 19, 2026

unsloth

FreeSummaryAI rating 70

Helps you use Unsloth for language model fine-tuning with LoRA and QLoRA, methods that adapt models with fewer trainable parameters. Supports API questions, implementation, and debugging using reference material drawn from official documentation.

  • Learning how to fine-tune models with LoRA or QLoRA
  • Looking up Unsloth features and APIs
  • Investigating errors in training code
NousResearch/hermes-agent255.3KUpdated Oct 19, 2026

grpo-rl-training

FreeSummary

Guides language model training with GRPO in TRL, comparing several responses and rewarding better results. Covers dataset preparation, scoring rules for correctness and format, training configuration, monitoring, and saving models for later use.

  • Training models to follow JSON or XML formats
  • Designing rewards for math and coding tasks
  • Adjusting training to available GPU memory
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

gptq

FreeSummary

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

  • Run a language model within limited GPU memory
  • Load a pre-quantized model for text generation
  • Quantize and save your own trained model
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

  • Train a model on instruction and response examples
  • Align responses using preferred and rejected answer pairs
  • Build a training pipeline using human feedback
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

llama-factory

FreeSummary

Helps adapt LLMs to specific tasks with LLaMA-Factory, including training through a web interface and memory-saving methods such as QLoRA. Provides documentation references for learning features, implementing workflows, and investigating code problems.

  • Exploring LLM fine-tuning through a web interface
  • Checking LoRA and QLoRA training options
  • Investigating LLaMA-Factory implementation problems
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

unsloth

FreeSummary

Get guidance on adapting LLMs with Unsloth, including implementation, API usage, and debugging. Covers LoRA and QLoRA, methods for adjusting models with fewer trainable parameters, with a focus on training speed and memory use.

  • Learning how to fine-tune models with Unsloth
  • Exploring LoRA and QLoRA for efficient training
  • Implementing features using Unsloth APIs
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

axolotl

FreeSummary

Get guidance on adapting large language models with Axolotl. Covers YAML configuration files, LoRA and QLoRA methods for training fewer parameters, distributed training settings, dataset formats, and debugging training code.

  • Write YAML settings for model fine-tuning
  • Explore training with LoRA or QLoRA
  • Configure training across multiple GPUs
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

Guides fine-tuning and evaluation of OpenVLA-OFT robot models that turn images and language into actions. Covers LIBERO simulation, ALOHA deployment, LoRA adaptation that updates a small set of parameters, and troubleshooting action scaling or configuration mismatches.

  • Evaluate pretrained models in LIBERO
  • Fine-tune robot action models with LoRA
  • Deploy server-client inference for ALOHA
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

llama-factory

FreeSummary

Get guidance on adapting LLMs through additional training with LLaMA-Factory. The skill covers a visual interface requiring no code, LoRA and QLoRA training methods, and documentation-based help with implementation, features, and debugging.

  • Learning additional training through a visual interface
  • Exploring LoRA and QLoRA training methods
  • Checking supported models and multimodal features
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

  • Train a model on instruction and response examples
  • Align responses using preferred and rejected answer pairs
  • Build a training pipeline using human feedback
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026