“huggingface”的搜索结果

Prepare large text collections for AI models with fast tokenizers, which split text into model inputs. Train custom vocabularies, trace tokens to original text positions, adjust input lengths, and integrate the results with transformers.

中文简介正在准备中。当前显示英语简介。

• Tokenizing large text collections
• Training a custom vocabulary
• Mapping extracted names or answers back to original text

Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.

中文简介正在准备中。当前显示英语简介。

• Load a larger model within available GPU memory
• Compare 4-bit and 8-bit quantization settings
• Fine-tune a quantized model with QLoRA

Build safety checks for LLM prompts and responses using Meta's LlamaGuard. This skill covers content classification, batch moderation, serving a moderation API, and connecting checks to NeMo Guardrails.

中文简介正在准备中。当前显示英语简介。

• Screening user prompts before sending them to an LLM
• Checking generated responses before displaying them
• Building an API for content safety checks

Find AI models for a specific task using official Hugging Face benchmark leaderboards. Compare scores, model sizes, and licenses, with memory-based estimates of device suitability and flags for models requiring quantization or API access.

中文简介正在准备中。当前显示英语简介。

• Compare coding or reasoning models by benchmark scores
• Find model candidates for a laptop's available memory
• Choose models for OCR or speech recognition

Build reusable command-line scripts that fetch and process Hugging Face API data. Combine multiple requests, enrich model information, and produce outputs for further filtering, with built-in help and usage examples for repeated tasks.

中文简介正在准备中。当前显示英语简介。

• Automating repeated model and dataset lookups
• Combining trending models with metadata and paper links
• Extracting licenses and tags from model cards

Generate Hugging Face Hub (huggingface_hub) release notes from cached PR JSON files. Use when asked to draft release notes from PR files.

中文简介正在准备中。当前显示原文说明。

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

中文简介正在准备中。当前显示原文说明。

Provides guidance for writing and benchmarking optimized CUDA kernels for NVIDIA GPUs (H100, A100, T4) targeting HuggingFace diffusers and transformers libraries. Kernels must be kernel-builder/ABI3-compliant: no pybind11, no setup.py, TORCH_LIBRARY_EXPAND bindings only. Supports models like LTX-Video, Stable Diffusion, LLaMA, Mistral, and Qwen. Includes integration with HuggingFace Kernels Hub (get_kernel) for loading pre-compiled kernels. Includes benchmarking scripts to compare kernel performance against baseline implementations.

中文简介正在准备中。当前显示原文说明。

远程格式化器。用于从huggingface hub的存储库加载数据集。 本SKILL使用依赖data_juicer，请在调用前安装好python环境并安装data_juicer，你可用以下指令进行安装： pip install py-data-juicer 当用户提到加载HuggingFace数据集、远程数据集加载、HuggingFace Hub等需求时使用此skill。

中文简介正在准备中。当前显示原文说明。

HuggingFace hf CLI: search/download/upload models, datasets.

中文简介正在准备中。当前显示原文说明。

API de treinamento distribuído mais simples. 4 linhas para adicionar suporte distribuído a qualquer script PyTorch. API unificada para DeepSpeed/FSDP/Megatron/DDP. Posicionamento automático de device, precisão mista (FP16/BF16/FP8). Config interativo, comando de launch único. Padrão do ecossistema HuggingFace.

中文简介正在准备中。当前显示原文说明。

HuggingFace hf CLI: search/download/upload models, datasets.

中文简介正在准备中。当前显示原文说明。

Use when the user asks about finding the best, top, or recommended model for a task, wants to know what AI model to use, or wants to compare models by benchmark scores. Triggers on: "best model for X", "what model should I use for", "top models for [task]", "which model runs on my laptop/machine/device", "recommend a model for", "what LLM should I use for", "compare models for", "what's state of the art for", or any question about choosing an AI model for a specific use case. Always use this skill when the user wants model recommendations or comparisons, even if they don't explicitly mention HuggingFace or benchmarks.

中文简介正在准备中。当前显示原文说明。

HuggingFace hf CLI: search/download/upload models, datasets.

中文简介正在准备中。当前显示原文说明。

Import datasets from HuggingFace and convert them to Coval test sets. Use when the user wants to create test cases from HuggingFace dataset or repository.

中文简介正在准备中。当前显示原文说明。

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

中文简介正在准备中。当前显示原文说明。

HuggingFace hf CLI: search/download/upload models, datasets.

中文简介正在准备中。当前显示原文说明。

Hugging Face Hub CLI (`hf`) for downloading, uploading, and managing models, datasets, spaces, buckets, repos, papers, jobs, and more on the Hugging Face Hub. Use when: handling authentication; managing local cache; managing Hugging Face Buckets; running or scheduling jobs on Hugging Face infrastructure; managing Hugging Face repos; discussions and pull requests; browsing models, datasets and spaces; reading, searching, or browsing academic papers; managing collections; querying datasets; configuring spaces; setting up webhooks; or deploying and managing HF Inference Endpoints. Make sure to use this skill whenever the user mentions 'hf', 'huggingface', 'Hugging Face', 'huggingface-cli', or 'hugging face cli', or wants to do anything related to the Hugging Face ecosystem and to AI and ML in general. Also use for cloud storage needs like training checkpoints, data pipelines, or agent traces. Use even if the user doesn't explicitly ask for a CLI command. Replaces the deprecated `huggingface-cli`.

中文简介正在准备中。当前显示原文说明。

Evaluate large language models on shared tests of knowledge, reasoning, and code generation with lm-evaluation-harness. Save scores and individual predictions, compare models in tables, and track performance across saved stages of model training.

中文简介正在准备中。当前显示英语简介。

• Evaluating models on MMLU and GSM8K
• Building comparison tables for multiple models
• Tracking scores across training checkpoints

Analyze and modify refusal behavior in open-weight language models without retraining. Use OBLITERATUS to select methods suited to available hardware, compare approaches, and evaluate changes in refusal rates and response quality.

中文简介正在准备中。当前显示英语简介。

• Studying how language models produce refusals
• Testing refusal-related weight changes without retraining
• Selecting models and methods for available hardware

Adapt existing PyTorch training scripts to use multiple GPUs or machines with limited code changes. The skill guides configuration, launch commands, mixed precision, which uses lower-precision numbers, and DeepSpeed or FSDP settings for distributing training work and memory.

中文简介正在准备中。当前显示英语简介。

• Move a single-GPU training script to multiple GPUs
• Configure mixed precision training
• Set up DeepSpeed or FSDP to reduce memory use

Create Python workflows for generating images from text, restyling existing pictures, and filling selected regions. Using HuggingFace Diffusers, the skill explains composition controls, style adapters, generation settings, and ways to reduce memory use.

中文简介正在准备中。当前显示英语简介。

• Generate images from written descriptions
• Restyle an existing picture as a watercolor
• Fill a masked area of a photo

Prepare text for language models by splitting it into tokens, small units represented by numbers. The skill covers batch processing, training custom vocabularies, tracking positions in the original text, and adjusting input lengths.

中文简介正在准备中。当前显示英语简介。

• Preparing large text collections for language models
• Training a custom vocabulary from text files
• Mapping model predictions back to original text

Add a model page to the SGLang Cookbook using shared templates. Organize verified launch settings and measured benchmarks, create configuration files and documentation, and update navigation, vendor cards, and page validation.

中文简介正在准备中。当前显示英语简介。

• Add documentation for a newly supported model
• Organize verified launch recipes by hardware
• Publish measured speed and accuracy results