“transformers”的搜索结果

Train sentence-transformers models for search, similarity, and reranking, which reorders search results by relevance. Choose a model type, prepare data, configure training, compare results against a baseline, and publish the trained model to Hugging Face Hub.

中文简介正在准备中。当前显示英语简介。

• Fine-tuning an embedding model for domain-specific search
• Training a model to rerank search results
• Training SPLADE or ColBERT retrieval models

Build and evaluate Mamba models for long sequences using state-space models, which summarize past inputs in an internal state. Covers setup, pretrained text generation, differences between Mamba-1 and Mamba-2, and speed comparisons with Transformers.

中文简介正在准备中。当前显示英语简介。

• Generate text with pretrained Mamba models
• Compare Mamba-1 and Mamba-2 configurations
• Benchmark generation speed against Transformers

Prepare large text collections for AI models with fast tokenizers, which split text into model inputs. Train custom vocabularies, trace tokens to original text positions, adjust input lengths, and integrate the results with transformers.

中文简介正在准备中。当前显示英语简介。

• Tokenizing large text collections
• Training a custom vocabulary
• Mapping extracted names or answers back to original text

Implement Mamba, a model architecture that processes sequences through an internal state with computation scaling linearly with input length. Covers pretrained text generation, Mamba-1 and Mamba-2 configuration, speed comparisons with Transformers, and GPU memory troubleshooting.

中文简介正在准备中。当前显示英语简介。

• Explore models for long sequences or streaming applications
• Generate text with pretrained Mamba models
• Compare Mamba-1 and Mamba-2 configurations

Train sentence-transformers models for search, similarity, and reranking, which reorders search results by relevance. Choose a model type, prepare data, configure training, compare results against a baseline, and publish the trained model to Hugging Face Hub.

中文简介正在准备中。当前显示英语简介。

• Fine-tuning an embedding model for domain-specific search
• Training a model to rerank search results
• Training SPLADE or ColBERT retrieval models

Prepare text for language models using HuggingFace Tokenizers, which splits text into model-readable units. Train custom vocabularies, process batches, track original text positions, and configure input lengths for use with transformers.

中文简介正在准备中。当前显示英语简介。

• Preparing large text collections for language models
• Training a tokenizer on domain-specific text
• Mapping model outputs back to original text

Use Hugging Face Transformers to load pretrained models, generate text, and classify text, images, or audio. Prepare model inputs, control generation settings, and fine-tune models on custom datasets with the Trainer API.

中文简介正在准备中。当前显示英语简介。

• Prototype text, image, or audio classification
• Configure text generation and conversational responses
• Fine-tune a model on a custom dataset

Generate embeddings, numerical representations of text or images, for meaning-based search, similarity comparisons, and document grouping. The skill guides model selection, multilingual processing, local execution, and integration with retrieval workflows.

中文简介正在准备中。当前显示英语简介。

• Generate document embeddings for RAG
• Find sentences with similar meanings
• Group documents by topic

Generate embeddings, numerical representations of text or images, for meaning-based search, similarity comparisons, and document grouping. The skill guides model selection, multilingual processing, local execution, and integration with retrieval workflows.

中文简介正在准备中。当前显示英语简介。

• Generate document embeddings for RAG
• Find sentences with similar meanings
• Group documents by topic

Apply HQQ quantization, which stores language model weights using fewer bits without calibration examples. Covers precision settings, inference backends, saving compressed models, deployment with HuggingFace Transformers or vLLM, and further training with LoRA.

中文简介正在准备中。当前显示英语简介。

• Compressing a model without calibration data
• Comparing 4-bit and 2-bit quantization settings
• Running quantized models with HuggingFace Transformers or vLLM

Compress LLM weights using HQQ quantization, which stores weights with fewer bits without calibration datasets. Follow workflows for precision settings, model saving, inference integration, and LoRA fine-tuning of quantized models.

中文简介正在准备中。当前显示英语简介。

• Compressing LLMs without calibration datasets
• Serving quantized models with vLLM or HuggingFace Transformers
• Comparing bit widths and inference backends

Build text tokenizers that split multilingual text into small units for AI models. Learn how to train SentencePiece on raw text, configure BPE or Unigram splitting methods, and convert text to token IDs and back.

中文简介正在准备中。当前显示英语简介。

• Preparing Japanese, Chinese, or Korean text for AI models
• Training a custom vocabulary from raw text
• Choosing between BPE and Unigram

Reduce GPU memory use by loading language models in 8-bit or 4-bit formats with bitsandbytes and HuggingFace Transformers. Includes configuration examples, QLoRA fine-tuning of compressed models, and optimizers that reduce memory needed during training.

中文简介正在准备中。当前显示英语简介。

• Load larger models within limited GPU memory
• Compare 8-bit and 4-bit model settings
• Fine-tune a model with QLoRA

Build text, image, and audio features in JavaScript using machine learning models that run in browsers or server runtimes. Covers model selection, execution settings, caching, and memory cleanup without requiring a Python server.

中文简介正在准备中。当前显示英语简介。

• Add sentiment analysis to a JavaScript app
• Build image classification in a browser
• Implement audio transcription

Track machine learning experiments with SwanLab by recording training settings, metrics, and media such as images and audio. Learn to compare runs, inspect training charts, and connect existing training code to local, cloud, or self-hosted dashboards.

中文简介正在准备中。当前显示英语简介。

• Comparing experiments with different training settings
• Viewing training metrics in a local dashboard
• Logging sample images and audio alongside metrics

Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.

中文简介正在准备中。当前显示英语简介。

• Run language models with limited GPU memory
• Convert your own model to 4-bit weights
• Compare compression settings for quality and speed

Train or fine-tune sentence-transformers models across `SentenceTransformer` (bi-encoder, dense or static embedding model for retrieval, similarity, clustering, classification, paraphrase mining, dedup, multimodal), `CrossEncoder` (reranker, pair scoring for two-stage retrieval / pair classification), `SparseEncoder` (SPLADE, sparse embedding model for learned-sparse retrieval), and `MultiVectorEncoder` (ColBERT / late-interaction, per-token embeddings scored with MaxSim). Covers loss selection, hard-negative mining, evaluators, distillation, LoRA, Matryoshka, and Hugging Face Hub publishing. Use for any sentence-transformers training task.

中文简介正在准备中。当前显示原文说明。

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

中文简介正在准备中。当前显示英语简介。

• Run a language model within limited GPU memory
• Load a pre-quantized model for text generation
• Quantize and save your own trained model

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

中文简介正在准备中。当前显示英语简介。

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Guides the use of RWKV, a language model architecture that carries information forward in a compact state. Covers streaming text generation, long document processing, fine-tuning, and memory comparisons with Transformers.

中文简介正在准备中。当前显示英语简介。

• Build streaming text generation
• Process long documents in chunks
• Compare memory needs with Transformers

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

中文简介正在准备中。当前显示英语简介。

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.

中文简介正在准备中。当前显示英语简介。

• Load a larger model within available GPU memory
• Compare 4-bit and 8-bit quantization settings
• Fine-tune a quantized model with QLoRA