查找技能

Build searches with Qdrant that find similar content and filter results by attributes. The skill covers document retrieval for AI answers, vector storage, memory optimization, and distributed deployment for larger collections.

中文简介正在准备中。当前显示英语简介。

• Building document retrieval for AI answers
• Combining similarity search with category or date filters
• Reducing memory use for large vector collections

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

中文简介正在准备中。当前显示英语简介。

• Run a language model within limited GPU memory
• Load a pre-quantized model for text generation
• Quantize and save your own trained model

Compress LLM weights using HQQ quantization, which stores weights with fewer bits without calibration datasets. Follow workflows for precision settings, model saving, inference integration, and LoRA fine-tuning of quantized models.

中文简介正在准备中。当前显示英语简介。

• Compressing LLMs without calibration datasets
• Serving quantized models with vLLM or HuggingFace Transformers
• Comparing bit widths and inference backends

Convert LLMs to GGUF and reduce model size through quantization, which stores weights at lower numerical precision. Prepare models for CPU or Apple Silicon inference, compare compression levels, and integrate them with local AI tools.

中文简介正在准备中。当前显示英语简介。

• Preparing an LLM for CPU-only use
• Running a local model on Apple Silicon
• Comparing model size and quality across quantization levels

Build document search and AI retrieval workflows with Chroma, a database for numerical representations of text. Cover document storage, meaning-based search, metadata filters, persistence, and connections to LangChain and LlamaIndex.

中文简介正在准备中。当前显示英语简介。

• Building document search based on meaning
• Adding document retrieval to AI answers
• Filtering search results by document attributes

Build safety checks for LLM prompts and responses using Meta's LlamaGuard moderation model. Classify potentially harmful content, block flagged messages, serve checks through an API, and integrate them with NeMo Guardrails.

中文简介正在准备中。当前显示英语简介。

• Checking prompts before sending them to an LLM
• Filtering responses before displaying them
• Building a moderation API

Set up reinforcement learning, which trains models using rewards, with verl. Follow workflows for preparing data, configuring GRPO or PPO training, scaling across GPUs, and addressing memory errors or unstable training.

中文简介正在准备中。当前显示英语简介。

• Training a math reasoning model with GRPO
• Configuring PPO training with a critic model
• Scaling large model training across multiple nodes

Generate embeddings, numerical representations of text or images, for meaning-based search, similarity comparisons, and document grouping. The skill guides model selection, multilingual processing, local execution, and integration with retrieval workflows.

中文简介正在准备中。当前显示英语简介。

• Generate document embeddings for RAG
• Find sentences with similar meanings
• Group documents by topic

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

中文简介正在准备中。当前显示英语简介。

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Prepare text for language models using HuggingFace Tokenizers, which splits text into model-readable units. Train custom vocabularies, process batches, track original text positions, and configure input lengths for use with transformers.

中文简介正在准备中。当前显示英语简介。

• Preparing large text collections for language models
• Training a tokenizer on domain-specific text
• Mapping model outputs back to original text

Use W&B to record machine learning experiments, visualize training, and compare results. The skill also covers automated searches for training settings and version tracking for datasets and models, helping teams share experiments and trace their inputs.

中文简介正在准备中。当前显示英语简介。

• Logging training metrics and viewing progress in real time
• Comparing experiments with different training settings
• Searching automatically for better training settings

Run language models locally with llama.cpp on CPUs, Apple Silicon, or AMD and Intel GPUs. The skill guides model setup, memory-saving GGUF format choices, interactive chat, and serving models through an OpenAI-compatible API.

中文简介正在准备中。当前显示英语简介。

• Running a language model on a CPU-only computer
• Setting up local chat on an Apple Silicon Mac
• Choosing model quantization to fit available memory

Guides experiments that inspect and change internal model values using nnsight. Covers local PyTorch models and remote experiments through NDIF, including replacing intermediate values to test how particular layers affect a model’s predictions.

中文简介正在准备中。当前显示英语简介。

• Inspecting layer outputs and attention patterns
• Replacing internal values to compare predictions
• Running large-model experiments through NDIF

Build and evaluate Mamba models for long sequences using state-space models, which summarize past inputs in an internal state. Covers setup, pretrained text generation, differences between Mamba-1 and Mamba-2, and speed comparisons with Transformers.

中文简介正在准备中。当前显示英语简介。

• Generate text with pretrained Mamba models
• Compare Mamba-1 and Mamba-2 configurations
• Benchmark generation speed against Transformers

Fine-tune large language models with LoRA and QLoRA while limiting GPU memory use. Guides training settings and adapter management, using small sets of task-specific weights that can be saved, switched, or merged into a base model.

中文简介正在准备中。当前显示英语简介。

• Fine-tuning an LLM with limited GPU memory
• Choosing LoRA settings and training layers
• Switching task-specific adapters on one base model

Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.

中文简介正在准备中。当前显示英语简介。

• Running large models with limited GPU memory
• Compressing a model with domain-specific sample text
• Serving AWQ models with vLLM

Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.

中文简介正在准备中。当前显示英语简介。

• Pretraining Llama 3.1 8B on eight GPUs
• Configuring multi-node training with SLURM
• Enabling Float8 training on H100 GPUs

Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.

中文简介正在准备中。当前显示英语简介。

• Deploy an OpenAI-compatible language model API
• Generate text from many prompts in a batch
• Serve quantized models with limited GPU memory

Use MLflow to record machine learning experiments, compare results, and manage model versions. The skill covers logging training settings, metrics, and files, organizing a model registry, and preparing models for local or cloud deployment.

中文简介正在准备中。当前显示英语简介。

• Comparing training settings and model performance
• Recording experiments for later reproduction
• Managing model versions and release stages

Build image captioning, visual question answering, and text-based image search with BLIP-2. The skill explains model selection, batch processing, and memory-saving settings, with Python examples for connecting image understanding to language models.

中文简介正在准备中。当前显示英语简介。

• Generating captions for multiple images
• Building a question-answering system for images
• Searching an image collection with text

Investigate why a PyTorch model behaves a certain way by changing its internal values with pyvene. The skill guides experiments that swap or remove activations, train interventions, compare outputs, and save or share intervention configurations.

中文简介正在准备中。当前显示英语简介。

• Locating model components that affect an output
• Swapping activations to test behavioral hypotheses
• Training interventions to investigate causal structure

Build image generation workflows in Python with Stable Diffusion and HuggingFace Diffusers. The guide covers text prompts, transforming existing images, replacing selected regions, controlling composition, applying learned styles, and adjusting memory use during generation.

中文简介正在准备中。当前显示英语简介。

• Generating images from text descriptions
• Changing the style of an existing image
• Replacing a selected region of an image

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

中文简介正在准备中。当前显示英语简介。

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs