“transformer”的搜索结果

Build text tokenizers that split multilingual text into small units for AI models. Learn how to train SentencePiece on raw text, configure BPE or Unigram splitting methods, and convert text to token IDs and back.

中文简介正在准备中。当前显示英语简介。

• Preparing Japanese, Chinese, or Korean text for AI models
• Training a custom vocabulary from raw text
• Choosing between BPE and Unigram

Reduce GPU memory use by loading language models in 8-bit or 4-bit formats with bitsandbytes and HuggingFace Transformers. Includes configuration examples, QLoRA fine-tuning of compressed models, and optimizers that reduce memory needed during training.

中文简介正在准备中。当前显示英语简介。

• Load larger models within limited GPU memory
• Compare 8-bit and 4-bit model settings
• Fine-tune a model with QLoRA

Build text, image, and audio features in JavaScript using machine learning models that run in browsers or server runtimes. Covers model selection, execution settings, caching, and memory cleanup without requiring a Python server.

中文简介正在准备中。当前显示英语简介。

• Add sentiment analysis to a JavaScript app
• Build image classification in a browser
• Implement audio transcription

Track machine learning experiments with SwanLab by recording training settings, metrics, and media such as images and audio. Learn to compare runs, inspect training charts, and connect existing training code to local, cloud, or self-hosted dashboards.

中文简介正在准备中。当前显示英语简介。

• Comparing experiments with different training settings
• Viewing training metrics in a local dashboard
• Logging sample images and audio alongside metrics

Optimize transformer attention, the calculation that relates tokens to one another, using Flash Attention. The skill guides PyTorch integration, GPU memory reduction, performance measurement, and output comparisons for training or inference with long sequences.

中文简介正在准备中。当前显示英语简介。

• Reducing GPU memory use with long sequences
• Integrating Flash Attention into PyTorch models
• Comparing runtime and outputs before and after changes

Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.

中文简介正在准备中。当前显示英语简介。

• Run language models with limited GPU memory
• Convert your own model to 4-bit weights
• Compare compression settings for quality and speed

Execute programs on a compiled transformer stack machine where every instruction fetch and memory read is a parabolic attention head. Demonstrates that transformer attention + FF layers can implement a working computer. Use when user mentions "llm-as-computer", "lac", "stack machine", "compiled transformer", "percepta", "parabolic attention", "execute program", or asks to run/trace programs on the transformer executor.

中文简介正在准备中。当前显示原文说明。

Molecular featurization hub with one consistent interface over 100+ featurizers. Fingerprints (ECFP/Morgan, MACCS, atom pair, topological torsion, Avalon, RDKit, ERG), RDKit and Mordred descriptor sets, pharmacophore and 3D shape descriptors, scaffold keys, and pretrained embeddings (ChemBERTa, ChemGPT, MolT5, GIN, Graphormer) through a common transformer API with caching and parallelism. Use this skill to convert SMILES into model-ready feature matrices for QSAR, virtual screening, and molecular ML, and to choose between featurizer families. Also trigger on molfeat, MoleculeTransformer, FPVecTransformer, PretrainedHFTransformer, molfeat model store, or featurizer selection.

中文简介正在准备中。当前显示原文说明。

Fornece orientação para pesquisa de interpretabilidade mecanística usando TransformerLens para inspecionar e manipular internals de transformers via HookPoints e caching de ativações. Use ao fazer engenharia reversa de algoritmos de modelos, estudar padrões de atenção ou realizar experimentos de activation patching.

中文简介正在准备中。当前显示原文说明。

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

中文简介正在准备中。当前显示原文说明。

Create AgentDB learning plugins that use recorded experience to improve agent decisions. Choose a learning method, store states, actions, and rewards, train models, and evaluate suggested actions through CLI and API workflows.

中文简介正在准备中。当前显示英语简介。

• Train agents from historical experience
• Build decision-making for games and navigation
• Combine experience from multiple agents for training

创建使用经验数据的AgentDB学习插件，从选择适合用途的学习方法，到记录行动与奖励，再到模型训练和评估，完成相应实现。

• 利用历史经验训练智能体
• 实现游戏或路线选择决策
• 汇集多个智能体的经验进行学习

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

中文简介正在准备中。当前显示英语简介。

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

中文简介正在准备中。当前显示英语简介。

• Run a language model within limited GPU memory
• Load a pre-quantized model for text generation
• Quantize and save your own trained model

Extend the amount of text a language model can process at once. Compares RoPE, YaRN, ALiBi, and position interpolation, with implementation examples, additional training guidance, and memory optimization approaches for long document processing.

中文简介正在准备中。当前显示英语简介。

• Extend an existing model to handle longer inputs
• Compare methods for representing token positions
• Plan additional training with long documents

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

中文简介正在准备中。当前显示英语简介。

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Helps extend how much text a language model can process at once. Covers choosing RoPE, YaRN, ALiBi, or position interpolation, implementing position information, fine-tuning on longer documents, and managing memory during inference.

中文简介正在准备中。当前显示英语简介。

• Extend an existing model to handle longer documents
• Compare context extension methods
• Implement position information in attention layers

Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.

中文简介正在准备中。当前显示英语简介。

• Load a larger model within available GPU memory
• Compare 4-bit and 8-bit quantization settings
• Fine-tune a quantized model with QLoRA

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Use SAELens to train and analyze sparse autoencoders, which break model activations into a small set of interpretable features. Explore pretrained features, evaluate reconstruction quality, troubleshoot training, and test how individual features influence generated text.

中文简介正在准备中。当前显示英语简介。

• Exploring features in a pretrained SAE
• Training an SAE for a selected model layer
• Investigating inactive features and reconstruction errors

Build JavaScript or TypeScript applications that run text, image, and audio models in browsers or server runtimes. Guides compatible model selection, GPU or CPU execution, caching, and memory cleanup without requiring a Python server.

中文简介正在准备中。当前显示英语简介。

• Add text classification or translation to a browser app
• Implement image classification and object detection
• Transcribe audio using JavaScript

Create AgentDB learning plugins that use recorded experience to improve agent decisions. Choose a learning method, store states, actions, and rewards, train models, and evaluate suggested actions through CLI and API workflows.

中文简介正在准备中。当前显示英语简介。

• Train agents from historical experience
• Build decision-making for games and navigation
• Combine experience from multiple agents for training

Use SAELens to train and analyze sparse autoencoders, which break model activations into a small set of interpretable features. Explore pretrained features, evaluate reconstruction quality, troubleshoot training, and test how individual features influence generated text.

中文简介正在准备中。当前显示英语简介。

• Exploring features in a pretrained SAE
• Training an SAE for a selected model layer
• Investigating inactive features and reconstruction errors