'transformer' 검색 결과

Build text, image, and audio features in JavaScript using machine learning models that run in browsers or server runtimes. Covers model selection, execution settings, caching, and memory cleanup without requiring a Python server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Add sentiment analysis to a JavaScript app
• Build image classification in a browser
• Implement audio transcription

Track machine learning experiments with SwanLab by recording training settings, metrics, and media such as images and audio. Learn to compare runs, inspect training charts, and connect existing training code to local, cloud, or self-hosted dashboards.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing experiments with different training settings
• Viewing training metrics in a local dashboard
• Logging sample images and audio alongside metrics

Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run language models with limited GPU memory
• Convert your own model to 4-bit weights
• Compare compression settings for quality and speed

Optimize transformer attention, the calculation that relates tokens to one another, using Flash Attention. The skill guides PyTorch integration, GPU memory reduction, performance measurement, and output comparisons for training or inference with long sequences.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reducing GPU memory use with long sequences
• Integrating Flash Attention into PyTorch models
• Comparing runtime and outputs before and after changes

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Execute programs on a compiled transformer stack machine where every instruction fetch and memory read is a parabolic attention head. Demonstrates that transformer attention + FF layers can implement a working computer. Use when user mentions "llm-as-computer", "lac", "stack machine", "compiled transformer", "percepta", "parabolic attention", "execute program", or asks to run/trace programs on the transformer executor.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Molecular featurization hub with one consistent interface over 100+ featurizers. Fingerprints (ECFP/Morgan, MACCS, atom pair, topological torsion, Avalon, RDKit, ERG), RDKit and Mordred descriptor sets, pharmacophore and 3D shape descriptors, scaffold keys, and pretrained embeddings (ChemBERTa, ChemGPT, MolT5, GIN, Graphormer) through a common transformer API with caching and parallelism. Use this skill to convert SMILES into model-ready feature matrices for QSAR, virtual screening, and molecular ML, and to choose between featurizer families. Also trigger on molfeat, MoleculeTransformer, FPVecTransformer, PretrainedHFTransformer, molfeat model store, or featurizer selection.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Fornece orientação para pesquisa de interpretabilidade mecanística usando TransformerLens para inspecionar e manipular internals de transformers via HookPoints e caching de ativações. Use ao fazer engenharia reversa de algoritmos de modelos, estudar padrões de atenção ou realizar experimentos de activation patching.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Create AgentDB learning plugins that use recorded experience to improve agent decisions. Choose a learning method, store states, actions, and rewards, train models, and evaluate suggested actions through CLI and API workflows.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train agents from historical experience
• Build decision-making for games and navigation
• Combine experience from multiple agents for training

Create AgentDB learning plugins that use recorded experience to improve agent decisions. Choose a learning method, store states, actions, and rewards, train models, and evaluate suggested actions through CLI and API workflows.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train agents from historical experience
• Build decision-making for games and navigation
• Combine experience from multiple agents for training

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run a language model within limited GPU memory
• Load a pre-quantized model for text generation
• Quantize and save your own trained model

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Extend the amount of text a language model can process at once. Compares RoPE, YaRN, ALiBi, and position interpolation, with implementation examples, additional training guidance, and memory optimization approaches for long document processing.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extend an existing model to handle longer inputs
• Compare methods for representing token positions
• Plan additional training with long documents

Use Outlines to make language models produce data in a defined format. The skill covers extracting information into JSON, restricting classification labels, and applying Pydantic models, which define fields and data types, with local model backends.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extracting company or profile details into JSON
• Classifying text using a fixed set of labels
• Generating text that matches a specified pattern

Helps extend how much text a language model can process at once. Covers choosing RoPE, YaRN, ALiBi, or position interpolation, implementing position information, fine-tuning on longer documents, and managing memory during inference.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extend an existing model to handle longer documents
• Compare context extension methods
• Implement position information in attention layers

Guide language model training with TRL, from learning to follow instructions to matching human preferences. Covers method selection, training data, reward models that score responses, evaluation, and adjustments for memory limits or unstable training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a model on instruction and response examples
• Align responses using preferred and rejected answer pairs
• Build a training pipeline using human feedback

Use SAELens to train and analyze sparse autoencoders, which break model activations into a small set of interpretable features. Explore pretrained features, evaluate reconstruction quality, troubleshoot training, and test how individual features influence generated text.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring features in a pretrained SAE
• Training an SAE for a selected model layer
• Investigating inactive features and reconstruction errors

Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Load a larger model within available GPU memory
• Compare 4-bit and 8-bit quantization settings
• Fine-tune a quantized model with QLoRA

Build JavaScript or TypeScript applications that run text, image, and audio models in browsers or server runtimes. Guides compatible model selection, GPU or CPU execution, caching, and memory cleanup without requiring a Python server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Add text classification or translation to a browser app
• Implement image classification and object detection
• Transcribe audio using JavaScript

Train or fine-tune SentenceTransformer bi-encoders, CrossEncoder rerankers, or SparseEncoder models, including losses, negatives, evaluation, distillation, LoRA, and Matryoshka. Use for sentence-transformers training tasks.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Design practical electromagnetic devices including electromagnets, DC and brushless motors, generators, and transformers by bridging theory to application. Use when sizing a solenoid or toroidal electromagnet for a target field or force, selecting motor topology and computing torque and efficiency, designing a transformer for a given voltage ratio and power rating, or analyzing losses from copper resistance, core hysteresis, and eddy currents.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Otimiza atenção em transformers com Flash Attention para ganho de 2-4x em velocidade e redução de 10-20x em memória. Use ao treinar/executar transformers com sequências longas (>512 tokens), ao encontrar problemas de memória GPU com atenção, ou quando precisa de inferência mais rápida. Suporta SDPA nativo do PyTorch, biblioteca flash-attn, H100 FP8 e sliding window attention.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.