'transformers' 검색 결과

Build JavaScript or TypeScript applications that run text, image, and audio models in browsers or server runtimes. Guides compatible model selection, GPU or CPU execution, caching, and memory cleanup without requiring a Python server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Add text classification or translation to a browser app
• Implement image classification and object detection
• Transcribe audio using JavaScript

Otimiza atenção em transformers com Flash Attention para ganho de 2-4x em velocidade e redução de 10-20x em memória. Use ao treinar/executar transformers com sequências longas (>512 tokens), ao encontrar problemas de memória GPU com atenção, ou quando precisa de inferência mais rápida. Suporta SDPA nativo do PyTorch, biblioteca flash-attn, H100 FP8 e sliding window attention.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Use Transformers.js to run state-of-the-art machine learning models directly in JavaScript/TypeScript. Supports NLP (text classification, translation, summarization), computer vision (image classification, object detection), audio (speech recognition, audio classification), and multimodal tasks. Works in browsers and server-side runtimes (Node.js, Bun, Deno) with WebGPU/WASM using pre-trained models from Hugging Face Hub.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

로컬 실행이나 지속적 통합에서 발견한 Python 타입 검사 오류를 분류하고, 타입 좁히기와 주석 수정부터 재검증까지 진행합니다. 새로운 타입 검사 범위 추가도 다룹니다.

• 지속적 통합의 타입 검사 실패 수정
• None이 포함된 타입 오류 수정
• 타입 검사 대상 디렉터리 추가

Test your understanding of a phase in AI Engineering from Scratch through eight multiple-choice questions. Receive a score, explanations for incorrect answers, and specific lessons to review before continuing your studies.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Checking your understanding after completing a phase
• Assessing readiness for the next phase
• Finding lessons to review from incorrect answers

Build Python workflows that constrain language model output using text patterns and grammar rules. Generate structured JSON, restrict classifications to allowed labels, extract information, and combine reusable generation steps with loops and tool selection.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Generate JSON with a defined structure
• Constrain date, email, and identifier formats
• Classify text using a fixed set of labels

Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running large models with limited GPU memory
• Compressing a model with domain-specific sample text
• Serving AWQ models with vLLM

Learn how GPT language models work by preparing text, training a small model, and generating samples. Covers CPU experiments, custom datasets, further training of pretrained GPT-2 models, and reproducing GPT-2 with multiple GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a small model on Shakespeare using a CPU
• Prepare custom text for model training
• Further train a pretrained GPT-2 model

Fine-tune large language models with LoRA and QLoRA while limiting GPU memory use. Guides training settings and adapter management, using small sets of task-specific weights that can be saved, switched, or merged into a base model.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tuning an LLM with limited GPU memory
• Choosing LoRA settings and training layers
• Switching task-specific adapters on one base model

Integrate Flash Attention into transformer models to reduce processing time and GPU memory use for long sequences. Covers PyTorch integration, advanced attention options, and benchmarks that compare speed, memory use, and output accuracy.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Speeding up transformer training on long sequences
• Reducing GPU memory use during attention
• Adding Flash Attention to a PyTorch model

Adapt machine learning training to run across multiple GPUs or machines with Ray Train. Covers changes to existing code, comparing training settings with Ray Tune, and saving checkpoints so training can resume after failures.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Adapting existing PyTorch code for multiple GPUs
• Training HuggingFace models across multiple machines
• Comparing learning rates and batch sizes with Ray Tune

Extend the amount of text a language model can process at once. Compares RoPE, YaRN, ALiBi, and position interpolation, with implementation examples, additional training guidance, and memory optimization approaches for long document processing.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extend an existing model to handle longer inputs
• Compare methods for representing token positions
• Plan additional training with long documents

Build Python workflows that constrain language model output using text patterns and grammar rules. Generate structured JSON, restrict classifications to allowed labels, extract information, and combine reusable generation steps with loops and tool selection.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Generate JSON with a defined structure
• Constrain date, email, and identifier formats
• Classify text using a fixed set of labels

Helps extend how much text a language model can process at once. Covers choosing RoPE, YaRN, ALiBi, or position interpolation, implementing position information, fine-tuning on longer documents, and managing memory during inference.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extend an existing model to handle longer documents
• Compare context extension methods
• Implement position information in attention layers

Helps fine-tune large language models with LoRA and QLoRA, methods that train small sets of additional parameters. Covers memory-conscious training, configuration choices, saving adapters, and switching task-specific adapters on a shared base model.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tune a model with limited GPU memory
• Choose LoRA settings for a specific task
• Switch task-specific adapters on one base model

Optimize transformer attention, the calculation that relates tokens to one another, using Flash Attention. The skill guides PyTorch integration, GPU memory reduction, performance measurement, and output comparisons for training or inference with long sequences.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reducing GPU memory use with long sequences
• Integrating Flash Attention into PyTorch models
• Comparing runtime and outputs before and after changes

Learn how GPT language models work by preparing text, training a small model, and generating samples. Covers CPU experiments, custom datasets, further training of pretrained GPT-2 models, and reproducing GPT-2 with multiple GPUs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train a small model on Shakespeare using a CPU
• Prepare custom text for model training
• Further train a pretrained GPT-2 model

Evaluate Hugging Face Hub models using inspect-ai or lighteval, with local inference or a provider-backed option. Choose an inference engine, start with a small test, and switch engines when model compatibility requires it.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run benchmark evaluations on a local GPU
• Choose an evaluation framework and inference engine
• Check a small sample before a full evaluation

Choose a serving container for models deployed on SageMaker. Match the model type to a compatible image, retrieve its address from the AWS catalog, and check regional availability, CPU or GPU variants, and required host settings.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choose a container for an LLM deployment
• Select images for embeddings and rerankers
• Check regional image addresses and GPU compatibility

Fine-tune vision models on custom images using Hugging Face Jobs cloud GPUs. Covers object detection, image classification, and segmentation—identifying image regions—with dataset validation, hardware selection, cost estimates, monitoring, and saving trained models to the Hub.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train an object detector on custom images
• Fine-tune an image classifier
• Adapt SAM/SAM2 to custom image masks

Convert existing Hugging Face Transformers Trainer or TRL SFTTrainer training code into an NVFLARE federated job using flare.patch(trainer), local validation, and job export; use when the user names Hugging Face or preliminary source inspection identifies one Hugging Face owner, and not for manual PyTorch loops, Lightning, inference-only pipelines, deployment, or experiment workflows.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Run Hugging Face models in JavaScript or TypeScript with Transformers.js, WebGPU, or WASM across browser, Node.js, Bun, and Deno. Use for client-side or JS-runtime inference, not Python training.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Train or fine-tune SentenceTransformer bi-encoders, CrossEncoder rerankers, or SparseEncoder models, including losses, negatives, evaluation, distillation, LoRA, and Matryoshka. Use for sentence-transformers training tasks.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

HuggingFace Transformers with biomedical LMs (BioBERT, PubMedBERT, BioGPT, BioMedLM) for scientific NLP: NER (genes, diseases, chemicals), relation extraction, QA, text classification, abstract summarization. Covers loading, biomedical tokenization, inference pipelines, fine-tuning. Alternatives: spaCy en_core_sci_lg (rule-based NER), Stanza (biomedical models), NLTK.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.