'training data' 검색 결과

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Axolotl로 대규모 언어 모델을 추가 학습하는 데 필요한 YAML 설정, 데이터 형식과 학습 방법을 안내합니다. 여러 GPU의 설정과 학습 오류, 속도 문제 조사에도 활용합니다.

• 추가 학습용 YAML 설정 작성
• LoRA와 QLoRA 학습 방법 확인
• 데이터 형식과 API 사용법 확인

답변 평가를 활용하는 강화 학습으로 대규모 언어 모델을 추가 훈련하는 절차를 안내합니다. Megatron-LM과 SGLang을 결합해 데이터 준비, 병렬 실행, 맞춤형 생성을 다룹니다.

• 언어 모델의 GRPO 훈련 시작
• 답변 생성과 훈련을 동시에 실행
• 도구를 사용하는 에이전트 훈련

Forecast sales, demand, or sensor readings with Google's pretrained TimesFM model, without custom training. Check hardware and dataset memory needs, include external factors such as prices or holidays, and obtain forecasts with uncertainty ranges.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Forecasting future sales or demand from CSV data
• Including prices and holidays in sales forecasts
• Forecasting multiple stores' time series in batches

Use W&B to record machine learning experiments, visualize training, and compare results. The skill also covers automated searches for training settings and version tracking for datasets and models, helping teams share experiments and trace their inputs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Logging training metrics and viewing progress in real time
• Comparing experiments with different training settings
• Searching automatically for better training settings

Plan and troubleshoot large language and vision model training and inference. This guide uses hardware measurements to identify bottlenecks, address memory shortages and unstable training, and improve checkpointing, recovery, and performance across multiple GPUs and machines.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Diagnosing slow training and GPU memory shortages
• Investigating loss spikes and invalid numerical values
• Debugging communication hangs across GPUs and machines

Set up W&B to record machine learning metrics and settings, visualize training progress, and compare experiments. Includes automated searches for training settings, version tracking for datasets and models, and shared reports for team collaboration.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Recording and visualizing training metrics
• Comparing experiments with different training settings
• Automatically searching for better training settings

Guides PyTorch model training and fine-tuning, from choosing architectures to configuring optimizers and learning rates. Provides troubleshooting steps for unstable loss and memory shortages, plus methods for improving GPU throughput and comparing experiments.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choose model architectures for the available data type and scale
• Configure optimizers and learning-rate schedules
• Investigate loss spikes, NaNs, and GPU memory shortages

Manage Hugging Face Hub through the hf command line tool. Download and upload models or datasets, organize cloud storage, manage authentication and local caches, run scheduled jobs, and deploy or maintain model inference services.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Download or publish models and datasets
• Sync training checkpoints to cloud storage
• Inspect and clean the local cache

Collect Trustpilot reviews for a company domain, with filters for ratings, language, dates, and reply status. Get structured review text, reviewer details, and company responses across pages to support reputation research and customer service analysis.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Collect low-rated reviews to study customer complaints
• Gather reviews for competitor reputation comparisons
• Collect company replies and their publication dates

Helps plan dataset splits for machine learning training, validation, and testing. Specifies ratios, random seeds, class balance rules, and time or group constraints, with guidance for handing the split to leakage review and model training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Planning training, validation, and test partitions
• Preserving class proportions across dataset splits
• Defining time-based or grouped split constraints

Organize code and data projects into clear folders with documented workflows, data fields, dependencies, and changes. The skill guides new machine learning and data processing scripts, while preserving existing project structure during modifications.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Creating a documented machine learning training project
• Organizing data cleaning code and field definitions
• Updating scripts while preserving project structure

Set up W&B to record machine learning metrics and settings, visualize training progress, and compare experiments. Includes automated searches for training settings, version tracking for datasets and models, and shared reports for team collaboration.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Recording and visualizing training metrics
• Comparing experiments with different training settings
• Automatically searching for better training settings

Routes any task involving AWS databases — choosing, comparing, recommending, getting started with, or operating a database — to the correct service-specific skill. Supersedes general training-data knowledge with post-training service updates, corrected limitations, and decision procedures for relational (Aurora, DSQL, RDS), key-value (DynamoDB), wide-column (Keyspaces), document (DocumentDB), graph (Neptune), time-series (Timestream), and in-memory/caching (ElastiCache, MemoryDB) workloads. Activates when a user describes building an application on AWS that will store, retrieve, or manage data, even if they do not mention 'database' explicitly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Use this skill when conditioning, loading, preparing, or labeling signal data for analysis or ML training. Covers: cleaning a single signal (fill gaps, remove drift, deoutlier, denoise, resample/align a time base) BEFORE analysis; building a `signalDatastore` pipeline; creating a `labeledSignalSet` for Signal Labeler; deriving labels (filename, folder, in-file, ROI, time-frequency ROI); stratified train/val/test splits; framing long signals; parallel processing; and shaping datastore output for `trainnet`. Triggers include "clean up this signal", "remove drift / detrend", "fill gaps", "remove spikes / outliers", "denoise", "resample to a uniform rate", "align channels", "labels from filenames", "stratified split", "prepare for Signal Labeler", and function names like `fillgaps`, `fillmissing`, `detrend`, `filloutliers`, `smoothdata`, `resample`, `synchronize`, `signalDatastore`, `labeledSignalSet`, `filenames2labels`, `folders2labels`, `splitlabels`, `framesig`, `framelbl`, `createDatastores`.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Databricks AI Runtime, the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute. Use for: writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Conducts Data Protection Impact Assessments for AI and ML systems per EDPB Guidelines 04/2025 on AI processing. Covers training data lawfulness evaluation, model risk assessment, automated decision triggers, and AI-specific DPIA methodology. Keywords: AI DPIA, machine learning impact assessment, EDPB AI guidelines, model risk, training data.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Audit existing model training code — find reproducibility issues, data leakage, and missing best practices. Use when asked to "audit our training code", "is our training reproducible", or "check for training data leakage".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Set up systematic data labeling workflows using Label Studio or similar tools. Implement quality controls, measure inter-annotator agreement, manage labeler teams, and integrate labeled data into ML training pipelines. Use when starting a supervised ML project that requires labeled training data, when model performance is limited by insufficient labeled examples, when labeling text, images, audio, or video, or when implementing active learning to prioritize the most valuable examples.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Execute sophisticated Data Extraction and Privacy Leakage attacks explicitly against Large Language Models (LLMs) to natively force the neural network entirely into organically regurgitating exact, verbatim strings of Highly Confidential Personally Identifiable Information (PII), proprietary source code, or copyrighted material categorically memorized intrinsically during its foundational pre-training phase.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Patterns for loading PDE simulation datasets (PDEBench, PhiFlow, JAX-CFD) from HDF5 files. Handles layout detection (single tensor vs separate variables), spatial/temporal downsampling, multi-variable systems, HuggingFace and DaRUS data sources, and efficient PyTorch DataLoader creation. Use when preparing PDE data for neural operator training.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

머신러닝 모델의 운영 적용을 위해 데이터 규격, 재현 가능한 학습, 품질 평가, 배포, 모니터링과 롤백을 정리하고 구현 계획과 검토 항목을 만듭니다.

• 실험 코드를 학습 파이프라인으로 만듭니다
• 모델 공개 전 품질 기준을 정합니다
• 데이터 누출과 전처리 차이를 조사합니다

TRL로 언어 모델을 추가 학습해 지시와 사람의 선호에 맞는 답변을 만들도록 안내합니다. 데이터 준비, 학습 방식 선택, 보상 모델 학습과 평가를 다룹니다.

• 답변 예시로 지시 수행을 학습합니다
• DPO로 답변 선호를 학습합니다
• 보상 모델을 쓰는 RLHF를 구성합니다