'training data' 검색 결과

Use this skill when conditioning, loading, preparing, or labeling signal data for analysis or ML training. Covers: cleaning a single signal (fill gaps, remove drift, deoutlier, denoise, resample/align a time base) BEFORE analysis; building a `signalDatastore` pipeline; creating a `labeledSignalSet` for Signal Labeler; deriving labels (filename, folder, in-file, ROI, time-frequency ROI); stratified train/val/test splits; framing long signals; parallel processing; and shaping datastore output for `trainnet`. Triggers include "clean up this signal", "remove drift / detrend", "fill gaps", "remove spikes / outliers", "denoise", "resample to a uniform rate", "align channels", "labels from filenames", "stratified split", "prepare for Signal Labeler", and function names like `fillgaps`, `fillmissing`, `detrend`, `filloutliers`, `smoothdata`, `resample`, `synchronize`, `signalDatastore`, `labeledSignalSet`, `filenames2labels`, `folders2labels`, `splitlabels`, `framesig`, `framelbl`, `createDatastores`.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Databricks AI Runtime, the `databricks air` CLI commands for submitting and managing GPU training workloads on Databricks serverless compute. Use for: writing and submitting `databricks air` workload YAML, passing hyperparameters and secrets, checking run status, listing/cancelling runs, streaming a run's logs and watching its progress, custom Docker image setup, and environment configuration.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Conducts Data Protection Impact Assessments for AI and ML systems per EDPB Guidelines 04/2025 on AI processing. Covers training data lawfulness evaluation, model risk assessment, automated decision triggers, and AI-specific DPIA methodology. Keywords: AI DPIA, machine learning impact assessment, EDPB AI guidelines, model risk, training data.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Audit existing model training code — find reproducibility issues, data leakage, and missing best practices. Use when asked to "audit our training code", "is our training reproducible", or "check for training data leakage".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Set up systematic data labeling workflows using Label Studio or similar tools. Implement quality controls, measure inter-annotator agreement, manage labeler teams, and integrate labeled data into ML training pipelines. Use when starting a supervised ML project that requires labeled training data, when model performance is limited by insufficient labeled examples, when labeling text, images, audio, or video, or when implementing active learning to prioritize the most valuable examples.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Execute sophisticated Data Extraction and Privacy Leakage attacks explicitly against Large Language Models (LLMs) to natively force the neural network entirely into organically regurgitating exact, verbatim strings of Highly Confidential Personally Identifiable Information (PII), proprietary source code, or copyrighted material categorically memorized intrinsically during its foundational pre-training phase.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Patterns for loading PDE simulation datasets (PDEBench, PhiFlow, JAX-CFD) from HDF5 files. Handles layout detection (single tensor vs separate variables), spatial/temporal downsampling, multi-variable systems, HuggingFace and DaRUS data sources, and efficient PyTorch DataLoader creation. Use when preparing PDE data for neural operator training.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

머신러닝 모델의 운영 적용을 위해 데이터 규격, 재현 가능한 학습, 품질 평가, 배포, 모니터링과 롤백을 정리하고 구현 계획과 검토 항목을 만듭니다.

• 실험 코드를 학습 파이프라인으로 만듭니다
• 모델 공개 전 품질 기준을 정합니다
• 데이터 누출과 전처리 차이를 조사합니다

TRL로 언어 모델을 추가 학습해 지시와 사람의 선호에 맞는 답변을 만들도록 안내합니다. 데이터 준비, 학습 방식 선택, 보상 모델 학습과 평가를 다룹니다.

• 답변 예시로 지시 수행을 학습합니다
• DPO로 답변 선호를 학습합니다
• 보상 모델을 쓰는 RLHF를 구성합니다

Track machine learning experiments in W&B, record training settings and metrics, and compare results in dashboards. Automate searches for training settings and keep version histories for models and datasets.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing accuracy across training runs
• Monitoring training progress in dashboards
• Searching for better training settings

PyTorch FSDP를 활용한 대규모 모델의 분산 학습 구현과 오류 조사를 돕습니다. 공식 문서 기반 자료와 코드 예제로 분할 전략, 혼합 정밀도, 학습 상태 저장을 검토합니다.

• 대규모 모델의 분산 학습을 구현합니다
• FSDP 적용 방법과 분할 전략을 비교합니다
• 혼합 정밀도와 체크포인트 예제를 확인합니다

Use PyTDC to discover therapeutic machine-learning datasets, create task-appropriate training and test splits, and evaluate predictions against curated benchmarks. Also score selected molecules with supported scoring functions, with explicit download plans and bounded outputs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Find datasets for therapeutic machine-learning tasks
• Plan and create task-appropriate data splits
• Evaluate predictions with benchmark-specific metrics

Manage Azure Machine Learning resources from Python with SDK v2. The skill provides implementation examples for registering data and models, configuring compute and environments, submitting training jobs, monitoring logs, and connecting steps into pipelines.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Submitting training jobs and monitoring logs
• Registering data and model versions
• Connecting preprocessing and training steps

Get guidance on adapting large language models with Axolotl. Covers YAML configuration files, LoRA and QLoRA methods for training fewer parameters, distributed training settings, dataset formats, and debugging training code.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Write YAML settings for model fine-tuning
• Explore training with LoRA or QLoRA
• Configure training across multiple GPUs

Guides setup and operation of Lambda Labs GPU instances for machine learning training and inference. Covers SSH access, persistent storage, API automation, and multi-GPU or multi-node training, including how to retain checkpoints and terminate idle instances.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up a GPU instance for LLM fine-tuning
• Keeping datasets and checkpoints between sessions
• Automating instance launch and termination through the API

Helps configure and troubleshoot DeepSpeed for training large models across multiple devices. Covers memory optimization, parallel training, and DeepNVMe storage transfers, with examples for tuning data movement and configuring models that divide work among specialized components.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Configuring distributed training for large models
• Tuning tensor transfers to NVMe storage
• Setting up models with specialized expert components

Train smaller language models using knowledge distillation, where a larger model supplies examples or prediction targets. This skill covers training losses, generated training data, parameter choices, and output comparisons to support model compression and specialized student models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Training a smaller model from a larger teacher
• Fine-tuning with teacher-generated responses
• Distilling domain knowledge into a specialized model

Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Compressing a large language model into a smaller model
• Training a specialized model from teacher-generated examples
• Comparing distillation methods and training settings

Guides setup and operation of Lambda Labs GPU instances for machine learning training and inference. Covers SSH access, persistent storage, API automation, and multi-GPU or multi-node training, including how to retain checkpoints and terminate idle instances.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up a GPU instance for LLM fine-tuning
• Keeping datasets and checkpoints between sessions
• Automating instance launch and termination through the API

Fine-tune language models with TRL using GRPO, a method that compares scored responses to the same prompt. Covers training data, scoring functions, GPU-conscious settings, and monitoring for tasks with measurable correctness or required output formats.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Train models to follow JSON or XML output formats
• Reward correct answers in math or coding tasks
• Balance correctness, format, and style during training

Add PyTorch FSDP2 to training scripts so model state can be split across GPUs. Covers distributed initialization, mixed precision, CPU offloading, and checkpoint saving and loading for models that exceed a single GPU's memory.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Training a model that exceeds one GPU's memory
• Adding FSDP2 to an existing training script
• Configuring mixed precision and CPU offloading

Fine-tune NV-Segment-CT VISTA3D on CT images and region labels in NIfTI format. Choose standard training or fixed-class softmax training, save model checkpoints and evaluation records, and optionally track training with MLflow.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tuning with paired CT images and region labels
• Checking the training workflow with a smoke run
• Training mutually exclusive classes with softmax

Plan and configure Nemotron customization workflows using existing steps for data preparation, translation, training, conversion, optimization, and evaluation. Check how outputs connect between stages and produce configuration files suited to the supplied models, data, and hardware.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Configure LoRA fine-tuning for a supplied model and dataset
• Connect data preparation and supervised fine-tuning
• Benchmark an existing hosted model endpoint

[omh] Before data leaves the team -- a dataset, log, ticket export or transcript excerpt bound for a vendor, a public issue, a model provider or a training corpus: classify every field, minimize first, pseudonymize with the mapping kept local, and call it redacted only after an observed residual scan. Use when the user says: data-share-review, data share review, pii redaction, redact pii, pseudonymize, de-identify, anonymize the dataset, residual pii.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.