Guides adding metadata, extra information attached to data elements, to Apache Beam's WindowedValue. Maps the changes needed across serialization, storage, processing, and runner interfaces so new fields remain available during pipeline execution.
- Adding trace context or drain flags to WindowedValue
- Checking metadata preservation through Windmill storage
- Reviewing propagation through grouping and timers
apache/beam☆ 8.7KUpdated Oct 20, 2026
⚠️ CRITICAL USER EXPERIENCE-BASED SKILL - ALWAYS CONSULT BEFORE DATA PREPROCESSING ⚠️ Prevents catastrophic errors (88.9% error rate in V1.0 case study) through multi-level feature analysis, data leakage detection, and semantic validation. MANDATORY for: data preprocessing, feature engineering, standardization, normalization, interpolation, missing value handling, feature selection, or ANY data transformation task. Covers grouped time-series, cross-sectional, panel data. Detects: time travel leakage, causal inversion, ID misuse, semantic-numeric fallacies, distribution blindness. User's hard-won lessons from real project failures.
The English summary is being prepared. Showing the original description.
foryourhealth111-pixel/Vibe-Skills☆ 3.7KUpdated Oct 20, 2026
Design data systems by understanding storage engines, replication, partitioning, transactions, and consistency models. Use when the user mentions "database choice", "which database should I use", "SQL or NoSQL", "replication lag", "partitioning strategy", "consistency vs availability", "stream processing", "ACID transactions", "eventual consistency", "my queries are slow at scale", or "data is inconsistent across replicas". Also trigger when choosing a datastore, designing data pipelines, or debugging distributed-system consistency issues. Covers data models, batch/stream processing, and distributed consensus. For system design, see system-design. For resilience, see release-it.
The English summary is being prepared. Showing the original description.
wondelai/skills☆ 2.5KUpdated Sep 11, 2026
Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines.
The English summary is being prepared. Showing the original description.
OpenRaiser/NanoResearch☆ 1.3KUpdated Oct 9, 2026
Import recorded driving sensor data (GPS, camera, lidar, actor tracks, lanes) into scenariobuilder.* objects (GPSData, CameraData, LidarData, ActorTrackData, Trajectory, laneData) and run preprocessing — synchronize, offset correction, crop, normalizeTimestamps, convertTimestamps. Also: compute actor tracks from lidar when no annotations exist, attach camera/lidar mounting + intrinsics, export to MAT/workspace/timetable/script. Use for raw driving dataset files (KITTI, nuScenes, Waymo, Pandaset, ROS/ROS2 bags, .mat, .csv, .mp4) or driving/vehicle/sensor logs that need wrapping. drivingLogAnalyzer (DLA) is OPT-IN ONLY — invoke only on explicit user request ('DLA', 'open in DLA', 'inspect/explore/analyze the recording') or reported sensor problem (sync drift, timestamp mismatch, overlay misalignment). NEVER auto-launch DLA after wrapping (Rule 0). For 'build scenario / export to RoadRunner / drivingScenario / OpenSCENARIO / Unreal / simulate', hand off to matlab-use-scenario-builder.
The English summary is being prepared. Showing the original description.
matlab/matlab-agentic-toolkit☆ 1.2KUpdated Oct 14, 2026
Expert LGPD compliance advisor for Brazil's Lei Geral de Proteção de Dados (Law 13,709/2018). Use this skill whenever a user asks about LGPD, Brazilian data protection, ANPD, personal data processing in Brazil, data subject rights under Brazilian law, legal bases for processing, sensitive data handling, DPO appointment in Brazil, data breach notification to ANPD, LGPD penalties (fines up to 2% of revenue / R$50M), international data transfers from Brazil, Brazil-EU mutual adequacy (January 2026 — SCCs/BCRs no longer needed for Brazil-EU transfers), LGPD gap assessments, privacy policy drafting for Brazilian operations, DPIA under LGPD, consent management, or comparing LGPD with GDPR. Trigger for any Brazil privacy or data protection question even if LGPD is not named explicitly.
The English summary is being prepared. Showing the original description.
Sushegaad/Claude-Skills-Governance-Risk-and-Compliance☆ 965Updated Oct 10, 2026
Expert LGPD compliance advisor for Brazil's Lei Geral de Proteção de Dados (Law 13,709/2018). Use this skill whenever a user asks about LGPD, Brazilian data protection, ANPD, personal data processing in Brazil, data subject rights under Brazilian law, legal bases for processing, sensitive data handling, DPO appointment in Brazil, data breach notification to ANPD, LGPD penalties (fines up to 2% of revenue / R$50M), international data transfers from Brazil, Brazil-EU mutual adequacy (January 2026 — SCCs/BCRs no longer needed for Brazil-EU transfers), LGPD gap assessments, privacy policy drafting for Brazilian operations, DPIA under LGPD, consent management, or comparing LGPD with GDPR. Trigger for any Brazil privacy or data protection question even if LGPD is not named explicitly.
The English summary is being prepared. Showing the original description.
lawve-ai/awesome-legal-skills☆ 874Updated Oct 3, 2026
EU Data Act (Regulation (EU) 2023/2854) skill for lawyers. Use when the user asks about Data Act classification, drafting, lookup, analysis, or audit. Triggers include "Data Act", "Regulation 2023/2854", "connected product", "related service", "data processing service", "DPS switching", "Article 3(2) pre-contract", "Article 25 contract", "trade-secret handbrake", "international government access", "Chapter VI cloud switching", "Article 50 timeline", "FAQ Q22a", "data holder", "exportable data", "functional equivalence", "Art. 4(10) competing product", and similar EU Data Act phrases. The skill produces lawyer-style Word output and cites verbatim from bundled regulation and FAQ source texts.
The English summary is being prepared. Showing the original description.
lawve-ai/awesome-legal-skills☆ 874Updated Oct 3, 2026
Implements compliance with the UAE Federal Decree-Law No. 45 of 2021 on the Protection of Personal Data (UAE PDP Law) and its Executive Regulations. Covers data controller and processor obligations, data subject rights, cross-border transfer requirements, sensitive data processing, and UAE Data Office enforcement. Keywords: UAE PDP, Federal Decree-Law 45, UAE Data Office, DIFC, ADGM, cross-border transfer.
The English summary is being prepared. Showing the original description.
mukul975/Privacy-Data-Protection-Skills☆ 313Updated Mar 17, 2026
Identifies and classifies GDPR Art. 9 special category data including racial origin, political opinions, religious beliefs, trade union membership, genetic, biometric, health, and sexual orientation data. Covers processing conditions under Art. 9(2)(a)-(j). Keywords: special category, Art 9, sensitive data, biometric, genetic, health data, explicit consent.
The English summary is being prepared. Showing the original description.
mukul975/Privacy-Data-Protection-Skills☆ 313Updated Mar 17, 2026
Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Find bottlenecks in large data transfers, imports, transformations, and historical data catch-up. Benchmark alternative processing methods, turn the fastest correct approach into a repeatable workflow, and verify file counts, row counts, and timestamps after execution.
- Speeding up large data imports and exports
- Reducing the time needed to load historical data
- Comparing batch sizes and worker counts
affaan-m/ECC☆ 284.2KUpdated Oct 20, 2026
Apply consistent architecture and coding conventions when building cross-platform apps with Avalonia UI and Zafiro. The skill guides separation of interface and logic, reactive data handling, explicit error results, and reuse of existing helpers.
- Standardizing Avalonia UI and Zafiro implementation
- Keeping ViewModels independent of Avalonia
- Reviewing error handling with Result types
davila7/claude-code-templates☆ 32.8KUpdated Oct 20, 2026
Guides the design of data pipelines, continuous stream processing, and data quality checks. It compares tools such as Airflow, Dagster, and Flink, and provides implementation patterns and checklists for scheduling, retries, validation, and monitoring.
- Compare tools for data pipeline scheduling
- Design continuous data processing
- Define checks for missing, duplicate, or stale data
fengshao1227/ccg-workflow☆ 5.9KUpdated Oct 19, 2026
Use this skill when conditioning, loading, preparing, or labeling signal data for analysis or ML training. Covers: cleaning a single signal (fill gaps, remove drift, deoutlier, denoise, resample/align a time base) BEFORE analysis; building a `signalDatastore` pipeline; creating a `labeledSignalSet` for Signal Labeler; deriving labels (filename, folder, in-file, ROI, time-frequency ROI); stratified train/val/test splits; framing long signals; parallel processing; and shaping datastore output for `trainnet`. Triggers include "clean up this signal", "remove drift / detrend", "fill gaps", "remove spikes / outliers", "denoise", "resample to a uniform rate", "align channels", "labels from filenames", "stratified split", "prepare for Signal Labeler", and function names like `fillgaps`, `fillmissing`, `detrend`, `filloutliers`, `smoothdata`, `resample`, `synchronize`, `signalDatastore`, `labeledSignalSet`, `filenames2labels`, `folders2labels`, `splitlabels`, `framesig`, `framelbl`, `createDatastores`.
The English summary is being prepared. Showing the original description.
matlab/matlab-agentic-toolkit☆ 1.2KUpdated Oct 14, 2026
Implement the NIST Privacy Framework CONTROL function covering CT.DM data management, CT.DP data processing policies and procedures, and CT.PO disassociated processing. Provides technical control architectures, data management workflows, and de-identification implementation guidance.
The English summary is being prepared. Showing the original description.
mukul975/Privacy-Data-Protection-Skills☆ 313Updated Mar 17, 2026
Handles GDPR Article 18 right to restriction of processing requests, covering the four grounds for restriction (accuracy contest, unlawful processing, erasure opposition, legitimate interest pending), technical flagging mechanisms, and lifting procedures. Activate for restriction request, Art. 18, processing freeze queries.
The English summary is being prepared. Showing the original description.
mukul975/Privacy-Data-Protection-Skills☆ 313Updated Mar 17, 2026
Nigeria Data Protection Regulation (NDPR) and Nigeria Data Protection Act (NDPA) 2023 compliance. Covers lawful basis for processing, data subject rights, cross-border transfer mechanisms, Data Protection Compliance Organisation (DPCO) registration, mandatory DPIA filing, and breach notification. Keywords: NDPR, NDPA, Nigeria, NITDA, DPCO, Africa data protection, cross-border transfer.
The English summary is being prepared. Showing the original description.
mukul975/Privacy-Data-Protection-Skills☆ 313Updated Mar 17, 2026
Extract structured data from any document format using unified document processing. Use when a user asks to extract data from a document, parse a PDF, pull structured data from files, convert documents to JSON or CSV, extract fields from invoices or forms, or scrape data from documents.
The English summary is being prepared. Showing the original description.
TerminalSkills/skills☆ 172Updated Oct 14, 2026
Reads a project or processing description and returns a DRAFT data protection impact assessment pack: processing description, necessity and proportionality questions, a risk table with blank rating cells, mitigations to consider and open questions. Never rates risk, determines the lawful basis or judges adequacy; the DPO assesses and signs. Works from descriptions, never personal data. Use when the user asks to "start a DPIA for the new monitoring tool", "draft a data protection impact assessment", "scaffold a DPIA from this processing description" or "what would the DPO need for a DPIA on this". Do not use for redacting or de-identifying a document, use document-deidentification-pass instead; do not use for working out what data an incident exposed, use data-incident-impact-brief instead. Drafts for human review; never approves, authorises or signs off.
The English summary is being prepared. Showing the original description.
kesslernity/awesome-copilot-agent-skills☆ 9Updated Sep 19, 2026
Fast in-memory DataFrame library for datasets that fit in RAM. Use when pandas is too slow but data still fits in memory. Lazy evaluation, parallel execution, Apache Arrow backend. Best for 1-100GB datasets, ETL pipelines, faster pandas replacement. For larger-than-RAM data use dask or vaex.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Build or review Java services with Quarkus 3.x using patterns for REST APIs, database access with Panache, and messaging with Apache Camel. Examples cover layered code structure, validation, transactions, and asynchronous processing, where work completes separately from the main flow.
- Designing a REST API with separate service and repository layers
- Connecting services through Camel and RabbitMQ
- Reviewing Panache database access and transactions
affaan-m/ECC☆ 284.2KUpdated Oct 20, 2026
Build or review server-side APIs in Node.js, Express, and Next.js. Apply patterns for organizing business logic and data access, reducing unnecessary database queries, caching results, validating requests, and handling authentication and errors.
- Designing APIs and separating business logic from data access
- Reducing repeated database queries
- Adding caching and background processing
affaan-m/ECC☆ 284.2KUpdated Oct 20, 2026
Analyze CSV, Parquet, and JSON files to answer questions through grouping, joins, cleaning, time series, and charts. Chooses DuckDB or Polars and a suitable processing location based on the task and available memory.
- Summarizing and joining data files
- Exploring trends and distributions
- Cleaning data before analysis
code-yeongyu/oh-my-openagent☆ 70.2KUpdated Oct 20, 2026