Configure and troubleshoot Apache Beam runners, the engines that execute data processing pipelines. Covers local testing, Dataflow, Flink, and Spark, with Java and Python examples, runner validation tests, and guidance on logs and execution settings.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Test a Beam pipeline locally
- Configure pipeline execution on Dataflow
- Review Flink or Spark execution settings
apache/beam☆ 8.7천2026년 10월 19일 업데이트
Develop and troubleshoot Apache Beam's YAML SDK. Understand its source files, run data processing pipelines locally or on Dataflow, test changes, and investigate provider issues or mismatched record fields.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Find source files for Beam YAML changes
- Run a YAML pipeline locally or on Dataflow
- Run unit tests and external service integration tests
apache/beam☆ 8.7천2026년 10월 19일 업데이트
Vulnerability audit and dataflow analysis built on the neug CPG engine. file_audit (default, recommended): first builds a function-level summary graph (tier1) over the entire project, then incrementally builds detailed CPGs (tier2) on demand for chosen functions; both tiers coexist in a single neug database (unified schema, cross-layer refines edges; C/Java/Python/Rust). All capabilities are exposed as CLI tool subcommands (audit/overview/build/query/methods/paths), so an agent can drive the audit step by step via shell; the audit subcommand can also run the built-in LLM loop. The same tooling also supports a dataflow analysis mode (Workflow C): no vulnerability hunting, only variable-level dataflow tracing for functions of interest, producing dataflow_analysis.json. repo_audit: multi-round LLM/Cypher audit over a full-repo CPG. Use when the user asks to audit a codebase/project for vulnerabilities, scan a project with CPG/neug, run repo_audit/file_audit, find source-to-sink taint paths, or analyze dataflow inside a function. Supports C, Java, Python, and Rust.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
alibaba/neug☆ 1702026년 10월 19일 업데이트
Develop and verify changes to Apache Beam's Python SDK. Set up a virtual environment, run tests, build installable packages or containers, and run data processing pipelines with the modified SDK.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Set up an Apache Beam Python SDK development environment
- Run unit and integration tests for SDK changes
- Build SDK packages and container images
apache/beam☆ 8.7천2026년 10월 19일 업데이트
Systematic methodology for achieving 100% backward dataflow reachability in a new language. Create gauntlet fixture, write trace, diagnose gaps, fix analyzer/algorithm, iterate to 100%. Language-agnostic process. Use when: (1) adding a new language to Grafema, (2) auditing dataflow coverage for existing language, (3) user says "/dataflow-gauntlet".
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Disentinel/grafema☆ 352026년 8월 24일 업데이트
Use when creating or managing CRM Analytics datasets: configuring dataflows, scheduling refreshes, selecting fields, handling date types, managing row-count growth, or troubleshooting stale or broken datasets. Triggers: 'dataset creation', 'dataflow schedule', 'dataflow quota', 'date field not filterable', 'dataset row limit', 'CRM Analytics data refresh', 'field type mismatch in dataset'. NOT for making an existing dataset smaller or faster — use data/analytics-dataset-optimization. NOT for choosing between Reports, CRM Analytics and Tableau in the first place — use admin/einstein-analytics-basics.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
PranavNagrecha/AwesomeSalesforceSkills☆ 192026년 10월 4일 업데이트
Manages Fabric Dataflow Gen2 items, including creation, M editing, connections, output destinations, getDefinition and updateDefinition inspection, executeQuery, refresh history, and Gen1-to-Gen2 save-as upgrades via saveAsNativeArtifact. Use for Dataflow items or Power Query M definitions. For pipeline JSON use pipeline-migration; for Spark or Warehouse transformations use their own skills.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/skills-for-fabric☆ 1.3천2026년 10월 5일 업데이트
Use this skill when building, debugging, or optimizing CRM Analytics dataflows — defining node types (sfdcDigest, Append, Augment, computeExpression, computeRelative, Flatten, dim2mea, sfdcRegister), scheduling runs, handling run failures, and tuning performance. NOT for doing the same transformation in a Data Prep recipe — use admin/analytics-recipe-design. NOT for dataset field types, refresh schedules, or row limits — use admin/analytics-dataset-management.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
PranavNagrecha/AwesomeSalesforceSkills☆ 192026년 10월 4일 업데이트
Guides Java SDK development in Apache Beam, from finding relevant modules to building code, running focused tests, and trying examples. Also explains how to publish modified modules locally and build SDK containers.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Finding the Java SDK module to modify
- Running a specific test class or method
- Checking setup with the WordCount example
apache/beam☆ 8.7천2026년 10월 19일 업데이트
Route DataFlow workflows for pipelines, text and document processing, serving, evaluation, and Ray acceleration.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
VectorSpaceLab/AREX-Skill☆ 3382026년 9월 3일 업데이트
Use this skill when configuring Data Manager in CRM Analytics: enabling objects for sync, scheduling data sync runs, setting up remote connections to external databases, monitoring sync status and error logs, or troubleshooting connected object issues. Trigger keywords: data sync, connected objects, Data Manager, sync schedule, remote connection, Snowflake connector, sync error, incremental sync, CRM Analytics data pipeline. NOT for pushing external data in programmatically via the External Data API — use data/analytics-external-data. NOT for authoring dataflow nodes — use admin/analytics-dataflow-development.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
PranavNagrecha/AwesomeSalesforceSkills☆ 192026년 10월 4일 업데이트
Use this skill when designing or building CRM Analytics Data Prep recipes — including node selection, join patterns, bucket field configuration, formula expressions, and scheduling. Triggers: 'build a recipe', 'join datasets in analytics', 'bucket a measure field', 'schedule a recipe', 'data prep transformation'. NOT for dataflow JSON and its node types — use admin/analytics-dataflow-development. NOT for tuning a slow or oversized dataset — use data/analytics-dataset-optimization.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
PranavNagrecha/AwesomeSalesforceSkills☆ 192026년 10월 4일 업데이트
Authors reproducible Nextflow DSL2 pipelines built on reactive dataflow, where processes communicate only through channels and execution order is not guaranteed. Use when deciding channel/dataflow (Nextflow) vs rule-based (Snakemake) authoring; wiring queue vs value channels and fixing shared-reference exhaustion with .first(); composing DSL2 modules and subworkflows with take/main/emit; selecting container/conda profiles and pinning images by digest for portability across local/SLURM/LSF/AWS Batch/Google Batch/Kubernetes executors; diagnosing why -resume misses the cache (nondeterministic input order, mtime on network filesystems, mutable :latest tags) with cache 'lenient' and -dump-hashes; managing work/ vs publishDir and dynamic retry escalation; and choosing whether to adopt an nf-core community pipeline or author from scratch.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
huang-sh/DeepScience☆ 42026년 7월 15일 업데이트
Guides adding metadata, extra information attached to data elements, to Apache Beam's WindowedValue. Maps the changes needed across serialization, storage, processing, and runner interfaces so new fields remain available during pipeline execution.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Adding trace context or drain flags to WindowedValue
- Checking metadata preservation through Windmill storage
- Reviewing propagation through grouping and timers
apache/beam☆ 8.7천2026년 10월 19일 업데이트
Scans code for security vulnerabilities with CodeQL by tracing data across functions. Builds and checks analysis databases, models project-specific APIs, and saves findings in SARIF, a structured results format, with broad or focused scan options.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Scanning a codebase for security vulnerabilities
- Tracing untrusted input through custom APIs
- Choosing broad or high-precision security scans
trailofbits/skills☆ 7.6천2026년 10월 16일 업데이트
Manages Fabric Variable Library items, including definitions, libraryVariables and valueSets overrides. Covers which consumers can reference a variable and with what syntax -- pipelines, notebooks via notebookutils variableLibrary, Dataflow Gen2, Copy Jobs, shortcuts, UDFs and Plan items -- the active value set per workspace or deployment stage, and Git serialization for CI/CD.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/skills-for-fabric☆ 1.3천2026년 10월 5일 업데이트
Finds Fabric items across every workspace with the Catalog Search API when the workspace is unknown, locating an item by display name, inventorying one item type tenant-wide, and returning the workspace and item IDs later calls need. Dataflow Gen1 and Gen2 items are not supported. Use only to locate items; once found, query them with the owning item skill such as sqldw-cli, spark-cli, eventhouse-cli or fabriciq.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/skills-for-fabric☆ 1.3천2026년 10월 5일 업데이트
Use when a UE5 task involves Niagara or Chaos destruction: a Niagara fireball, projectile trail, impact explosion, muzzle flash, spell, smoke, sparks, debris, Niagara fluids or flipbooks; "Niagara is too expensive", stat NiagaraOverview, Effect Types, pooling, Data Channels, lightweight emitters, VFX scalability; judging an effect's readability, value, color, timing, white blowout or strobing; or a wall that shatters, geometry collection fracture, Dataflow, damage thresholds, floating chunks, debris cost, Chaos Visual Debugger.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
scenario-labs/skills☆ 1.1천2026년 10월 19일 업데이트
Python-based workflow manager for reproducible, scalable pipelines. Define rules with file-based dependencies; Snakemake resolves execution order and parallelism. Runs local, SLURM, LSF, AWS, GCP via profiles; per-rule conda/Singularity envs. For NGS pipelines, ML training, and multi-step file processing. Use Nextflow for Groovy dataflow or nf-core integration.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
jaechang-hits/SciAgent-Skills☆ 3812026년 10월 16일 업데이트
Dataflow workflow engine for scalable bioinformatics pipelines. Defines processes (containerized tasks) connected by channels; runs local, HPC (SLURM/SGE), cloud (AWS/GCP/Azure), or Kubernetes via a single config change. Powers nf-core. Use Snakemake for rule-based Python workflows; use Nextflow for containerized, cloud-native, and nf-core pipelines.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
jaechang-hits/SciAgent-Skills☆ 3812026년 10월 16일 업데이트
Use DreamerV3 for world-model reinforcement learning training, embodied environment dataflow, JAX model internals, result operations, and troubleshooting.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
VectorSpaceLab/AREX-Skill☆ 3382026년 9월 3일 업데이트
Think and work like an expert Computer Architecture Researcher. Use when a task calls for Computer Architecture Researcher judgment. Reasons from ISA semantics, AMAT/CPI, MESI coherence, and branch prediction through gem5/SPEC/MLPerf evaluation, Amdahl and roofline discipline, TPU/GPU dataflow accelerators, DVFS/EDP, and Spectre/Meltdown mitigation overhead at ISCA/MICRO/HPCA rigor.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
K-Dense-AI/scientific-agents☆ 2172026년 10월 3일 업데이트
Use when EZ_math_model runs in multi or hybrid mode and has two or more independent subtasks that can be assigned to subagents without shared files, shared state, or dataflow dependencies.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
woodfishhhh/EZ_math_model☆ 432026년 7월 28일 업데이트
Use when deciding whether Salesforce Reports, CRM Analytics, or Tableau is the right level of analytics tooling, and when reviewing or troubleshooting basic CRM Analytics designs. Triggers: 'CRM Analytics', 'Einstein Analytics', 'Tableau CRM', 'lens', 'dataset', 'dataflow', 'analytics dashboard', 'license requirement'. NOT for a detailed CRM Analytics vs Tableau licensing and platform comparison — use architect/crm-analytics-vs-tableau-decision. NOT for building the app, lenses and datasets — use admin/crm-analytics-app-creation.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
PranavNagrecha/AwesomeSalesforceSkills☆ 192026년 10월 4일 업데이트