Skip to content
cccskills
FreePublished on GitHub

write-pipeline

Design or revise Marin experiment pipelines by connecting reusable tasks and their outputs in a dependency graph. Organize shared implementations separately from experiment settings, then check that the workflow connects the intended inputs and stages.

OriginalShow the original description

Design or revise a Marin experiment pipeline that binds reusable work into an artifact graph. Use for new workflow entrypoints, stage wiring, and pipeline placement decisions; use a narrower domain skill when it owns the launch.

See how to install

Good for

  • Creating an experiment workflow entrypoint
  • Connecting pipeline stages and outputs
  • Separating reusable code from experiment settings
  • Checking dependencies before running an experiment

Files included (3)

  • SKILL.md2.1 KB
  • references/artifact-binding.md2.0 KB
  • references/layout.md2.0 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Write a Marin pipeline

Keep the boundary between work and workflow explicit:

  • lib/** owns concrete implementations intended for reuse: functions, configurations, and produced data types. New library code must not compose a pipeline, construct an ArtifactStep or StepSpec, or reference a particular artifact handle, name, version, or output. The execution framework's Artifact and ArtifactStep definitions are infrastructure, not a model for new library workflow builders.
  • experiments/** owns artifact graph construction and one-off binding code: choosing inputs, names, versions, dependencies, resources, and which reusable functions to run. Keep a transformation here only when it is specific to that experiment. Move work intended for reuse into a concrete lib/** implementation, then bind it in experiments/**.
  • Put experiment-specific tests beside their experiment, including tests of its graph and one-off transformations; do not put them in root tests/** or lib/**. Keep tests of reusable library behavior in the library's normal test location. Follow root TESTING.md and the relevant module instructions.

Inspect nearby current pipelines before editing. Read layout and examples for placement decisions and artifact binding when working with ArtifactStep, apply, paths, or caching. Existing library builders that return steps are exceptions, not precedent for adding more pipeline composition to lib/**.

For a change, verify that the experiment builds the intended dependencies and that reusable work can run without importing experiments/**. Dry-run the graph where the entrypoint supports it; run focused behavior tests without submitting a live job unless requested. Update user-facing docs when the workflow or API changes. Use the commit skill if asked to publish the result.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

ab-test-zephyr

FreeSummary

Compare Zephyr changes using the same prepared dataset and matching execution settings. Analyze Finelog metrics for each processing stage to distinguish CPU efficiency, elapsed time, and peak memory changes, then report improvements, regressions, or tradeoffs.

  • Compare Zephyr performance before and after a PR
  • Assess speed gains against additional CPU usage
  • Check peak memory and out-of-memory regressions
marin-community/marin4KUpdated Oct 22, 2026

add-dataset

FreeSummary

Register Hugging Face datasets for Marin by inspecting their structure without downloading the full dataset. Identify text fields, configurations, and data splits, then add a dataset module and validate the mapping with a sample.

  • Registering a Hugging Face dataset for Marin
  • Inspecting text fields without a full dataset download
  • Checking configurations and data splits
marin-community/marin4KUpdated Oct 22, 2026

add-grant

FreeSummary

Turn a specified GCP access request into a reviewable Pulumi change and pull request. Select the narrowest suitable role and encrypt personal email identities, covering resource permissions and Cloud Run viewer access through IAP, an access gateway.

  • Prepare a request for GCS bucket read access
  • Add a viewer to a Cloud Run service protected by IAP
  • Prepare service account impersonation permissions
marin-community/marin4KUpdated Oct 22, 2026

Add or update Pallas/Mosaic kernels, specialized computation routines for JAX. The skill covers reference implementations, output and gradient checks, public wrappers, fallback behavior, performance benchmarks, and hardware-specific tuning when requested.

  • Adding a Pallas kernel for a JAX computation
  • Checking outputs and gradients against a reference
  • Maintaining backend selection and fallback behavior
marin-community/marin4KUpdated Oct 22, 2026

Preserve old experiment scripts with a dated Git tag, a named snapshot of the code, and add comments linking related GitHub issues to the archived files and cleanup pull request.

  • Preserving a snapshot of old experiment scripts
  • Linking experiment issues to archived files
  • Updating archive notices after a tag changes
marin-community/marin4KUpdated Oct 22, 2026

babysit-zephyr

FreeSummary

Launch and continuously monitor a specified Zephyr pipeline on Iris when asked. It checks coordinator and worker health, tracks stage progress, identifies stalled or repeated failures, and requires explicit approval before stopping or restarting jobs.

  • Launch a specified Zephyr pipeline and check startup
  • Monitor stage progress and worker health over time
  • Investigate stalled stages or repeated worker failures
marin-community/marin4KUpdated Oct 22, 2026

See all skills by marin-community

Report a problem with this skill