Skip to content
cccskills
FreePublished on GitHub

use-fsutil

Manage files in GCS, CoreWeave S3, R2, and local storage through Marin's fsutil command-line tool. List, inspect, copy, move, or synchronize data using bucket connections defined in the checkout's configuration.

OriginalShow the original description

Use Marin's fsutil CLI for local object-storage operations across GCS, CoreWeave S3, R2, and local paths. Use whenever a task needs to list, inspect, read, size, find, copy, move, synchronize, hash, browse, or remove data at gs:// or s3:// URLs from a checkout. Do not launch an Iris job solely to access object storage.

Works withAWS
See how to install

Good for

  • Listing and reading files in cloud storage
  • Copying or synchronizing cloud and local data
  • Finding files and checking sizes or hashes
  • Using configured bucket connections in Python

Files included (2)

  • SKILL.md968 B
  • agents/openai.yaml216 B

SKILL.md (original)

Review the instructions the agent will receive before you install.

Use fsutil

Use uv run fsutil from the Marin checkout for operations on gs:// and s3:// paths. It routes each declared bucket to the backend and endpoint in config/*.yaml.

Read docs/references/fsutil.md for commands, behavior, and safety constraints. Let the task determine which command and verification are appropriate.

Use this interface before provider-specific CLIs, hand-built S3 endpoints, custom transfer scripts, or Iris jobs. Do not launch Iris solely to access object storage. For Python code that needs the same bucket routing, use rigging.filesystem.buckets.filesystem_for(url).

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

ab-test-zephyr

FreeSummary

Compare Zephyr changes using the same prepared dataset and matching execution settings. Analyze Finelog metrics for each processing stage to distinguish CPU efficiency, elapsed time, and peak memory changes, then report improvements, regressions, or tradeoffs.

  • Compare Zephyr performance before and after a PR
  • Assess speed gains against additional CPU usage
  • Check peak memory and out-of-memory regressions
marin-community/marin4KUpdated Oct 22, 2026

add-dataset

FreeSummary

Register Hugging Face datasets for Marin by inspecting their structure without downloading the full dataset. Identify text fields, configurations, and data splits, then add a dataset module and validate the mapping with a sample.

  • Registering a Hugging Face dataset for Marin
  • Inspecting text fields without a full dataset download
  • Checking configurations and data splits
marin-community/marin4KUpdated Oct 22, 2026

add-grant

FreeSummary

Turn a specified GCP access request into a reviewable Pulumi change and pull request. Select the narrowest suitable role and encrypt personal email identities, covering resource permissions and Cloud Run viewer access through IAP, an access gateway.

  • Prepare a request for GCS bucket read access
  • Add a viewer to a Cloud Run service protected by IAP
  • Prepare service account impersonation permissions
marin-community/marin4KUpdated Oct 22, 2026

Add or update Pallas/Mosaic kernels, specialized computation routines for JAX. The skill covers reference implementations, output and gradient checks, public wrappers, fallback behavior, performance benchmarks, and hardware-specific tuning when requested.

  • Adding a Pallas kernel for a JAX computation
  • Checking outputs and gradients against a reference
  • Maintaining backend selection and fallback behavior
marin-community/marin4KUpdated Oct 22, 2026

Preserve old experiment scripts with a dated Git tag, a named snapshot of the code, and add comments linking related GitHub issues to the archived files and cleanup pull request.

  • Preserving a snapshot of old experiment scripts
  • Linking experiment issues to archived files
  • Updating archive notices after a tag changes
marin-community/marin4KUpdated Oct 22, 2026

babysit-zephyr

FreeSummary

Launch and continuously monitor a specified Zephyr pipeline on Iris when asked. It checks coordinator and worker health, tracks stage progress, identifies stalled or repeated failures, and requires explicit approval before stopping or restarting jobs.

  • Launch a specified Zephyr pipeline and check startup
  • Monitor stage progress and worker health over time
  • Investigate stalled stages or repeated worker failures
marin-community/marin4KUpdated Oct 22, 2026

See all skills by marin-community

Report a problem with this skill