Add projections to collections to rename fields or map nested JSON paths to flat column names. Use when renaming fields for destination conventions, flattening nested paths to columns, or creating field aliases. Use when user says "rename field", "flatten nested JSON", "map JSON path to column", "field alias", or "projection".
The English summary is being prepared. Showing the original description.
See how to installReview the instructions the agent will receive before you install.
Add projections to collections to rename fields or map nested JSON paths to flat column names.
Docs: https://docs.estuary.dev/concepts/advanced/projections/
/user/name → user_name)flowctl catalog pull-specs --name <collection-name>
Add a projections stanza to the collection spec (top-level, alongside key and schema):
collections:
tenant/your/collection:
schema: schema.yaml
key: [/id]
projections:
# Rename a top-level field
user_id: /id
# Flatten nested paths
customer_name: /customer/name
customer_email: /customer/email
# Extract array elements
primary_tag: /tags/0
Values are JSON Pointers: / separated, array indices numeric (/tags/0).
Fields from your schema already show up as columns in materializations automatically. You only need projections when you want to rename a field or expose a nested path as a different column name.
flowctl catalog publish --source flow.yaml
New field names become available in materialization field selection. Add them to fields.require in the materialization binding to include them.
partition: true) — see docs for that use casefields.require in materialization binding/ not . for path separation/tags/0 not /tags[0]~ as ~0 and / as ~1 in field namesschema-field-selection — Choose which projected fields to materializeschema-custom-types-ddl — Customize column types for projected fieldsschema-field-redaction — Hash or block fields at capture timeNo reviews yet. Tell others what you thought.
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
Create an Alpaca capture using flowctl to stream stock trade data into Estuary collections. Use when setting up an Alpaca Market Data source for historical and real-time stock trades. Use when user says "capture Alpaca", "stream stock trades", "Alpaca market data", or "connect Alpaca to Estuary".
The English summary is being prepared. Showing the original description.
Create a capture for ANY Estuary connector using dynamic schema discovery. Use when the user wants to capture from a source that doesn't have a dedicated skill (e.g., Kafka, Salesforce, HubSpot, Stripe, S3, GCS, Kinesis, or any of the 148+ connectors). Use when user says "capture from <source>", "stream from <source>", "connect <source> to Estuary", or "set up <source> capture" and no connector-specific skill exists.
The English summary is being prepared. Showing the original description.
Create an HTTP Ingest (webhook) capture to receive data via HTTP POST requests. Use when setting up webhooks from GitHub, Shopify, Stripe, or any JSON source. Use when user says "set up webhook capture", "HTTP ingest to Estuary", "receive POST requests to Estuary", or "webhook capture".
The English summary is being prepared. Showing the original description.
Create a HubSpot Real-Time capture using flowctl to stream CRM data into Estuary collections. Use when setting up a HubSpot source for contacts, companies, deals, tickets, or other HubSpot resources. Use when user says "capture HubSpot", "stream from HubSpot", "HubSpot CDC", or "connect HubSpot to Estuary".
The English summary is being prepared. Showing the original description.
Create a MongoDB CDC capture using flowctl. Use when setting up real-time streaming from MongoDB Atlas, DocumentDB, or self-hosted MongoDB. Use when user says "capture MongoDB", "stream from Mongo", "MongoDB CDC", or "connect MongoDB to Estuary".
The English summary is being prepared. Showing the original description.
Create a MySQL CDC capture using flowctl with binlog replication. Use when setting up streaming from MySQL, Amazon RDS MySQL, or Aurora MySQL. Use when user says "capture MySQL", "stream from MySQL", "MySQL CDC", "binlog replication", or "connect MySQL to Estuary".
The English summary is being prepared. Showing the original description.