跳到正文
cccskills
免费在 GitHub 公开

schema-projections

Add projections to collections to rename fields or map nested JSON paths to flat column names. Use when renaming fields for destination conventions, flattening nested paths to columns, or creating field aliases. Use when user says "rename field", "flatten nested JSON", "map JSON path to column", "field alias", or "projection".

中文简介正在准备中。当前显示原文说明。

查看安装方法

包含的文件(1)

  • SKILL.md2.8 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Projections

Add projections to collections to rename fields or map nested JSON paths to flat column names.

Docs: https://docs.estuary.dev/concepts/advanced/projections/

When to Use

  • Rename fields to match destination naming conventions
  • Flatten nested JSON paths to column names (e.g., /user/name → user_name)
  • Extract array elements as named fields

Procedure

Step 1: Pull the Collection Spec

flowctl catalog pull-specs --name <collection-name>

Step 2: Add Projections

Add a projections stanza to the collection spec (top-level, alongside key and schema):

collections:
  tenant/your/collection:
    schema: schema.yaml
    key: [/id]
    projections:
      # Rename a top-level field
      user_id: /id

      # Flatten nested paths
      customer_name: /customer/name
      customer_email: /customer/email

      # Extract array elements
      primary_tag: /tags/0

Values are JSON Pointers: / separated, array indices numeric (/tags/0).

Fields from your schema already show up as columns in materializations automatically. You only need projections when you want to rename a field or expose a nested path as a different column name.

Step 3: Publish Changes

flowctl catalog publish --source flow.yaml

New field names become available in materialization field selection. Add them to fields.require in the materialization binding to include them.

Notes

  • Projections are also used for logical partitions (partition: true) — see docs for that use case
  • If the underlying field is pruned by the complexity limit, the projection survives but its type may widen (e.g., to JSON) — define the field in the readSchema to pin the type

Troubleshooting

Projection Not Appearing in Materialization

  • Ensure JSON pointer path exists in the schema
  • Add projected field to fields.require in materialization binding
  • Projections are defined on the collection, not the materialization

Invalid JSON Pointer

  • Uses / not . for path separation
  • Array indices are numeric: /tags/0 not /tags[0]
  • Escape ~ as ~0 and / as ~1 in field names

Related Skills

  • schema-field-selection — Choose which projected fields to materialize
  • schema-custom-types-ddl — Customize column types for projected fields
  • schema-field-redaction — Hash or block fields at capture time

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Create an Alpaca capture using flowctl to stream stock trade data into Estuary collections. Use when setting up an Alpaca Market Data source for historical and real-time stock trades. Use when user says "capture Alpaca", "stream stock trades", "Alpaca market data", or "connect Alpaca to Estuary".

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

Create a capture for ANY Estuary connector using dynamic schema discovery. Use when the user wants to capture from a source that doesn't have a dedicated skill (e.g., Kafka, Salesforce, HubSpot, Stripe, S3, GCS, Kinesis, or any of the 148+ connectors). Use when user says "capture from <source>", "stream from <source>", "connect <source> to Estuary", or "set up <source> capture" and no connector-specific skill exists.

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

Create an HTTP Ingest (webhook) capture to receive data via HTTP POST requests. Use when setting up webhooks from GitHub, Shopify, Stripe, or any JSON source. Use when user says "set up webhook capture", "HTTP ingest to Estuary", "receive POST requests to Estuary", or "webhook capture".

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

Create a HubSpot Real-Time capture using flowctl to stream CRM data into Estuary collections. Use when setting up a HubSpot source for contacts, companies, deals, tickets, or other HubSpot resources. Use when user says "capture HubSpot", "stream from HubSpot", "HubSpot CDC", or "connect HubSpot to Estuary".

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

Create a MongoDB CDC capture using flowctl. Use when setting up real-time streaming from MongoDB Atlas, DocumentDB, or self-hosted MongoDB. Use when user says "capture MongoDB", "stream from Mongo", "MongoDB CDC", or "connect MongoDB to Estuary".

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

Create a MySQL CDC capture using flowctl with binlog replication. Use when setting up streaming from MySQL, Amazon RDS MySQL, or Aurora MySQL. Use when user says "capture MySQL", "stream from MySQL", "MySQL CDC", "binlog replication", or "connect MySQL to Estuary".

中文简介正在准备中。当前显示原文说明。

estuary/agent-skills72026年9月25日 更新

查看 estuary 的全部技能

报告此技能的问题