Skip to content
cccskills
FreePublished on GitHub

azure-stream-analytics

Expert knowledge for Azure Stream Analytics development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building ASA jobs with Event Hubs/Kafka, Cosmos/SQL outputs, autoscale, VNets/private endpoints, or edge/IoT workloads, and other Azure Stream Analytics related development tasks. Not for Azure Data Explorer (use azure-data-explorer), Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azure Event Hubs (use azure-event-hubs).

The English summary is being prepared. Showing the original description.

See how to install

Files included (1)

  • SKILL.md20.6 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Azure Stream Analytics Skill

This skill provides expert guidance for Azure Stream Analytics. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLinesDescription
TroubleshootingL37-L58Diagnosing and fixing Stream Analytics job errors (config, data, internal/external), performance issues, and input/output/query problems using logs and job diagrams (logical/physical).
Best PracticesL59-L73Best practices for Stream Analytics job design, query patterns, performance tuning, scaling, reliability, time handling, geospatial logic, ML/Cosmos/SQL outputs, and alerting.
Decision MakingL74-L82Guidance on choosing Stream Analytics tools and services, migrating from Visual Studio/.NET UDFs, and configuring autoscale and real-time processing options.
Architecture & Design PatternsL83-L88Designing resilient, geo-redundant Stream Analytics topologies and scaling jobs using Streaming Units, input/output partitioning, and performance tuning patterns.
Limits & QuotasL89-L96Limits, sizing, and performance of Stream Analytics: Event Hubs output size caps, streaming unit/cluster scaling, and IoT Edge-specific limits and support.
SecurityL97-L117Securing Stream Analytics jobs: managed identities for inputs/outputs (Event Hubs, SQL, Synapse, Cosmos, Blob, Service Bus, Power BI), VNet/private endpoints, data protection, and Azure Policy compliance.
ConfigurationL118-L149Configuring Stream Analytics jobs: inputs, outputs (Cosmos DB, SQL, Event Hubs, Kafka, Power BI, Delta Lake, etc.), autoscale, ordering, error handling, monitoring, and compatibility.
Integrations & Coding PatternsL150-L166Patterns and code for integrating Stream Analytics with Kafka, SQL, Azure ML, UDFs (C#/JS), anomaly detection, schema registry, and advanced scenarios like HFT and .NET job management
DeploymentL167-L180Automating deployment, migration, and lifecycle (start/stop/delete) of Stream Analytics jobs and clusters using ARM/Bicep, GitHub Actions, Azure DevOps, REST, and edge/Stack Hub tools

Troubleshooting

TopicURL
Resolve Stream Analytics configuration error codeshttps://learn.microsoft.com/en-us/azure/stream-analytics/configuration-error-codes
Resolve Stream Analytics data error codeshttps://learn.microsoft.com/en-us/azure/stream-analytics/data-error-codes
Resolve data errors in Azure Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/data-errors
Debug Stream Analytics queries locally with Visual Studio job diagramhttps://learn.microsoft.com/en-us/azure/stream-analytics/debug-locally-using-job-diagram
Debug Stream Analytics queries locally with VS Code job diagramhttps://learn.microsoft.com/en-us/azure/stream-analytics/debug-locally-using-job-diagram-vs-code
Debug user-defined functions in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/debug-user-defined-functions
Resolve Stream Analytics external availability error codeshttps://learn.microsoft.com/en-us/azure/stream-analytics/external-availability-error-codes
Resolve Stream Analytics external error codeshttps://learn.microsoft.com/en-us/azure/stream-analytics/external-error-codes
Resolve Stream Analytics internal error codeshttps://learn.microsoft.com/en-us/azure/stream-analytics/internal-error-codes
Use job diagram metrics to troubleshoot Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/job-diagram-with-metrics
Diagnose Azure Stream Analytics job performancehttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-analysis-with-metric-dimensions
Troubleshoot Stream Analytics jobs with resource logshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-diagnostic-logs
Debug Stream Analytics jobs with logical job diagramhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-logical-diagram-with-metrics
Use physical job diagram metrics to debug Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-physical-diagram-with-metrics
Monitor and troubleshoot Azure Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitoring
Diagnose and fix Azure Stream Analytics input issueshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-input
Troubleshoot Azure Stream Analytics output connection problemshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-output
Troubleshoot Azure Stream Analytics query issueshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-query

Best Practices

TopicURL
Develop and debug Azure Stream Analytics jobs locallyhttps://learn.microsoft.com/en-us/azure/stream-analytics/develop-locally
Build geofencing and geospatial aggregation with Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/geospatial-scenarios
Implement input validation patterns for Stream Analytics resiliencyhttps://learn.microsoft.com/en-us/azure/stream-analytics/input-validation
Optimize Stream Analytics query performance with Job Simulationhttps://learn.microsoft.com/en-us/azure/stream-analytics/optimize-query-using-job-diagram-simulator
Optimize non-parallelizable Stream Analytics jobs with repartitioninghttps://learn.microsoft.com/en-us/azure/stream-analytics/repartition
Improve Azure Stream Analytics job reliability and upgradeshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-reliability
Optimize Azure Stream Analytics with query parallelizationhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parallelization
Optimize Azure SQL Database output performance for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-sql-output-perf
Apply common query patterns in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-stream-analytics-query-patterns
Implement configurable threshold-based alerting in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-threshold-based-rules
Design time handling and lateness in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-time-handling

Decision Making

TopicURL
Choose Azure Stream Analytics portal vs VS Code toolshttps://learn.microsoft.com/en-us/azure/stream-analytics/feature-comparison
Migrate Stream Analytics projects from Visual Studio to VS Codehttps://learn.microsoft.com/en-us/azure/stream-analytics/migrate-to-vscode
Choose and configure autoscale for Stream Analytics SUshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-autoscale
Migrate from .NET UDFs to JavaScript in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge-csharp-udf-methods
Choose Azure real-time and stream processing serviceshttps://learn.microsoft.com/en-us/azure/stream-analytics/streaming-technologies

Architecture & Design Patterns

TopicURL
Design geo-redundant Azure Stream Analytics job architectureshttps://learn.microsoft.com/en-us/azure/stream-analytics/geo-redundancy
Scale Azure Stream Analytics jobs with SUs and partitioninghttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-scale-jobs

Limits & Quotas

TopicURL
Use Event Hubs as Stream Analytics output with size limitshttps://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-output
Resize Azure Stream Analytics clusters by streaming unitshttps://learn.microsoft.com/en-us/azure/stream-analytics/scale-cluster
Understand Azure Stream Analytics on IoT Edge limits and supporthttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge
Understand and tune Azure Stream Analytics streaming unitshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-streaming-unit-consumption

Security

TopicURL
Configure managed identity for Azure Data Explorer outputshttps://learn.microsoft.com/en-us/azure/stream-analytics/azure-data-explorer-managed-identity
Configure managed identity auth for Stream Analytics Blob outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/blob-output-managed-identity
Securely connect Stream Analytics jobs to Azure VNetshttps://learn.microsoft.com/en-us/azure/stream-analytics/connect-job-to-vnet
Use managed identities for Cosmos DB outputs in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/cosmos-db-managed-identity
Configure data protection for Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/data-protection
Access Event Hubs from Stream Analytics with managed identitieshttps://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-managed-identity
Apply built-in Azure Policy definitions to Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/policy-reference
Set up managed identity authentication for Stream Analytics Power BI outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/powerbi-output-managed-identity
Configure Stream Analytics cluster managed private endpointshttps://learn.microsoft.com/en-us/azure/stream-analytics/private-endpoints
Secure Azure Stream Analytics jobs in virtual networkshttps://learn.microsoft.com/en-us/azure/stream-analytics/run-job-in-virtual-network
Apply Azure Policy compliance controls to Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/security-controls-policy
Send Stream Analytics outputs to Service Bus with managed identityhttps://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-managed-identity
Use managed identities from Stream Analytics to Azure SQL and Synapsehttps://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-output-managed-identity
Configure Kafka input and security for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-kafka-input
Rotate input and output credentials for Azure Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-login-credentials-inputs-outputs
Use managed identities with Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-managed-identities-overview
Configure user-assigned managed identities for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-user-assigned-managed-identity-overview

Configuration

TopicURL
Configure Azure Cosmos DB as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/azure-cosmos-db-output
Configure Azure Data Explorer as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/azure-database-explorer-output
Connect Azure Stream Analytics outputs to Azure Functionshttps://learn.microsoft.com/en-us/azure/stream-analytics/azure-functions-output
Configure Azure Synapse Analytics dedicated SQL pool as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/azure-synapse-analytics-output
Configure Blob Storage and Data Lake Gen2 outputs for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/blob-storage-azure-data-lake-gen2-output
Configure Stream Analytics autoscale settings via CI/CD toolhttps://learn.microsoft.com/en-us/azure/stream-analytics/cicd-autoscale
Configure event ordering policies in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/event-ordering
Reference for Stream Analytics JobConfig.json fields in VS Codehttps://learn.microsoft.com/en-us/azure/stream-analytics/job-config-json
Configure Kafka output for Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/kafka-output
Configure monitoring for Azure Stream Analytics with Azure Monitorhttps://learn.microsoft.com/en-us/azure/stream-analytics/monitor-azure-stream-analytics
Reference for Azure Stream Analytics monitoring metrics and logshttps://learn.microsoft.com/en-us/azure/stream-analytics/monitor-azure-stream-analytics-reference
Configure Azure Database for PostgreSQL as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/postgresql-database-output
Configure Power BI as an Azure Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/power-bi-output
Configure Service Bus queues as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-queues-output
Configure Service Bus topics as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-topics-output
Configure Azure SQL Database as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-output
Configure Azure SQL Database as Stream Analytics outputhttps://learn.microsoft.com/en-us/azure/stream-analytics/sql-db-table
Configure compatibility levels for Azure Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-compatibility-level
Configure custom blob output partitioning in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-custom-path-patterns-blob-storage-output
Configure input sources for Azure Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs
Configure Azure Cosmos DB output for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-documentdb-output
Monitor and manage Stream Analytics jobs with PowerShellhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitor-and-manage-jobs-use-powershell
Programmatically enable and configure Stream Analytics job monitoringhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitor-jobs
Configure output error handling policies in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-output-error-policy
Configure Protobuf input deserialization in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-protobuf
Set up Azure Monitor alerts for Stream Analytics jobshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-set-up-alerts
Set up Azure Table storage output for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/table-storage-output
Configure Azure Stream Analytics output to Delta Lakehttps://learn.microsoft.com/en-us/azure/stream-analytics/write-to-delta-lake

Integrations & Coding Patterns

TopicURL
Use Confluent Cloud Kafka as Stream Analytics inputhttps://learn.microsoft.com/en-us/azure/stream-analytics/confluent-kafka-input
Send Stream Analytics output to Confluent Cloud Kafkahttps://learn.microsoft.com/en-us/azure/stream-analytics/confluent-kafka-output
Integrate Azure Machine Learning models as Stream Analytics UDFshttps://learn.microsoft.com/en-us/azure/stream-analytics/machine-learning-udf
Implement SQL UPDATE/UPSERT via Azure Functions from Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-upsert
Configure Azure SQL Database as reference inputhttps://learn.microsoft.com/en-us/azure/stream-analytics/sql-reference-data
Manage Stream Analytics jobs with .NET Management SDKhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-dotnet-management-sdk
Write C# user-defined functions for Stream Analytics in Visual Studiohttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge-csharp-udf
Implement high-frequency trading with Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-high-frequency-trading
Create JavaScript user-defined aggregates in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-aggregates
Implement JavaScript UDFs in Azure Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-functions
Use built-in ML anomaly detection in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-machine-learning-anomaly-detection
Parse JSON, Avro, and complex data in Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-json
Integrate Azure Stream Analytics with Event Hubs Schema Registryhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-schema-registry-integration

Deployment

TopicURL
Generate and deploy Stream Analytics jobs with Bicephttps://learn.microsoft.com/en-us/azure/stream-analytics/cicd-deploy-with-bicep
Deploy Stream Analytics jobs using GitHub Actions workflowshttps://learn.microsoft.com/en-us/azure/stream-analytics/cicd-github-actions
Migrate Azure Stream Analytics jobs across regionshttps://learn.microsoft.com/en-us/azure/stream-analytics/move-across-regions
Move Azure Stream Analytics clusters across regionshttps://learn.microsoft.com/en-us/azure/stream-analytics/move-cluster
Deploy Stream Analytics edge jobs to Azure Stack Hubhttps://learn.microsoft.com/en-us/azure/stream-analytics/on-azure-stack
Export Stream Analytics jobs as ARM templateshttps://learn.microsoft.com/en-us/azure/stream-analytics/resource-manager-export
Set up Azure DevOps CI/CD for Stream Analyticshttps://learn.microsoft.com/en-us/azure/stream-analytics/set-up-cicd-pipeline
Start Azure Stream Analytics jobs via portal, PowerShell, and Visual Studiohttps://learn.microsoft.com/en-us/azure/stream-analytics/start-job
Implement CI/CD for Stream Analytics on IoT Edge via RESThttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-cicd-api
Stop and delete Azure Stream Analytics jobs safelyhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-clean-up-your-job
Use Stream Analytics CI/CD NuGet package with MSBuildhttps://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-tools-for-visual-studio-cicd

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Expert knowledge for Azure Active Directory B2C development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building B2C user flows/custom policies, configuring IdPs/MFA, securing APIs, automating CI/CD, or monitoring with Sentinel, and other Azure Active Directory B2C related development tasks. Not for Azure Role-based access control (use azure-rbac), Azure Information Protection (use azure-information-protection), Azure Security (use azure-security), Azure Sentinel (use azure-sentinel).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

Expert knowledge for Azure Advisor development including best practices, decision making, limits & quotas, security, configuration, and integrations & coding patterns. Use when managing Advisor alerts, digests, recommendation states, Resource Graph queries, or RBAC access, and other Azure Advisor related development tasks. Not for Cost Management (use azure-cost-management), Azure Monitor (use azure-monitor), Azure Policy (use azure-policy), Azure Security (use azure-security).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

Expert knowledge for Azure AI Vision development including decision making, limits & quotas, configuration, integrations & coding patterns, and deployment. Use when using Image Analysis, Read OCR containers, smart-crop thumbnails, background removal, or video frame analysis, and other Azure AI Vision related development tasks. Not for Azure AI Custom Vision (use azure-custom-vision), Azure AI Video Indexer (use azure-video-indexer), Azure AI Document Intelligence (use azure-document-intelligence), Azure AI Immersive Reader (use azure-immersive-reader).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

Expert knowledge for Azure Kubernetes Service Edge Essentials development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when deploying AKS Edge/Hybrid with Arc, Azure Local, GitOps, IoT/OPC/ONVIF, or Key Vault-integrated workloads, and other Azure Kubernetes Service Edge Essentials related development tasks. Not for Azure Kubernetes Service (AKS) (use azure-kubernetes-service), Azure IoT Edge (use azure-iot-edge), Azure Stack Edge (use azure-stack-edge), Azure Container Apps (use azure-container-apps).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

Expert knowledge for Azure Analysis Services development including troubleshooting. Use when resolving server connectivity, firewall/VNet, DNS, client connection, or network error issues, and other Azure Analysis Services related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure SQL Database (use azure-sql-database), Azure SQL Managed Instance (use azure-sql-managed-instance), SQL Server on Azure Virtual Machines (use azure-sql-virtual-machines).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

Expert knowledge for Azure Anyscale On Azure development including limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when registering AKS as Anyscale clouds, wiring ACR images, enabling Private Link/RBAC, ARM-based deployments, or region checks, and other Azure Anyscale On Azure related development tasks. Not for Azure Databricks (use azure-databricks), Azure Kubernetes Service (AKS) (use azure-kubernetes-service), Azure Machine Learning (use azure-machine-learning), Azure HDInsight (use azure-hdinsight).

The English summary is being prepared. Showing the original description.

MicrosoftDocs/Agent-Skills786Updated Oct 19, 2026

See all skills by MicrosoftDocs

Report a problem with this skill