5,627 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

Unable to Connect to Public SFTP from Azure Synapse – Linked Service HMAC Error and Python Connection Timeout

Problem Statement We have a requirement to read and write data to a cloud/on‑prem SFTP server from Azure Synapse. The SFTP server (sftpssh.example.com) is a public SFTP server. We are using Azure Synapse with a Self‑Hosted Integration Runtime…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-10T12:56:44.5933333+00:00
Shubhangi Nannware 80 Reputation points
commented 2026-05-03T12:56:40.89+00:00
Shubhangi Nannware 80 Reputation points
2 answers

How to fix following Error: Query failed because of connection issues to control container or control container failure.

I have a Synapse Lake Database what has tables which were created on csv files stored in adls gen2, Everything has been working fine until now. Every time I execute a specific query in SSMS or SQL Query of Synapse I get the following error message:…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-11T15:56:31.3766667+00:00
Harinath Reddy A 0 Reputation points
commented 2026-05-03T09:21:26.5933333+00:00
SAI JAGADEESH KUDIPUDI 2,535 Reputation points Microsoft External Staff Moderator
0 answers

Options to migrate from Synapse for Spark Data Ingestion Jobs

Hi All, My team is currently trying to migrate from Synapse for our Spark Data Ingestion Job where we ingest data from Kusto clusters via Service Principal and store since the recommendation is to migrate to newer solutions which are actively being…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-30T09:29:25.07+00:00
Arjun Kedlaya 0 Reputation points Microsoft Employee
edited the question 2026-05-03T03:07:24.7733333+00:00
Saraswathi Devadula 15,940 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Transition your Azure Synapse Analytics workspaces to private links before 1 August 2026

Is there a way to enable a managed private network in an existing Azure Synapse workspace where it hasn’t been enabled? We recently received an email about transitioning to private links before August next year, otherwise Synapse will lose its ability to…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2025-09-19T18:05:51.92+00:00
Mohd Anas 20 Reputation points
commented 2026-05-02T08:56:19.64+00:00
Youness Kabbouch 0 Reputation points
1 answer

Transition your Azure Synapse Analytics workspaces to private links before 1 August 2026

Hello, We received an email from Microsoft saying that "Transition your Azure Synapse Analytics workspaces to private links before 1 August 2026" We discovered that our current synapse workspace does not have Managed VNet. Creating a new…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-02-24T15:33:09.5433333+00:00
Victor Buzy 25 Reputation points
commented 2026-05-02T08:53:36.1766667+00:00
Youness Kabbouch 0 Reputation points
0 answers

Unable to Delete Spark Pool

I am trying to delete a spark pool from a workspace but I am unable to. I have verified that this Spark pool is no longer referenced by any notebooks, pipelines, or historical workloads, and all known dependencies have been removed or reassigned. Despite…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-29T22:08:11.6333333+00:00
Ashely Tang 0 Reputation points Microsoft Employee
commented 2026-05-01T10:50:28.2166667+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator
1 answer

Deployment issue in Azure Synapse Analytics

Context We are using: Azure Synapse Analytics Git integration with main as collaboration branch Synapse Publish to generate: TemplateForWorkspace.json TemplateParametersForWorkspace.json Azure DevOps release pipeline with the Synapse workspace…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-28T15:37:10.8166667+00:00
Paul Hernandez 691 Reputation points Microsoft Employee
edited a comment 2026-05-01T10:02:35.3166667+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator
0 answers

Notebook execution is hanging when triggered using synapse pipeline

My spark notebook is extracting data from data lake & is triggered through notebook activity from a synapse pipeline, it was working fine till 27th April, execution started hanging after that for long time, when executed manually notebook executes…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-28T10:41:49.6+00:00
K Kulendra Singh (Harman Connected Services Inc) 5 Reputation points Microsoft External Staff
commented 2026-04-29T12:51:13.96+00:00
K Kulendra Singh (Harman Connected Services Inc) 5 Reputation points Microsoft External Staff
0 answers

Regarding version of azure synapse analysis

Regarding this swatsynapse workspace we are seeing the latest version but we are still receiving the mail'

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-29T06:46:26.11+00:00
NAVEEN Mittal 130 Reputation points Microsoft External Staff
edited a comment 2026-04-29T07:14:18.3433333+00:00
SAI JAGADEESH KUDIPUDI 2,535 Reputation points Microsoft External Staff Moderator
0 answers

Unbale to run synapse pipeline when triggered from ADF, but runs inside synapse just fine.

We have two Synapse pipelines, Dimensions Processing and Facts Processing, inside our resource syn-mint-p-uat which run fine when triggered from synapse, but when triggered from MintOrchDataFactoryFY26UAT, they fail with the below error: Error details…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-28T21:30:37.91+00:00
Indu Jaishwal 0 Reputation points Microsoft Employee
commented 2026-04-29T00:36:30.79+00:00
Manoj Kumar Boyini 13,605 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

quotas and resources constraints in apache spark for azure synapse

quotas and resources constraints in apache spark for azure synapse

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-27T23:49:27.94+00:00
Haijun Zhai 20 Reputation points Microsoft Employee
accepted 2026-04-28T19:20:41.1033333+00:00
Haijun Zhai 20 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Synapse Spark Pool 3.5 and Hyperspace support

Hi, I want to confirm if Spark Pool 3.5 runtime is still supported with Hyperspace? I've checked release information but have not found anywhere mentioned if Hyperspace is still supported, the last version I see it still support is Spark Pool 3.2…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-27T12:40:10.12+00:00
Vinh Nguyen 20 Reputation points
accepted 2026-04-27T12:44:15.7333333+00:00
Vinh Nguyen 20 Reputation points
1 answer

Azure Synapse Link is available in our environment, but the option to export Dataverse audit logs is not surfaced during link creation. We are Power Platform Administrators and auditing is enabled. Please enable Dataverse audit export via Azure Synapse Li

Azure Synapse Link is available in our environment, but the option to export Dataverse audit logs is not surfaced during link creation. We are Power Platform Administrators and auditing is enabled. Please enable Dataverse audit export via Azure Synapse…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-24T09:46:33.3366667+00:00
Sudhir Rawat 0 Reputation points
answered 2026-04-24T11:39:32.48+00:00
Pilladi Padma Sai Manisha 7,310 Reputation points Microsoft External Staff Moderator
1 answer

Synapse Notebook to Azure SQL Database connection issue

0 created Linked service to Azure SQL database in Synapse Analytics that uses Authentication type " System Assigned Managed Identity". Than referencing it in PySpark Notebook. Method getConnectionString is used to get access token. But its…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2024-07-25T09:57:59.5966667+00:00
Balbeer Singh 0 Reputation points
edited a comment 2026-04-24T07:05:05.5866667+00:00
Sacher, Wolf-Rüdiger 21 Reputation points
0 answers

The Synapse job is stuck while reading a large number of ADLSv2 files

workspace: edp-synapse-cpccogs-prod spark pool: cpccogs SparkJobDefinition_412adb40-2985-4d64-93a4-e06e59bd9a2d; livy id: 4538 SparkJobDefinition_463e4caf-1a3e-4949-9fd3-330c0b343295;    livy id:…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-24T05:58:13.0533333+00:00
Xiwen Yue 0 Reputation points Microsoft Employee
commented 2026-04-24T06:18:17.3966667+00:00
Jilakara Hemalatha 12,755 Reputation points Microsoft External Staff Moderator
3 answers

SystemReservedJob-LibraryManagement stuck in queued state

SystemReservedJob-LibraryManagement doesn't leave queued state when trying to upload "requirement.txt" file to spark pool

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-03-27T17:21:58.9666667+00:00
TI 0 Reputation points
commented 2026-04-24T01:25:49.2333333+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
3 answers

Spark 3.5 - Cosmos OLAP read fails with "Session isn't active" while working in Spark 3.4

🔹 Description We are currently migrating workloads from Azure Synapse Spark 3.4 to Spark 3.5. We are experiencing an issue when reading data from Azure Cosmos DB using Synapse Link (cosmos.olap). The exact same code works perfectly in Spark 3.4, but…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-01T19:36:15.84+00:00
Victor Buzy 25 Reputation points
answered 2026-04-24T01:14:50.7833333+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
1 answer

New Requirements to Spark Pool via EV2

I have been facing some issues with deploying new requirements to a Synapse Spark Pool. We currently deploy our Synapse pool requirements via EV2. When I try to add a new module to the requirements.json file (in this case, azure.cosmos), it fails during…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-23T17:42:28.5733333+00:00
Yajushi Mattegunta 0 Reputation points Microsoft Employee
commented 2026-04-23T21:52:45.7366667+00:00
Yajushi Mattegunta 0 Reputation points Microsoft Employee
1 answer

Synapse Spark notebooks not starting truly in parallel despite increased nodes

I am working with Azure Synapse Spark pools and need clarification on how parallel notebook execution is handled, particularly in relation to Spark application scheduling and resource allocation. Environment details Service: Azure Synapse Analytics…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-21T19:17:53.6533333+00:00
Sharan 20 Reputation points
commented 2026-04-23T05:26:01.16+00:00
Smaran Thoomu 35,045 Reputation points Microsoft External Staff Moderator
1 answer

Unauthorized Error Accessing Storage Container via Private Endpoint from Synapse

I created a storage account named bchdevih and connected it to a VNet. However, when I try to view the container details, I’m unable to access them and receive an error. Error Details Your firewall settings may be preventing network access from this…

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

5,627 questions
asked 2026-04-15T17:40:53.1166667+00:00
Saini, Tejinder [IH] 0 Reputation points
edited the question 2026-04-22T04:42:21.3733333+00:00
Saraswathi Devadula 15,940 Reputation points Microsoft External Staff Moderator