12,086 questions with Azure Data Factory tags

Sort by: Updated
2 answers

Can the Azure SQL database be scaled up (in the DTU model) automatically before running a pipeline and then scaled down afterwards?

I have several pipelines in ADF that when executed write data to an azure sql database. I am using the Standard DTU model for the pricing tier. Using any available ADF activities, can the Azure SQL database be scaled up (in the DTU model) automatically…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-12T23:23:07.55+00:00
Caesar 0 Reputation points
commented 2026-03-13T02:34:39.8466667+00:00
Caesar 0 Reputation points
0 answers

How to Call a ORACLE DATABASE PACKAGE from Azure data factory and receive the output of that package.

Team I need to call a ORACLE DATABASE PACKAGE from azure data factory and use its output in other activities but i am not able to call a PACKAGE. Inside the package there are many stored procedures written so i need to call a specific stored procedure…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2025-03-05T11:24:06.85+00:00
ADFUser 1 Reputation point
edited a comment 2026-03-13T00:19:57+00:00
LEIGHTON Olivia 0 Reputation points
1 answer

ADF Deployment failure – Global parameter not found under dataFactory

ADF Git Publish/ARM Validation fails when referencing Global Parameter: “Parameter StorageContainerName was not found under dataFactory I’m deploying Azure Data Factory pipelines from a feature branch → main and publishing to our ADF DEV factory. For…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-11T22:55:03.8733333+00:00
Karthik K Koneru 61 Reputation points
edited a comment 2026-03-12T22:36:38.6166667+00:00
Pilladi Padma Sai Manisha 5,240 Reputation points Microsoft External Staff Moderator
1 answer

I have to copy data from share point (Unstructured Data Photo/Video)to Azure blob storage using ADF pipeline

Can anyone tell me which activities I have to use as well which access I have required on share point level as well On Entra ID As well which linked service I have to use

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-11T20:25:46.23+00:00
Prashant Vidhate 0 Reputation points
commented 2026-03-12T17:20:21.8933333+00:00
Manoj Kumar Boyini 9,410 Reputation points Microsoft External Staff Moderator
1 answer

Adf Pipeline created date

Hi Team, How can we find the excat adf pipeline created date. I tried to get detils from Activity log but i can see ony 3 months data can be fetched. Please suggested how can i get the pipeline creation date. Regards Saim

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-12T10:32:27.0266667+00:00
shamim 0 Reputation points
answered 2026-03-12T10:32:53.18+00:00
Q&A Assist
2 answers

Moving SHIR binaries from C: to D: drive

Hi, We have installed Microsoft Selfhosted Integration Runtime(SHIR (both Azure and On‑Premises) on a virtual machine, where the default installation is on the C: drive. We came to know that there is a possibility to move the SHIR binaries from C: to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-03T10:26:47.0033333+00:00
Seshamanikumarchava-6950 0 Reputation points
commented 2026-03-12T09:37:24.1966667+00:00
Manoj Kumar Boyini 9,410 Reputation points Microsoft External Staff Moderator
1 answer

Column level type conversion in Mapping section of Copy Activity in Azure Data Factory.

Earlier, I used to get the option to change type conversion settings of a particular datetime column in mapping section of a copy data activity. Here my source is Azure SQL DB and Destination is Azure blob storage. Now, If I am changing my source to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-11T08:19:27.9433333+00:00
BadMan 0 Reputation points
commented 2026-03-12T06:03:49.7533333+00:00
Smaran Thoomu 33,920 Reputation points Microsoft External Staff Moderator
1 answer

Table connector not working for incremental logic setup in Databricks

It appears Table Connector to bring the SAP tables data into Blob not working as expected and we have setup the incremental logic on timestamp. However, we observed that a few records in SAP table are being deleted. However, not able to get those deleted…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-03T10:42:58.22+00:00
Tej Pavan Chowdary 0 Reputation points
commented 2026-03-11T21:56:47.5033333+00:00
Pilladi Padma Sai Manisha 5,240 Reputation points Microsoft External Staff Moderator
0 answers

ADF - Az function activity 499 error

WE get an error while executing azure function activity inside adf pipeline. Azure function is calling an API and extracts and stores the data returned by api to a storage account. Call to provided Azure function 'api_blob' failed with status-'499'…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-09T06:54:47.4266667+00:00
Santhi Dhanuskodi 365 Reputation points
edited a comment 2026-03-11T15:07:02.84+00:00
SAI JAGADEESH KUDIPUDI 485 Reputation points Microsoft External Staff Moderator
1 answer

Fix format of a datetime column in Copy Activity's Mapping section

We have set format of a Datetime column to "G" and "en-US" in mapping section of copy activity. Here our source is Azure SQL db and Destination is ADLS. The format of the datatype is as expected. Here is the type conversion setting:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-10T05:26:33.38+00:00
BadMan 0 Reputation points
answered 2026-03-11T06:21:20.5233333+00:00
Alex Burlachenko 19,465 Reputation points Volunteer Moderator
1 answer

Data Factory Redshift Dataset throws v2 Error when using v1

Our Redshift Copy Pipelines recently stopped working with the error that they cannot locate a V2 ODBC DLL file. We did not change any settings and are still using V1 for Redshift. We attempted to update the Linked Service to use v2 but still receive…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-06T19:49:39.2866667+00:00
Clint Vallandingham 0 Reputation points
commented 2026-03-11T01:40:21.6566667+00:00
Pilladi Padma Sai Manisha 5,240 Reputation points Microsoft External Staff Moderator
2 answers

ADF - postgres: Read method cannot be called when another read operation is pending

I'm using Azure Data Factory copy data activity to move data from Azure PostgreSQL to OneLake. I'm using a self-hosted integration runtime for that (because of how our VNETs are set up). Here is the error I'm getting: Operation on target…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
Azure Database for PostgreSQL
asked 2024-11-12T09:22:24.8866667+00:00
Mart Roben 0 Reputation points
commented 2026-03-10T12:17:49.85+00:00
Mart Roben 0 Reputation points
1 answer

What are the supported Open SSH Key Formats when it is using in Azure ADF - Linked services for SFTP access

Hi, I created a ADF Linked services with Open SSH key for SFTP access. It is supports only with RSA format key but not ECDSA format. As per the security requirement, I need to use only ECDSA format. Please help me to provide the suggestions and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-09T17:29:46.63+00:00
Lekkala, MuraliKrishna 0 Reputation points
answered 2026-03-09T17:29:58.5733333+00:00
Q&A Assist
1 answer

Connection to UiPath with Service Principal in Azure Data Factory

Dear All, I'm very new to Azure Data Factory and recently I got a request to connect to UiPath using Service Principal. I have received Directory (tenant) ID, Application (client) ID, Client secret Value and Secret ID. I could also see that it is already…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-09T13:39:25.3066667+00:00
WerciaS 0 Reputation points
edited an answer 2026-03-09T15:47:05.32+00:00
Martin Dimovski 1,711 Reputation points
2 answers One of the answers was accepted by the question author.

Validate Schema option in mapping data flow not failing for invalid type

I have a mapping data flow with 'Validate Schema' ticked and the following projection settings. When I run the mapping data flow in debug mode, it doesn't fail for the following file. Here is the final file. It just skips the erroneous values. How…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-02-23T18:51:29.8+00:00
Dhruv Singla 210 Reputation points
accepted 2026-03-06T12:28:24.5966667+00:00
Dhruv Singla 210 Reputation points
1 answer

SftpFailedToConnectToSftpServer

I am having an issue with a client supplied SFTP account from within Data Factory, I am able to connect with the credentials via FileZilla locally, and with some C# code when deployed, but Data factory cannot create a valid connection to this AWS server.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2025-04-15T16:26:17.8066667+00:00
Daniel Woodhouse 0 Reputation points
commented 2026-03-05T13:31:24.5633333+00:00
Maverick 0 Reputation points
2 answers

IBM I Access AS400 connection in ADF

I want to connect IBM I Access AS400 connection for data source in ADF

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-02T13:03:55.9533333+00:00
Godasi, Kumar R L D P 0 Reputation points
commented 2026-03-05T04:42:31.84+00:00
Manoj Kumar Boyini 9,410 Reputation points Microsoft External Staff Moderator
1 answer

ADF system-assigned managed identity broken after subscription migration

After migrating an Azure Data Factory (ADF) resource from one Azure subscription to another, the system assigned managed identity for the ADF resource appears to be in a broken state. The managed identity is visible in the ADF resource settings, but it…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-03-03T22:15:15.6066667+00:00
Murali Kadiyala 0 Reputation points Microsoft Employee
answered 2026-03-04T01:02:24.14+00:00
Vinodh247 41,566 Reputation points MVP Volunteer Moderator
4 answers One of the answers was accepted by the question author.

Failed to resolve the server name "dpsouthafricanorth.svc.datafactory.azure.com", please refer to troubleshooting doc and check network configuration.

Hi Team For some unknown reason we are having this error with our linked services in ADF. All test connection failed with: Failed to resolve the server name "dpsouthafricanorth.svc.datafactory.azure.com", please refer to troubleshooting doc…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-02-19T10:11:17.3733333+00:00
Gomolemo 105 Reputation points
accepted 2026-03-02T18:20:04.7666667+00:00
Gomolemo 105 Reputation points
2 answers

Not able to read the Excel file using the download url of the share point file into the Azre ADF http Excel dataset

Hi, I am using the Share point download url in the Azure ADF http Excel dataset, where i have put the download url then also this does not read the sheet name . When i put the sheet name manually then this not show the preview. In that similar way i…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,086 questions
asked 2026-02-26T05:43:30.8366667+00:00
nishant garg 0 Reputation points
commented 2026-03-02T12:38:00.6233333+00:00
Manoj Kumar Boyini 9,410 Reputation points Microsoft External Staff Moderator