Question 1 of 30
A data engineering team is tasked with integrating a large dataset from an on-premises SQL database into Azure Data Lake Storage (ADLS) for further processing with Azure Databricks. The dataset consists of millions of records, and the team needs to ensure that the data is ingested efficiently while maintaining data integrity and minimizing costs. Which approach should the team take to achieve this?
Use Azure Data Factory to create a pipeline that utilizes the Copy Data tool to move data from the SQL database to ADLS, while implementing incremental data loading to only transfer new or updated records.
Manually export the data from the SQL database as CSV files and upload them to ADLS using Azure Storage Explorer, ensuring that the files are organized by date.
Set up a direct connection between the SQL database and Azure Databricks, allowing Databricks to query the data directly without storing it in ADLS.
Use Azure Logic Apps to automate the process of transferring data from the SQL database to ADLS, triggering the transfer based on a schedule.

Preparing for Microsoft DP-203 Data Engineering on Microsoft Azure? Now land the interview.

73% of qualified candidates get rejected because of weak resumes. Build an ATS-optimized, recruiter-ready resume in under 5 minutes - free to start.

Build My Resume Free