We assigned a group of Azure Experts and did deep analysis, understand the environment and requirements. We used Azure Data Factory v1 to connect to on premise database, we used another windows server at the same network to install data gateway in order to solve connection issues. Building incremental load pipelines to move data daily according to dates. Building json scripts to move the data daily as an incremental copy.

Automated Azure Datawarehouse using automation account to start/stop at certain. Our team completed the challenge in 5 working days, which consisted out designing a flow using .JSON scripts and schedule the pipelines that needed to be run daily.