• Develop and unit test ETL/ ELT data pipelines using ADF V2


• and other components like Azure SQL, Azure SQL DW, ADLS Gen2 etc.


• Maintain and manage code with Azure DevOps.


• Implement secure integration with data sources using Azure Key Vault, Managed Identity, Private Links etc.


• Create data pipeline involving diverse systems such Azure SQL DB, Azure SQL DW, ADLS Gen2, Azure Databricks, On premise compute.


• Engage with onsite-offshore team for daily activities Status reporting – weekly and monthly basis.


• Document functional and technical design.


• 2-3 Experience working on ETL/ELT tools.  Understanding and experience in Azure and Azure Data ecosystem


• Good to have programming language experience with .NET/Python or Scala/ Spark.


• 2-3 years’ experience working with ADF.


• 2-3 years' experience working with Azure Data Lake.


• 2-3 years’ experience working with Azure SQL DB or Azure Synapse.


• Experience in Machine Learning Studio, Stream Analytics, Event/IoT Hubs, and Cosmos.


• Nice to have Databricks experience.


• Nice to have Azure Logic Apps, Azure Blog Storage experience.


• Nice to have data migration experience from on prem to cloud.


• Knowledge of ADF Fault Tolerance, load balancing, security controls and distributed processing capabilities.

Technical Skills