Description
Azure Cloud Architect [Azure Data factory/Databricks]
We are looking for experienced Azure Cloud Architect to join our client team
Primary Responsibilities
- Develop and design ETL processing and Data extraction using Azur Data Factory/Data Flow/Azure Databricks.
- Design and develop Apache Spark SQL using Scala/Python to examine and query datasets.
- Develop Dataframes for ETL transformation and loads
- Write scripts for automated testing of data in the target facts and dimensions.
- Capture audit information during all phases of the ETL transformation process.
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse