Description
Build Complex Data Integration pipelines with varied types (nested XML, JSON, Cobol, EBCIDC formats) and sources of data (direct integration, API based, ftp transfer)
Support the planning and implementation of data platform services including sizing, configuration, and needs assessment
Implement effective metrics and monitoring processes
Hands-on experience on Azure data ecosystem, essentially with Azure Databricks, Data Factory, Data Lake, SQL DB
Continuous Integration, Continuous Development, Continuous Deployment tool and DevOps model, including Azure DevOps
Experience with the following technologies:
ADF
Databricks
SQL DB
ADLS
Azure DevOps
Strong Python and SQL skills is mandatory