Description
Key Skills for this role are as follows:
- Python, Apache Spark, SQL
- Databricks
- Azure Data Factory
- Azure Blob Storage
Daily tasks include:
- Conduct experimentation on existing migration solution to identify bottlenecks and potential performance improvements ie, tune, test, analyse.
- Implement incremental performance improvements, as required
- Implement a data validation/data quality solution to verify that the migrated data is being correctly loaded into the target data store
12 Month contract!