Description
Data Engineer (Contract Role) - £525 Per day Inside IR% Remote! - 6 Month contract
Key skills:
- Python, Apache Spark, SQL
- Databricks
- Azure Data Factory
- Azure Blob Storage
- Azure SQL
Nice to have (Non essential):
- HDInsight/Hive
- Delta
- Experience writing unit/integration tests
- Experience with data migrations
- Experience with CI/CD tooling eg Azure DevOps
What will this role involve day to day:
- Conduct experimentation on existing migration solution to identify bottlenecks and potential performance improvements ie, tune, test, analyse.
- Implement incremental performance improvements (as required)
- Improve the data validation/data quality tooling