Description
Cloud Consulting has an exciting opportunity for an experienced Azure Data Engineer to work on a new project for a leading UK organisation.
You will be working as part of a team of data engineers to build data processing pipelines, using PySpark on Databricks to ingest and transform large volumes of data.
The role is offered on a fully remote basis and is paying £550-£600/day via umbrella on an initial 6-month contract.
Key skills:
- Databricks:- experience writing data transformation pipelines Previous experience in Structured Streaming is a bonus.
- PySpark
- Python Software Development - including unit testing, packaging, and coding standards. Specific experience of automated testing of Spark code is a bonus
- Azure
If you're interested, please send your CV in the first instance.