Description
I am recruiting for a Data Engineer to work remotely until restrictions are lifted and then to be based in either Leeds or London for some of the time.
The role falls inside IR35 so you will have to work through an umbrella company. The rate quoted is the take home pay after ALL deductions.
You will have a solid background as a Data Engineer and have some experience of building, testing and promoting metadata.
Experience in Databricks ETL processing using PySpark is essential.
You must also have experience in AWS S3 storage, Lambda, DynamoDB.
Knowledge of Databricks Delta lake on how to Ingest, transform, load on Delta tables in Bronze, Silver, and Gold zone is also required.
Some experience in Airflow and also Python is preferred.
Experience/knowledge in Metadata catalog - AWS Glue/Collibra is desirable.
The deadline for candidate submission is Monday at 12pm.