Description
SC cleared Lead Data Engineer is required by this niche consulting business engaged on a high level Government project. You must be able to demonstrate work on complex Digital Transformation programmes, across Data Integration into Cloud Data Warehouses/Data Lakes in an Agile environment with heavy exposure to APIs.
Responsibilities include -
- Build of data-streaming systems
- Recognise opportunities to re-use existing data flows between teams
- Coordinate teams and set best practice and standards
- Lead a team of 5-10 data engineers and oversee successful sprint deliveries to meet SLAs
- Re-engineering of manual data flows to enable scaling
- User requirement identification and analysis
Ideally you can demonstrate experience in -
- AWS Cloud
- ETL
- Pentaho/Talend
- Spark/Big Data
- Datamodelling
- Metadata management
- Kafka/Denodo skills are very beneficial
* This is a remote working, Outside IR35 contract but please not that you must be SC cleared already to be considered. Please contact me for a full job spec and detailed conversation.*