Description
Cloud Consulting have an urgent requirement for an experienced Data Engineer to work on a high-profile project for a leading blue chip company.
The role can be offered on a fully-remote basis, and is outside of IR35.
The project is to deliver a Real Time analytics tool to present the client's caseworkers with all the relevant information they require in the correct time-frames. This will allow them to make better, quicker decisions without having to request additional information.
They currently have a Kafka pipeline that consumes c. 100k events p/day which are then stored on an AWS RDS instance and queried via a Celery application which stores all analytics output on an AWS ElastiCache service for rendering back to the user. The Back End and wider architecture is largely locked-down and stable, but they have a lot of dashboards, panels etc to deliver.
We therefore need people who are confident in SQL and who can quickly churn through business requirements to deliver queries, dashboards etc.
Key skills:
- Python
- SQL BI/MI querying
- SQL, data-modelling, schema optimisation
- SQL, query optimisation
- Ideally Kafka, or if not, then event streaming fundamentals
- Basic Kubernetes
- CI/CD basics
If you are interested, then please forward your C.V in the first instance.