Description
My client are seeking a CIP Data Engineer, to monitor and audit data quality and processes, including key performance indicators. This will be a contract for initially 3 months, but has the possibility for it to be extended.
Remote work.
The Role:
- Creating and productionising Jupyter notebooks
- Identify, evaluate and implement external services and tools to support data processing, validation and cleansing
- Set up, maintain and improve automated data processes
- Munging large data sets from multiple sources, including audit data captured from digital services
- Collaborate with multidisciplinary team to provide data business solutions, including publishing data and sharing data through file processes and APIs
Your Experience:
- Extensive AWS suite experience
- DevOps experience
- Experience working within multidisciplinary team including Data Scientists, Application Developers, QA, Delivery Lead and Product Owner
- S3/HDFS Data Warehousing