Description
Data Architect - Iceberg/Hudi/Delta Lake
A Data Architect is required to join an exciting new programme, focused on promoting global financial integrity. Previous experience with AWS and modern data architecture frameworks - Apache Hudi, Apache Iceberg, and/or Databricks Delta Lake would be highly desirable, as well as previous E-commerce or gaming industry experience.
Deliverables:
- Translate business needs into data architectural requirements and designs
- Undertake data profiling and source system analysis to present clear insights and support end use of the data
- Make recommendations to ensure product requirements are met
- Support to the selection of appropriate technologies
- Review and agree proposed data architectural designs
- Provide detailed data architectural design and technical requirements to our cloud delivery partners
- Work with the scrum teams and product owners to resolve development blockers
- Review and provide collaborative input and support on the development and test environments to be built
Key skills and experience:
- Experience developing data architectures and data models supporting Real Time data pipelines
- Implementing data pipelines for data driven business decision supported by ML and NLP
- Data architecture across the full product development life cycle with exposure to a wide array of technologies, methodologies, and business environments
- Data streaming (ie Kafka) technology, SQL (ie PostgreSQL) and non-SQL database (ie CouchDB) technology which supports processing stream data, record keeping, and reporting
This role have been deemed inside IR35. Please apply for more information.