on-site

Data Architect - Iceberg/Hudi/Delta Lake

London
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

Data Architect - Iceberg/Hudi/Delta Lake

A Data Architect is required to join an exciting new programme, focused on promoting global financial integrity. Previous experience with AWS and modern data architecture frameworks - Apache Hudi, Apache Iceberg, and/or Databricks Delta Lake would be highly desirable, as well as previous E-commerce or gaming industry experience.

Deliverables:

  • Translate business needs into data architectural requirements and designs
  • Undertake data profiling and source system analysis to present clear insights and support end use of the data
  • Make recommendations to ensure product requirements are met
  • Support to the selection of appropriate technologies
  • Review and agree proposed data architectural designs
  • Provide detailed data architectural design and technical requirements to our cloud delivery partners
  • Work with the scrum teams and product owners to resolve development blockers
  • Review and provide collaborative input and support on the development and test environments to be built

Key skills and experience:

  • Experience developing data architectures and data models supporting Real Time data pipelines
  • Implementing data pipelines for data driven business decision supported by ML and NLP
  • Data architecture across the full product development life cycle with exposure to a wide array of technologies, methodologies, and business environments
  • Data streaming (ie Kafka) technology, SQL (ie PostgreSQL) and non-SQL database (ie CouchDB) technology which supports processing stream data, record keeping, and reporting

This role have been deemed inside IR35. Please apply for more information.

Start date
n.a
Duration
6 months
From
La Fosse Associates Limited
Location
London
Published at
23.06.2022
Project ID:
2411504
To apply to this project you must log in.