Description
Senior Data Engineer (m/f)
Reference: -en
Start: asap
Duration: 3 MM++
Main tasks:
- Designing the inbound interfaces for Performance Data out of the Investment Management System into the new, strategic data platform
- Design Ingestion pipelines, required data mastering, design conceptual and logical data models and design consumption patterns and APIs for the ingested performance data, especially to support rendering of the performance data (attribution and top line performance) for client reporting
- Identify the sources of data and choosing the best patterns of transporting the data from (external) sources into the new data storage
- Assure the proper patterns will be applied to design the ELT / ETL processes with re-usability and future use in mind, i.e. decoupling source from target (Streams, Kafka Logs, Pub/Sub)
- Define the approach for mastering data that will have to be mastered through the Eagle Pace system
- Conceptually and logically model the target data model for storing this data on Oracle and/or Hadoop
- Together with (consumer) SMEs identify and design access and distribution patterns and APIs for that data for consumption, especially towards reporting requirements
- Guide and govern the Engineering teams throughout implementation of requirements
- Liaise with Data Analysts to discuss mappings of inbound data into a common semantic form
- Work with the Data Governance team to cover full lineage of data flows and use within the system(s) and to consumers
Main qualifications
- Experience with Hadoop (Cloudera) / Spark / Hive / Impala, Oracle 11g/12g, Data Pipelines, Pub/Sub and of ELT/ETL processes
- Skilled in Data Modelling (conceptual / logical/phyiscal), Data Access (APIs, Streaming)
- Ability to identify common patterns and define such patterns for data ingestion and consumption
- Experience creating loosely coupled systems and data flow processes
- Understanding of Master Data Management concepts and integration into a (data) system landscape
- Understanding of event driven / streaming concepts as opposed to batch oriented data flow management
- Understanding of end of day data snapshots vs. intraday, near-time data updates and how these live alongside
- Asset Management Data background and understanding (e.g. Trading, Accounting (IBOR, ABOR), Performance Measurement, Reporting ...)
- Abstract thinking and ability to transform business / data requirements into sound designs
- Experience in working in distributed teams (US, EMEA / UK, India) and in an Agile environment (SCRUM)
- Open minded, ability to work against tough timelines with huge demand, providing governance into other teams and assuring delivery is according to design
Main advantages:
- International high-street bank with various stakeholders
- Individual career opportunities and perspectives in an exciting environment
- Working in virtual teams and experiencing innovative working methods
- Very interesting client with versatile working fields and modern technology
About us:
IT specialists hold all the cards: for its customers in industry and the public sector, Hays is looking for motivated employees who like looking at the bigger picture and growing with new challenges. We make sure that you benefit from our many years of experience in IT recruitment and will find you the right role to suit your skills and interests – all completely free of charge to you. Register with us and reap the benefits of job offers that are both interesting and relevant to your skills and experience.
My contact at Hays:
My contact person:
Lara Errgang
Referencenumber:
Make contact:
Phone:
Email: