Description
Data Engineer/Software Engineer/Developer/Programmer, remote working, English speaking
Skills:
- Experienced in building data pipelines using Spark and Python
Duties:
As a data/software engineer, you will be working closely with business and product owners within our business units and business consultants. The goal will be to ingest data from various sources, store these in our event store, and create a canonical (curated) model on top of that. In addition, you make the data available for consumption by the business users.
The platform to do this, is custom developed for the client using Apache Spark and runs on Kubernetes on AWS. We have chosen a program approach to efficiently build the data platform with internal and external staffing using an Agile/Scrum approach for delivery.
- Build data pipelines and data transformations in PySpark
- Integrate systems, applications, or data sources
- Monitoring architectural and technical debt and addressing this in backlog formation with the product owners
- Provide solutions to data-transformation and -consumption questions
The client is investing in a new Data Platform for research and information provisioning as part of its Digital strategy. We are looking for a data/software engineer who can add value to the team of engineers by your experience and skills.
You will be responsible for helping to build the platform throughout its life cycle, eg building data transformation pipelines and data consumption functionality.
You will be working with a lead data engineer in an international team of business analysts, data engineers, and business staff.
The data team is part of the Data Centricity program and works closely with the Information Management Strategy team (IMS) delivering functional solutions in IT. Your colleagues are very well experienced professionals in the financial industry with many years of experience in orchestration the processing and reporting of investment processes and products
As a Data Engineer, you will be part of the Data Centricity Program team for client in The Hague. You will find a working environment where you can enjoy opportunities to explore and create. You will be working directly with business and senior management to drive forward developments in our Data and Information solutions.
Working for a well established client.
WORKING CONDITIONS: REMOTE WORKING (3-4 days per week), WITH ON SITE in the Hague once or twice a week.
Flexible start date (ie immediate to 3 months notice)
(If this position do not fit within your experience or is of no interest to you we offer a recommendation fee for any consultant you refer we successfully make a placement with).