Data Engineer - Python - Contract - Paris

Paris  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Description

A market leading web-based technology group require Data Engineers to assist in stabilising and improving their existing data platform. The current data platform is almost at capacity and needs significant work in order to continue its vital role whilst a new platform is being developed. This contract role is to join the existing team in supporting and improving the existing platform as well as starting on the work to build the new platform.
The existing platform consists of a large volume of jobs written in Python and Shell Script and running in AWS and utilising a number of AWS Redshift warehouses and marts. The vision is to create a new Real Time self service data platform capturing and aggregating data across multiple platforms within the group from browser events to order tracking events from all group entities. The platform will underpin our test and learn culture supporting the group analytics, BI and machine learning teams.

Responsibilities;
  • Maintaining the existing data platform;
  • Improve and the existing platform using sound software engineering practices
  • Working on the build of a new data platform for the group;
  • Working with the wider team to receive training on the existing platform
Skills & Experience required;
  • Expert knowledge of relational databases (PostgreSQL, MySQL);
  • Experience of Big Data technologies (eg Hadoop, AWS Redshift);
  • Experience of Real Time data processing (eg Apache Storm, AWS Kinesis);
  • Expert knowledge and experience with Python and Shell script, with development experience in other languages such as Java, Go, Scala, JavaScript;
  • you have an appetite for collecting large volumes of data from multiple sources (queues, NoSQL databases, etc.) and for data security;
  • Understanding and knowledge of data governance, data management, visualisation, web analytics;
  • Worked with AWS or other cloud based environment
Start date
Immediate
From
Theta Partners
Published at
25.01.2018
Project ID:
1490937
Contract type
Freelance
To apply to this project you must log in.
Register