Description
Data Engineer ( PostgreSQL, MySQL, Hadoop, AWS Redshift )
My client, a market leading E-commerce company are recruiting for a contract Data Engineer ( PostgreSQL, MySQL, Hadoop, AWS Redshift ) to join them ASAP in the Paris office on an initial 6 months contract paying £450 - £600 per day depending on experience. (No expenses paid).
As the Data Engineer ( PostgreSQL, MySQL, Hadoop, AWS Redshift ) you will be responsible for maintaining an existing platform whilst improving and stabilising the platform in terms of software engineering practices such as version control, security as well as moving it to Docker.
The current data platform is reaching its limits and needs some attention in order to continue its vital role whilst a new platform is being developed. This contract role is to join the existing team in supporting and improving the existing platform as well as starting on the work to build the new platform.
The existing platform consists of ~400 batch jobs written in Python and Shell Script and runs in AWS whilst utilising a number of AWS Redshift warehouses and marts. Qlikview provides the user interface.
The future vision is to create a new Real Time self-service data platform capturing and aggregating data across multiple technology platforms from browser events to order tracking events from all group entities. The platform will underpin the clients test and learn culture supporting the group analytics, BI and machine learning teams.
The Data Engineer ( PostgreSQL, MySQL, Hadoop, AWS Redshift ) will require the following skills:
. Expert knowledge of relational databases (PostgreSQL, MySQL);
. Experience of Big Data technologies (eg Hadoop, AWS Redshift);
. Experience of Real Time data processing (eg Apache Storm, AWS Kinesis);
. Expert knowledge and experience with Python and Shell script, with development experience in other languages such as Java, Go, Scala, JavaScript;
. An appetite for collecting large volumes of data from multiple sources (queues, NoSQL databases, etc.) and for data security;
. Ecommerce experience would be an advantage;
. Understanding and knowledge of data governance, data management, visualisation, web analytics;
. AWS or other cloud based environment experience;
. Effective implementation of new ideas/improvements;
If you are someone who likes to work in a fast paced and varied environment and are passionate about working on different and ambitious projects, this would be an excellent contract for you.
If you want to work within a successful and recognised company, but you also want the freedom to bring forward your own solutions and to make your own impact, then please click apply now.