Description
Big Data Engineer - Contract
Location: London
Start Date: ASAP
Duration: 3 month rolling contract
Rate: £500 per day
NST Recruitment are currently looking for a Big Data Engineer to work for a Global Marketing company based in London. You will be expected to design, build, optimize and launch new data models, as well as supporting the existing data models. Use analysis skills to understand business requirements, work with cross-functional data & product teams to build efficient and scalable data solutions. Efficiently use expert coding skills across a number of languages from Python, Java and PHP.
We want someone who knows how to review the existing infrastructure that we have built and come up with solutions that can solve two main problems:
1. Speed to process any ETL or Analytical Jobs
2. Reduce cost to perform the job
To do the above, candidates who have good exposure to the latest technologies will be required such as Spark 2.1.1, Presto 0.17, spinning EMR clusters with manual configurations, AWS Athena etc.
Main Responsibilities:
Be an expert in cloud and lead the design and development of big data ETL process.
Utilise the recent but proven data processing cloud platforms to keep evolving the infrastructure.
Set up the big data platform where by that allows to build different analytics solutions on top of it.
Involve in cross cloud architecture designing.
Transform large quantities of data into client insights & actionable recommendations.
Maintain active communications with key contacts working on projects, managing expectations as you go along.
Qualifications:
BS/B.Tech./M.Tech in Computer Science, Math or related field
Experience in development (Java, Python preferred)
Hands-on experience in SQL and NoSQL
Hands-on experience in the data warehouse space, custom ETL.
Experience working with either a Map Reduce or a MPP system.
Hands on experience with LAMP stack development.
Experience with large data sets, Hadoop, and data visualization tools.
Experience with Amazon Web Services (AWS) - must have good experience on tuning the clusters to get better performance.
Knowledge of the media, direct and digital industry would be an advantage (Not Essential)
If you are interested in this position, or can recommend anyone else, please contact Artche Harrowell at NST Recruitment/(see below)