Contract Data Engineer/Data Scientist, SPARK, Hampshire

Job type:
on-site
Start date:
ASAP
Duration:
12 months
From:
FDO Consulting Limited
Location:
Hampshire
Published at:
01/19/2021
Country:
flag_no United Kingdom
Project ID:
2032070

Warning
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Contract Lead Data Engineer/Data Scientist, Hands-On, Data Lakes, AI, Data and Market Analysis. Hampshire based post Covid. Responsible for building and deploying the data element of a global digital platform. Must have a strong combination of Data Science and Data Engineering skills.

MUST HAVE SKILLS -

* Spark
* Azure Databricks.
* Data Science and Data Engineering skills.
* Multi-tenanted Cloud Deployment.

Well respected and established company are in the process of completely refreshing their application and infrastructure tech stack designed for the cloud to deliver a SaaS global platform and are looking for a Lead Data Engineer, with knowledge and experience of implementing a combination of MI reporting and the use Data Lakes servicing AI/ML, to play a lead role. With experience in a similar role, you will have heavily been involved in building a platform in a start-up environment or as part of the build team in a larger organisation. Technically you will be very strong with a range of technologies including management dashboards, business and UI data analytics utilising cloud technologies. This is an excellent chance to be involved from the ground up and build an industry leading Cloud platform.

Duties and Responsibilities include -

* Work with the architect and engineering teams to ensure the data platform is designed to be globally available, scalable, secure, performant, manageable and cost effective.
* Work with the business to implement a reporting strategy suitable for reporting from a multi-tenanted data stores with appropriate obfuscation and tenant specific dashboards, reports and ML algorithms.
* Collaborate with product owners, architects and engineering team to design data patterns and schemas that are implemented to support analytics and machine learning as part of a global multi tenanted platform.
* Develop basic machine learning models upon the selected data platform to ensure that the platform meets the product requirements for data scientists to succeed.
* Ensure data storage and services are deployed in accordance with company security policies and cloud best practice design patterns.

Essential skills -

* Design of big data storage and ingestion processes.
* Good cloud agnostic understanding as well as Azure specifics (Azure Big Data).
* Experience of implementing data analytics strategies for multi tenanted cloud platforms encompassing domains of business analysis and user experience analytics.
* Knowledge with reporting platforms suitable for product integration.
* Technical expertise with data models, data mining and segmentation techniques.
* Knowledge of appropriate tools and how to apply them.
* Knowledge of machine learning tools.
* Experience of working as a data engineer in a cloud platform.

This is a fantastic opportunity for a Data evangelist and technologist who would like to play a key role in building a new platform from the ground up over the next 2 years and then continuing to enhance utilising AI/ML technologies. You will gain the chance to use your technical skills and business experience and help create an industry leading SaaS platform.