Description
Senior Data Engineer - Data Science / Python / Java / Big DataAs a Senior Data Engineer / Data Scientist within Big Data, you will be the technical lead for the data engineering part of the team, working closely with both the data science and the consultants to understand both internal and external customer needs and develop ground breaking solutions
You will:
Build and maintain cloud data infrastructure: storage, pipelines, analytics platforms
Support data scientists to design and handle very large datasets, understanding data processing at scale
Deliver analytical solutions, analysing large and complex data sets using multiple technologies (SQL, Big Query, Big Table, Cloud Services).
Understand customer requirements and define tailor made solutions
Create and develop data products and implement production tools
Clearly and confidently present complex data architectures in a simple and engaging manner
Visualise and deliver analytical results in insightful, interesting and interactive ways using various technologies (Powerpoint, Qlikview, HMTL, Javascript, Tableau, other)
Proactively investigate and discover new techniques, technologies and data sources to enhance Big Data capabilities
Be an inherent part of the team, helping design and drive both short and long-term strategies
You will have:
Experience with software engineering, big data and distributed platforms.
Python programming advanced level.
Java programming capability.
Batch and streaming large-scale data processing (Apache Beam, Apache Spark) and advanced SQL.
NoSQL, Big data analytics platform, Massively parallel processing engines (BigQuery, Impala, BigTable, HBase).
Good understanding of different types of big data storages.
Message brokers (Kafka, Pub/Sub).
Virtual environments, containers, advanced distributed version control system. Git guru.
Ability to write requirements specification, mission statement and documentation.
Team player, happy to collaborate ideas and contribute collectively for a common goal.
Excellent problem solver with real curiosity and drive.
Happy to regularly take on new challenges. Motivated and quick to pick up any newly required skills.
Please send a CV detailing the required experience for consideration