Description
A World Leading Energy company are looking for a Senior Data Engineer to join their growing team of analytics experts and Solution and Data Architects, working on designing the next generation big data platform to support the digital marketing platform.Responsibilities:
Design and implement a new big data solution which supports high amounts- and velocity of data, supports future growth, use latest big data technologies/techniques, is cloud supported and in-line with the company's strategies.
Design and implement modern data pipelines to extract, clean and process data in batch and Real Time from different data sources.
Use the latest development, testing and deployment techniques to quickly deploy new releases to eg deploy new data pipelines and add data sources.
Help establish best practices around data governance, data security- and privacy (GDPR).
Work together with the solution - and data architect to define the target data strategy. Drives and applies Agile Framework within his/her operating environment. Will take direct reports, when applicable, through Agile Framework and its respective tools.
Skills & Requirements:
Bachelor or master degree in information technology, computer science, business administration or a related discipline.
Certified in Agile Product Owner/SCRUM master and/or other Agile techniques Leadership Skills
Have strong interpersonal, communication, facilitation and presentation skills. Is highly experienced in communicating with business at all levels.
Comfortable to work with global stakeholders, internally and externally.
Experience of working in a global business environment/different cultures.
Have strong interpersonal, communication, facilitation and presentation skills. Is highly experienced in communicating with business at all levels.
Experience of working in a global business environment/different cultures and with global stakeholders.
Technical Skills:
Source Code Control (eg Git, Subversion).
Open Source Frameworks (Apache Spark, Hadoop etc.)
Strong design and coding skills (eg Python, Scala, JavaScript).
Experience with reporting/visualization tools (eg SAP Lumira/Design Studio, Spotfire, Power BI)
Comfortable to work with global stakeholders, internally and externally.
Experience with SAP technologies (SAP ECC/ERP, SAP BW, SAP HANA etc)
Experience with SQL-based technologies (eg MSSQL, MySQL, PostgreSQL).
Experience with Restful API developments.
Experience with data blending technology (eg Alteryx)
Experience with Microsoft or AWS data stack eg Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc.
Job Experience Requirements Experiences
Interpretation of data, highly analytical, troubleshooting and problem-solving skills.
Experience with data architecture and design techniques (local/abstract).
Experience with API techniques/developments.
Experience with data transformation/blending technology (eg Alteryx is preferred).
Experience with working concepts as data pipelining/data wrangling
Experience with big data platforms; working with large data sets, large amounts of data in motion and numerous big data technologies.
Agile Project Delivery techniques (eg SCRUM) & experience creating and using a wide range of scrum and agile artefacts and techniques, automated testing, personas, user stories, agile games etc
Awareness of Agile Framework and its tools such as Visual Studio Team Services (VSTS)