Data Engineer

Description

ROLE PROFILE

GENERAL DETAILS

Role Title

Data Engineer

Location

London/Singapore

Department

Marketing

GBF Band

Band6/12

Reports to (manager)

Transformational Moves Manager

Type of Work

Specialist Support

Manager once removed

Head of Digital and Innovation

Date

Oct 2021

CONTEXT

The purpose of the Marketing BU is to sustainably maximise cash flows from the marketing of Anglo American products and services. In support of this, we have set ourselves an ambition to deliver a considerable uplift in in EBIT by 2023.

One of the critical enablers to our success will be to embed a new portfolio of digital and other innovative concepts and analytical tools. The Digital and Innovation Team is charged with identifying, designing and implementing solutions to enable commercial business units in mining supply chain and commodity trading desks by using novel technologies and business data to uplift their bottom-line results

PURPOSE

Be a key member of the Digital and Innovation team working across teams and projects to deliver high quality data solutions and integration components.

Initial focus will be the design and delivery of a data platform as part of the agile Digital & Innovation team delivering the Marketing ESG provenance and traceability solution. Key deliverables will be to design the data platform to bring all the relevant data to create a 360 view of supply chain and for digital ESG label, provenance and traceability and build Data Ingestion & Data Processing components to integrate with the sources and creating a common data model with the related data. Implement data governance, process, data cataloguing and insights.

TYPICAL TASKS

Solution Architecture

Support Digital & Innovation in the development of the Digital and Innovation Strategy by providing technical expertise and insights related on how data can flow from mine to consumers.

Explore new innovative solution/approaches with the power of digital technologies which would create a competitive advantage for Marketing BU

Concept Development and Delivery .

Develop fit-for-purpose, resilient, scalable and future-proof data services to meet project needs

Orchestrate ETL pipelines breaking down data silos and drive data availability across the Marketing Unit.

Ensure data quality for all ISOP, Master Data and blockchain data

Handle Real Time and batch data from internal transactional and third-party data sources

Provide best-practices and frameworks for data testing, validation ensuring reliability, performance and accuracy of data

Ensure that data solutions are aligned to group standards (including Anglo American Security and Operating Standards)

Work with and support Group Data Analytics, IM and business in architecture of data warehousing and data-lake as required.

Align delivery of the solutions and analysis according to Agile methodology

Leverage learnings from across relevant teams and contribute to the development of a high calibre Data Engineers capabilities.

ROLE RELATIONSHIPS

Managerially Accountable to:

Digital & Innovation Transformational Moves Manager

Direct Reports (if applicable):

Key Internal Relationships:

Digital & Innovation Technology and Data Science Managers and Teams

Digital & Innovation Opportunity Managers

Digital & Innovation ESG Provenance and Traceability agile team

Marketing IM Team

Group Data Analytics Team

Production BU Teams

Marketing functional teams (ie Finance, Risk, HR etc.)

Key External Relationships:

Key Vendors and Service Providers

Mental Processing Ability

This work involves analysis, reflection and the use of data over a longer period, in order to anticipate problems. It requires knowledge of the overall system and focuses on the direct application and improvement of systems.

Application/Energy

Proposes best practives for handling data from different sources

Encourages innovative thinking and scientific debate with applicable results

Consistently displays a positive and engaged manner

Fosters cross team collaboration

Knowledge

Formal qualifications:

Required: MSc + 12 years relevant experience

Required field of qualification: Computer Science, Physics, Mathematics, Engineering.

Role-specific knowledge:

Required: Experience in designing, building, and maintaining data pipelines and data lake.

Required: Experience working with blockchain solutions and decentralized systems

3+ years of software development experience working on business critical systems and building microservices

Passion for data and insights

Commodities trading experience would be desirable

Strongly preferred: Exploratory data analysis and experience handling large data sets.

Safety:

Provides a consistent outstanding role model in relation to safety practices with a deep understanding of the importance of safety.

Technical Skills

Technologies & Tools: Azure Data Factory, Azure DataBricks, Azure Cloud, Apache Airflow, Apache Kafka and Apache Spark

Required: Deep knowledge of storage architectures, including Distributed File Systems (ie HDFS), Blob/Lake Gen 2 storage, SQL DB, Postgres, Cosmos DB, IPFS, No SQL, Key-Value storage.

Required: Kowledge of Distributed Query Engines (like Presto), Coding with Python/C#, Scala and GraphQL

Expert level in versioning Control (Git) and DevOps tools like Kubernetes, Docker and CI/CD.

Social Process Skills

Ability to challenge diverse ideas respectfully

Ability to comminucate complex concepts in a very intuitive way

Comfortably interact across all mediums of interaction ie face to face vs virtual interactions

Must be fluent in English.