Description
Joining a diverse, talented and creative team within the Data Science and Innovation division you will focus on solving complex and usually confidential and sensitive problems leveraging advanced data processing tools and analytics techniques.
You will have hands-on experience in at least two of the following disciplines and be an expert in one: Data Integration/ETL, SQL (Optimisation and Tuning), Lake/Warehouse/Mart design, Data Management (incl. Data Quality Management), Data Virtualization/Federation, and Datamodelling.
Your responsibilities:
- Gathering, documenting, examining and managing data integration and data management requirements
- Design and build extensible data acquisition and integration solutions using various integration tools (Informatica, Pentaho, >AbInitio, IBM DataStage, Kafka, Flume, etc) and a variety of data environments (Hadoop, Oracle, Mongo, etc)
- SQL development, QA, and profiling (Oracle, Hive, Impala).
- Data modelling, both logical and physical.
- Optimize data integration platforms to provide optimal performance under increasing data volumes and complexity
- Provide expert knowledge of ETL methodologies
Skills and qualifications:
- Expert in different patterns and technologies around enterprise-level data integration, data management and data warehousing
- Expert in the design, development, and optimization/tuning of database technologies
- Expert in Hadoop and related NoSQL technologies (Hive, Impala, HDFS, Spark) or Pentaho as a minimum.
- Experienced with Agile principles and methodology
- Programming (SQL, Unix Shell, Java, Python)
- Applied knowledge of several data technologies, practices and analytical approaches, including:
- Data Integration (ETL/ELT, SOA/Middleware, Enterprise Service Bus)
- Relational Databases (OLTP, Analytical MPP Appliances, Hadoop)
- Data Preparation and Data Warehousing (SQL, ETL, Warehouse architecture, OLAP)
- Data Architecture (Logical & Physical Modelling, Policy and Rules Management)
For more details regarding this vacancy, call Luke or send your CV direct to (see below)