Description
Data Engineer
6 months
Candidate must be SC Eligible
We are heading up a recruitment drive on behalf of a global IT consultancy that require a Data Engineer to join their team on a major government project that is based remotely.
The client is looking for a data engineer with experience in Denodo, and the ETL tools used on the HMRC account, ie Pentaho PDI and Talend etc
Task Description:
Carrying out development in accordance with the agreed requirements and development standards.
Tasks:
Testing of products in accordance with the test strategy to ensure that they are fit for purpose.
Assisting the team in examining packages of work and giving realistic timescales for completion.
Completion of work allocated within agreed time, cost and quality criteria and providing progress reports on assigned work as required.
Management and control of problems and change within their area of responsibility, including negotiation with other team members.
Problem analysis, investigation, and resolution.
Playing an active part in Process improvement, awareness of and compliance with all relevant quality processes and procedures, including completion of all the specified quality records.
Mandatory
Unix/Linux
Cloudera (basic level)
Pentaho PDI
HQL/SQL
Problem solving
Ability to work independently
Proactive
Good communication skills
Optional
Pentaho BA
Java
AWS
CRON (scheduling)
Berlin Scheduler
Operational support experience
JIRA/Confluence
Assyst
Gitlab/Bitbucket
Skills/Experience:
Experience of Requirement gathering, analysing, and documenting data requirements & business terms
Experience of data profiling, analysing data and writing VQL.
Experience of data and data warehousing management across the life cycle of data
Experience of release management and admin process in Denodo.
Denodo Development and Denodo.administration(monitoring).
Specific experience of data solutions development addressing data extraction, transformation and load (ETL) processing and data analytics and reporting requirements.
Familiar with Agile software development principles and practices and experience of delivery as a member of an Agile Scrum team utilising Scrum methodology.
Mandatory Business Skills:
SC Eligible
Good written and verbal communication skills.
Problem solving and creativity skills.
Desirable Business Skills:
Knowledge of HMRC business.