Description
My client's Data Engineering team is looking for an Engineer to be part of the team working on creating a new Real Time cloud based datawarehouse.
In this role, you will contribute in designing and developing our platform to fulfil the business needs and to also improve their systems. You will have the chance to design new data pipelines, manage Real Time API integrations and apply transformations on data streams for batch-loading and Real Time visualisations.
This is the perfect environment to put your skills to the test by building a consolidated Data Platform with innovative features and most importantly joining a bunch of talented and fun group of people.
Responsibilities
- Involved in data integrations which includes internal data, 3rd parties
- Involved in migrating data from on-premise to cloud DWH
- Ingestion of streaming data and applying transformations to data streams
- Being involved in Datamodelling following data standards
- Ensuring data quality by verifying data consistency and accuracy;
- Collaborating with the Data DevOps, Business Intelligence and other multi-disciplined teams
- Comfortable working in an agile environment involving SDLC;
- Familiar with the change and release management process;
- Have an investigative mindset to be able to troubleshoot - thinking outside the box when it comes to troubleshooting problems and incident management;
- Full ownership on projects and tasks assigned together with being able to work within a Team;
- Able to document well processes and perform knowledge sharing sessions.
Requirements
- Previous experience in cloud based DWH integrations;
- SQL -> PLSQL, T-SQL, Analytical function;
- Have a good understanding of data warehouse and ETL concepts;
- Experience in kafka;
- Be familiar with any Programming Languages like Python, .NET, Java, Scala;
- Experience around AWS S3 buckets;
- Cloud based columnar database like Snowflake or Redshift;
- Experience with Nifi and airflow as orchestrators;
- Have strong analytical and problem-solving skills;
- Be experienced and knowledgeable in core database development tuning techniques;
- Familiar with software versioning tools like Git;
- Excellent verbal and written English communication skills;
Trading as TEKsystems. Allegis Group Limited, Bracknell, RG12 1RT, United Kingdom. No. . Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at our website.
To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go to our website.
We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice at our website for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request.