Description
Job Title: AWS Data Engineer - Outside IR35
Contract Length: 3-6 months (High chance of multiple extensions)
Rate: Negotiable
Start Date: ASAP
Fully Remote Role
Job Description
* Design, build, maintain, test and deploy data pipelines and architectures in AWS and potentially Azure;
* Ensure the scalability of the data engineering architecture to meet future business demand;
* Extract, transform and load data from multiple source systems such as SQL Server, MongoDB, Flat Files etc;
* Performance tuning of data pipelines
Key Skills
* 3+ years' experience in a similar data engineering role ie building data pipelines for either a Data Warehouse and/or a Data Lake
* 2+ years' experience using Python
* 2+ years' experience of using AWS cloud computing services
* 1+ years' experience using Linux or Unix
* Strong experience using SQL for querying data in any relational database
* Agile development approach with due regard for configuration management, specification/documentation, review and testing.
* Technically strong, with recent hands-on experience
* An ability to advise senior stakeholders, work comfortably without definition and apply a progressive technical approach to any problem
Desirable Competencies:
* In depth experience of any of the following AWS services will be a significant advantage: Lambda, Glue, Athena, Step Functions, Cloudformation, DMS, EMR, EC2, IAM, VPC, Cloudwatch, SQS, S3
* Strong experience using SQL for querying data in SQL Server
* In depth knowledge of utilizing Change Data Capture processes, particularly on SQL Server
* In depth knowledge of utilizing Replication processes, particularly on SQL Server
* Experience of "Big Data" technologies eg Spark, Hadoop, AWS EMR, Data bricks etc.
* Experience of Azure Cloud Computing Services
* Built continuous integration/deployment pipelines in any technology
Please send your CV or call.