IT

Senior Data Engineer (contract) - outside IR35

Gloucestershire,  United KingdomOn-siteFreelanceASAPDuration 6 months6 months (scope for more)
Posted by
Methods Business and Digital Technology Limited
Contact person
Generic Network
Project ID
2939957
Controles de AccesoAutomationMicrosoft AzureBatch ProcessingCloud ComputingDatabasesData ArchitectureInformation EngineeringData InfrastructureExtract Transform Load (ETL)Database DevelopmentDevOpsElasticsearchGithubPython (Programming Language)PostgreSQLDataOpsSecurity ManagingStorage SystemsData StreamingWorkflowsOktaAzure Data FactoryKubernetesReal Time DataApache KafkaSafety PrinciplesMultiplatformData PipelineDocker

Description

Senior Data Engineer (contract) On-site 5 days.

Outside IR35 - £500 - £600

The Role

We're looking for a Senior Data Engineer to join our team on a permanent basis. You'll design, build, and manage complex data infrastructure across hybrid on-premises and Azure cloud environments, enabling scalable, secure, and high-performing data operations.

What You'll Do

  • Build and maintain robust data pipelines (Python/Go/Azure Data Factory) for streaming and batch processing

  • Implement hybrid cloud and storage solutions (on-prem + Azure)

  • Work with Docker, GitHub and Kubernetes for containerisation and orchestration

  • Automate workflows and data flows with Azure Data Factory

  • Manage Real Time data streams with Kafka/NATS

  • Ensure security and compliance using Keycloak and best practice access controls

  • Design and optimise PostgreSQL and Elasticsearch databases

What We're Looking For

  • Strong Python skills for automation and data engineering

  • Hands-on ETL/ELT experience in hybrid environments

  • Proven expertise in hybrid cloud data architecture (on-prem + Azure)

  • Solid containerisation/orchestration experience (Docker, GitHub, Kubernetes)

  • Practical knowledge of Azure Data Factory

  • Event streaming experience (Kafka/NATS)

  • Understanding of security practices across multi-platform environments

  • Strong database development (PostgreSQL, Elasticsearch)

Nice to Have

  • 5+ years' data engineering experience across cloud and on-prem

  • Azure or related certifications

  • Some DevOps engineering exposure

Clearance
This role requires Security Clearance (ACTIVE SC).

Application form