Description
Senior Data Engineer | |Python | Scala | DevOps | Hadoop | Azure| AWS | Java | Apache Airflow
Title: Senior Data Engineer
Company: FinTech
Location: London, Remote.
Rate: Up to £625
IR35: Outside
Duration: Up to 12 Months
The Role:
You will be working for one of most recognised Start-Up's in the FinTech industry. You need to display a deep passion for Data Engineering and someone that has a proven track record of adapting to new environments rapidly.
Responsibilities:
- Engineering and optimising Machine Learning and process algorithms for data ingestion.
- Implementing and integrating large data models into robust Data Pipelines.develops data models,
- Processing pipelines and Back End services supporting data science.
- Innovating the infrastructure eco-system, CI/CD, and product optimisation.
- Owning technical solutions for the Azure Data Lake.
- Providing high standard production support for all issues.
Requirements:
- Bachelors or Masters in Computer Science, engineering, or related technical field.
- Professional experience in building pipelines.
- Profficent programmer in Python and a good understanding of other Languages (Scala, Java, C++)
- Exposure to distributed systems such as Spark, Presto,Hadoop, Spark, Hive, Impala, PrestoDb, Kafka
Senior Data Engineer | |Python | Scala | DevOps | Hadoop | Azure| AWS | Java | Apache Airflow