Description
Data Platform Engineer£575 Per Day (Umbrella)
Stevenage
6 months
Inside IR35
Responsibilities:
- Given a well-specified data framework problem, implement end-to-end solutions using appropriate programming languages (eg python, Scala, or go), open-source tools (eg Spark, elasticsearch, ...), and cloud vendor-provided tools (eg Amazon S3)
- Leverage tools provided by Tech (eg infrastructure as code, cloud ops, devops, logging/alerting, ...) in delivery of solutions
- Write proper documentation in code as well as in wikis/other documentation systems
- Write fantastic code along with proper unit, functional, and integration tests for code and services to ensure quality
- Stay up-to-date with developments in the open-source community around data engineering, data science, and similar tooling
Requirements:
- Masters degree in Computer Science with a focus in Data Engineering or Software Engineering, etc. plus 2 years job experience, or Bachelor's degree in Computer Science plus 4 years job experience
- Experience with common distributed data tools (Spark, Kafka, Hive, Presto, etc.)
- Experience with basic data architecture (eg optimizing physical layout for access patterns)
- Experience with basic search engines/indexing (eg Elasticsearch, Lucene)
- Experience in writing Python, Java, Scala, Go, and/or C++
Desireable Requirements:
- Comfortable with basics of data architecture (eg optimizing physical layout for access patterns)
- Comfortable with basics of search engines/indexing (eg Elasticsearch, Lucene)
- Experience with agile software development
- Experience building and designing a DevOps-first way of working
- Demonstrated experience building reusable components on Kubernetes or similar ecosystem
- Experience with agile software development
- Experience with public cloud provider like AWS, Azure and GCP