Description
Templeton are seeking a Cloud DataOps Engineer join their Cloud Native Engineering team to help shape the future of data science for our global client.
As a DataOps Engineer you will work as part of a team of global DataOps Engineers who partner with data science teams throughout the organization with the goal of improving products, features, and flow reliability.
Our Data Science Tech stack: Azure & AWS, Terraform, Jenkins, Docker, EKS (Kubernetes), KubeFlow, ML Flow, Pachyderm, Jupyter Note books and much more
On a Normal Day, You Will
- Design solutions to deeply optimize the big data computing and storage setup, to enable new business needs
- Design and build the infrastructure for data extraction, preparation, and loading of data from a variety of sources
- Implement tools and processes to automate the management of our infrastructure
- Provide guidance to improve resilience and scalability of our Data Platform
- Implement and optimize platform configurations for cost, security, and performance
- Implement monitoring and alerting solutions to provide insight into overall Data Platform health
- Craft and maintain documentation of infrastructure and processes,
You Have
-
Grit, drive and a deep feeling of ownership
-
BS/MS with quantitative focus (eg Computer Science, Economics, Mathematics, Physics, Statistics) or equivalent practical experience,
-
Deep knowledge of AWS infrastructure and automation with experience setting-up, managing, and maintaining large-scale infrastructure and platforms (EC2, RDS, S3, VPC, etc.),
-
Experience of automation and provisioning approaches, using tools such as Terraform, Bash, PowerShell, etc,
-
Familiar with operations of third-party Big Data Platform and Infrastructure-as-a-Service (PaaS/IaaS) technologies (ie, Databricks),
-
Experience of agile project management approaches and tools (eg Atlassian Jira/Confluence),
-
Experience in setting up server-less and data streaming technologies (lambda, Kinesis, Kafka, DataBricks, Spark),
-
Experience in setting ETL/data pipeline solutions
-
Fundamental knowledge of security best practices in cloud
-
Ability to quickly learn, understand and work with new and emerging technologies, methodologies, and solutions in the cloud and IT technology space,
-
Strong communication and interpersonal skills with attention to detail, highly agile and self-starter.