Description
GCP Data Engineer - Remote
Help build a cutting edge data platform in a GCP cloud environment.
Analytics / Machine Learning / Artificial Intelligence solutions will be developed and run on this platform.
Tasks:
- Build data pipelines that will be used to prepare, provision and version data for AI / ML model training
- Advise Data Scientists on Data Engineering approaches when developing and operating ML models on the GCP data platform
- Create and implement microservcies to make the ML models available via a REST API
- Provide function within the microservices that will allow monitoring of the ML Models in production
- Deploy microservices in the GCP Data platform and ensure high stability and availability
Required Experience:
- GCP
- Terraform
- GitLab
- Kuberneter / Docker
- Airflow / MLflow
- BigQuery & Big Table
- Python / PySpark / SQL
- REST API