Description
Flint is looking for Data engineer profiles for Spark, Scala programming language is mandatory.
- Min 5 years Hands-on development experience in Shell Scripting, Spark, Scala, Python, Terraform Scripting programming language
- Debugging/troubleshooting of Spark jobs
- Performance tuning experience for Hadoop/Spark jobs
- Hands-on development experience on Google Cloud Platform, on
Following Cloud services: Cloud Composer, Big query, Pub sub, Data PROC, Data flow, CDAP, Big table, GCS
- Hands-on development Experience on Airflow DAG creation.
- Hands-on development experience on Data migration Pipeline creation on PubSub with DataProc/DataFlow.
- Hands-on development Experience on Cloud function creation.
- Hands-on development experience in Big Query and performance tuning of BQ queries, BQ Data Load Jobs
- Good Telecom domain knowledge