Description
An international banking client of ours is looking for a senior Data Engineer. As a Data Engineer you will further develop and maintain the clients Data products and further develop the architecture of our platform and create new architectures for incoming projects.
As a Data Engineer you are the single most important part of the team. You are able to combine Software Engineering with Machine Learning. Without your work, nothing moves, data sits idle and useless in a DB. You are the one combining these sources in Real Time, distributed systems to handle large amounts of data loads in no-time. You work on the APIs that deliver personal and relevant insights to the customer.
Your passion is to work with the latest and greatest technologies in the field of Data Engineering. You will work as an engineer on different projects. With this team, you will be building new capabilities, help to launch new initiatives.
Technology Stack
Within the 1:1 Docker/Kubernetes/OpenShift
* Kafka
* Spark
* Flink
* REST API
* Cassandra (and other noSQL DBs)
* Scala
* Python
* Polymer (nice to have)
* Airflow (nice to have)
Key Competencies
* Knowledge of data manipulation and transformation, eg SQL
* Hands-on experience building complex data pipelines eg ETL
* Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (Hadoop/Spark and/or Kafka/Flink)
* Programming in Scripting languages, eg Python
* Programming in a statically typed language, eg Scala
* Experience in setting up both SQL as well as noSQL databases
* Deployment and provisioning automation tools eg Docker, Kubernetes, Openshift, CI/CD
* Bash Scripting and Linux systems administration
* Security, authentication and authorisation (LDAP/Kerberos/PAM)
* Affinity with Predictive Analytics, Data Science
If this sounds like a good opportunity for you then please send me a copy of your updated CV.