Description
Our customer, is looking for a Data Engineer that can help with processing and refinement of data. The person will help take data from existing legacy dbs and migrate into the he Azure Cloud environment. Existing data will need to be processed and refined and put into new data models / loaded into graph databases and made accessible to end clients.Task:
- Specifically, further data sources have to be developed and integrated into a platform, existing modules have to be expanded and, if necessary, stabilized, and new models for data have to be created. In particular, challenges in terms of data quality must be dealt with.
- Connection of new data sources from the SAP PM
- Creation of certain relations in the data model with Python 3
- Modeling of faults and switch positions and integration into the database
- Modularization of some existing modules
- Modeling of gas assets
Skills
- Several years of project experience as a developer / data engineer
- Experience in cloud environments, ideally Azure Cloud
- Experience with data in the energy sector
- Strong Python developer knowledge
- Strong knowledge of computing libraries such as pandas and pyspark
- Knowledge of the use of query languages
- Very good knowledge of German, business fluent in English
Nice-to-have
- Knowledge of Java development
- Knowledge of Scala and Spark development
- Experience in the Azure cloud
- Experience with data in the energy sector
- Experience in No SQL Databases
- Experience in SAP
If interested please get in touch.