Upgrade Post project

Data Engineer (SENIOR)

Stockholm County, Solna  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Programming SQL Server Python SQL performance tuning SQLAlchemy pandas Spark SQL Spark Streaming pySpark requests

Description

We are looking for Data Engineer (SENIOR) for a long term project

Locations: Solna, Sweden
Language- English
Start- ASAP

Job Description:
Data Engineer (SENIOR)
Information regarding business & team Data Engineer will join the YIPAA Analytics Team and is supposed to join the DIS Team working with Distribution Sweden.

Tasks & responsibilities Technical skills:
- SQL and T-SQL stored procedure programming
- Python programming, python unit testing
- PySpark, Spark streaming, Spark SQL
- Building, packaging pyspark jobs
- Git and CICD
- Spark performance tuning, interpreting execution plans
- Optional – Airflow or Argo knowledge
- Pandas, Requests, SQLAlchemy and working with JSON+XML in python
- Kubernetes awareness
- Jupyter/Azure Data Studio

Required experience / expertise
Demonstrated experience on building PySpark pipelines for 2 years

Demonstrated experience of SQL development, ability to analyze SQL execution plans and troubleshooting

Data modelling using star schemas

SQL Server 2016 and above

Note : Candidate should be in Europe for more than 5 years

Eligible candidates, please share their resume/CV at

Regards
CosMicIT
Start date
ASAP
From
CosMicIT GmbH
Published at
01.10.2021
Contact person:
Mritunjay jha
Project ID:
2218238
Contract type
Freelance
To apply to this project you must log in.
Register