Description
We are currently looking for a Data Scientist Specialist and a Big Data Expert for the construction and further development of a data analysis platform (DAP). A Data Warehouse application is migrated to a data lake in the AWS Cloud. The implementation of the platform is done with the current standard technologies (AWS Serverless and Hadoop), while architectures can be expanded and scaled as required.As a Data Scientist Specialist, you will conceptualize and develop data flows with AWS technologies and Apache Spark / Scala. Additionally, you will be required to describe, coordinate and document the functional and non-functional requirements (NFA) in the form of epics, features and user stories. Along with that you will be creating technical documents (e.g. use cases / user stories, product backlog, functional system descriptions, technical service descriptions, technical interface descriptions). You will consult, implement and design the technical requirements for the IT systems, and you will also build and evaluate the functional specifications documentation of requirements in Jira Creation. Lastly you will be in charge of implementing the test cases organization and workshops.
As a Data Scientist Specialist / Big Data Expert you will provide suggestions on setting up and using AI models in the AWS. Furthermore, you will implement machine learning models / data pipelines and will participate in project-related meetings to clarify technical details as well as the project-related ceremonies in the Scrum team. You need to have know-how transfer in the area of MLOps and previous experience with analyzing errors in ML pipelines.
Project details:
- Starting period: 27.09.2021
- Ending period: 31.12.2021 (possible extension)
- Working days: 63 days
- Full-time (5 days/week)
- Location: Remote / Frankfurt
- Languages: German
Experience: Data Scientist Specialist
- At least 3 ETL tools (Spark, Nifi, Jupyter, ...)
- Architecture and implementation knowledge in the AWS stack (e.g. ECS, EMR, Athena, Glue, Redshift, Kinesis or MSK, Lambda, Python)
- Relational databases, SQL, ETL and BI tools
- Programming with Apache Spark and Scala
- Problem-solving / work organization know-how
- Stakeholder management
- Agile environment (e.g. Scrum)
- Agile requirements engineering (e.g. user journeys, EPICs, features, user stories, user story mapping)
- AWS Certified Solutions Architect, AWS Certified Developer
Experience: Data Scientist Specialist / Big Data Expert
- Set up data pipelines in the AWS
- AI / machine learning including the production of ML models
- Python
- AWS Sagemaker
- Agile environment (e.g. Scrum).
- Agile requirements engineering (e.g. user journeys, EPICs, features, user stories, user story mapping)
- AWS Certified Solutions Architect, AWS Certified Developer
- Stakeholder management
Do you see yourself as the perfect fit? We would be happy to work with you!