Attachments
Timor-Abdulaieve-CV-english_311023.pdf
Please upgrade to the business membership to download freelancers' CVs.
Skills
10+ Years experience in Data engineering, Data architecture, DataOps, Information extraction and building complex distributed processing pipelines at scale.
Apache Spark, Pipeline Construction, Data processing, Data Mining, Machine learning, Big Data, Big Data Analytics, Natural Language Processing (NLP), Web Crawling, Apache Solr, elasticsearch, lxc, MongoDB, Apache Cassandra, Java, hdfs, Cloudera, Python, AWS, Platform, GCP, Git, Java Spring, Solr Cloud, software architecture, Apache Maven, Information retrieval
Project history
Key responsibilities:
- - Setting up strategic objectives: Vision & Mission Data Lake DB Netz AG
- - Assessment of technical components and processes
- - Initiation and execution of Process and Technical improvements
- - Conception of Data Governance
- - Conception and Development of Data Lake Operations Framework
- - Enrichment of Data, ML and AI Use Cases
Key responsibilities:
- - Migration of existing Cloudera based Datalake to native AWS
- - Migration and optimisation of existing pipelines to AWS
(Glue/EMR)
- - Designing and development of reusable components for ETL
pipelines
Technologies:
Spark, Glue, EMR, Scala, Python, CDK, CloudFormation, Lamda, Athena, RDS, Gitlab CI/CD, Docker
Data governance and Compliance / Data Lake team.
Building Compliance enforcement agent according to GDPR and Antitrust rules.
Key responsibilities:
- - Developing Data Compliance enforcement agent
- - Implementation of pipelines CI and CD
- - Monitoring and Alerting
- - Ensure production readiness
Technologies:
Delta Lake, EMR, AWS, Presto, Hive, Kubernetes, Docker, Java, CI/CD.