04/29/2025 updated

**** ******** ****
100 % available

Data Engineer, Software Entwickler, Data Engineer

Tallinn, Estonia
Germany
Tallinn, Estonia
Germany

Profile attachments

Lebenslauf_Enn_Petersoo.docx
CV_Enn_Petersoo.docx

HTMLJava (Programming Language)JavaScriptPHPSpring SecurityApplication Programming Interfaces (APIs)Agile MethodologyApache AirflowAliasingAmazon Web ServicesAmazon Elastic Compute CloudAmazon S3Apache TomcatBusiness LogicAuthenticationsTest AutomationMicrosoft AzureBash ShellOracle WebLogic ServerBig DataC++ (Programming Language)Cascading Style Sheets (CSS)Apache ImpalaComputer SecurityInformation SystemsContinuous IntegrationInformation EngineeringData GovernanceExtract Transform Load (ETL)Data ManagementData MigrationData SecurityIBM DB2Database DesignDocument Management SystemsWeb DevelopmentEclipseLinkEnterprise JavaBeansElasticsearchOnline BankingJava Platform Enterprise Edition (J2EE)FoxProGoogle Web ToolkitsGroovyGrails (Framework)Apache HadoopApache HBaseHibernateApache HiveHP Service Manager SoftwareWeb ServersIBM Rational Unified ProcessIBM Websphere Application ServerIT ManagementInventory Management SoftwareJava Message Service (JMS)Java Persistence APIJava ServletSpring FrameworkApache StrutsjQueryJUnitPython (Programming Language)Kerberos (Protocol)Load TestingMachine LearningApache MavenMetadataMongoDBNatural Language ProcessingNoSQLObject-Oriented Software DevelopmentApache OozieOracle DatabasesOracle ApplicationsScrum MethodologyQuery OptimizationRabbitMQTensorFlowData Access LayerClouderaSwaggerSecurity Assertion Markup Language (SAML)SAS (Software)ScalaSeleniumServer-SideSimple Object Access Protocol (SOAP)SoapUIApache SolrSQL DatabasesSQLAlchemySystems ArchitectureSalesforce TableauUMLWeb ApplicationsWeb ServicesExtensible Markup Language (XML)OpenapiJupyter NotebookData ProcessingGoogle CloudPostmanPyTorchSpring MVCFlaskApache SparkSpring BootBackendGitFastAPIpandasPytestData LakeAngularJSGitlab-ciApache FlumeScikit LearnIntegration TestsKubernetesRational RoseVba Programming LanguageDaskApache KafkaApache NifiFront End Software DevelopmentRestful ApiTerraformCode RefactoringWebmethodsDockerJenkinsAlteryxWeb ApiMicroservices
Agile, Airflow, Apache Airflow, aliases, Alteryx, Elastic Cloud, S3, AWS, Angular, Flume, HBase, Hadoop, Hive, Apache Kafka, Kafka, Maven, Apache NiFi, Nifi, Oozie, Solr, Apache Spark, Spark, Struts, Tomcat, API, test automation, Backend, back-end, Bash Scripting, Big Data, application logic, C++, CSS, Cloudera, Impala, Refactoring, security architecture, CI/CD, Dask, data access layer, Data Governance, Enterprise Data Governance, Data Lake, master data, Data migration, data processing, data access, database design, Docker, document management System, EclipseLink, Elasticsearch, EJB, XML, ETL, FastAPI, Flask, FoxPro, Frontend, front-end, Git, Gitlab CI, GCP, Google Web Toolkit, GWT, Grails, Groovy, HP Service Manager, HTML, Hibernate, DB2, RUP, IBM Websphere, IT Management, Data Engineer, Information System, Informatics, integration tests, integration test, Integration Testing, Inventory software, JQuery, Java, JMS, JPA, JavaEE, J2EE, JEE, Servlets, Javascript, Jenkins, JUnit, Jupyter notebook, Kerberos, Kubernetes, K8S, Load testing, Machine Learning, Metadata, backend services, Azure, Azure Cloud, Azure DevOps, MS Excel, Mongo DB, MongoDB, NLP, NoSQL Databases, NoSql, OOAD, Online Banking, OpenAPI, Oracle, Oracle database, WebLogic, PHP, Pandas, Postman, pytest, Python, PyTorch, Query tuning, RabbitMQ, Rational Rose, REST API, Rest-API, SAS, SQL Databases, SqlAlchemy, Scala, scikit-learn, Scrum, SAML, Selenium, Server-side, SOAP, SoapUI, Spring, Spring Security, Spring Boot, Spring MVC, Swagger, System Architect, Tableau, TensorFlow, Terraform, UML, Authentication, Visual Basic, VBA, WebAPI, web application, web-based, web frontend, web client, Webservices, Web services, webMethods

Experience

Professional experience10+ years
Freelancer since2010

Languages

GermanFluentEnglishFluentRussianGoodSpanishGood

Project history

Senior Python developer

European Central Bank

Banking & Financial Services

500-1000 team member

  • Migration of a legacy platform, implemented in FAME DB, to Python + Camunda (BPMS) + Hadoop.
  • Migration of business logic into Python, implementation of unit (PyTest) and integration tests. (Jupyter Hub).

Data Engineer

ENBW
* ETL implementation on Azure Cloud (Azure Logic Apps)
* Implementation of CI/CD pipelines (Azure DevOps)
Azure Logic Apps, Azure DevOps, Azure Pipelines, Python

ML Engineer

RTL
* Design, implementation and deployment of Elasticsearch ingestion workflow services on GCP
(Python, Big Query, Gitlab CI, K8S, Argo CD, Terraform).
* Design and implementation of a web client application (FastAPI) to query metadata for
different media types from several Elasticsearch clusters and postprocessing the results for
upstream services. Implementation of unit and integration tests (pytest).
* Elasticsearch cluster management.
* Elasticsearch index lifecycle management (updates, reindexing, aliases).
* Development and tuning of search and suggestion queries in Elasticsearch.
* Query tuning automation by creating interactive Jupiter notebooks and using ES Rank Evaluation
API.
* Load testing.

GCP, Python, FastAPI, Pandas, Elastic Cloud, Kubernetes, Docker, Big Query, Gitlab CI, Terraform

Software Entwickler

Allianz
* Design and implementation of a framework for visual design and generation of Kafka KSQL data
source transformations based on Informatica Data Governance Metadata.
* Backend implementation (Python and JavaEE)
* Implementation of a Rest API client for Informatica Enterprise Data Governance.
* Implementation of a Rest API client for Informatica Axon.
* Deployment of application logic as Azure Functions and WebAPI
* Azure DevOps
* Unit and integration test

Azure, Python, Kafka KSQL, Informatica EDC, Informatica Axon, Rest API

Data Engineer

Kühne + Nagel
* Design and implementation of ETL pipelines with Kafka.
* Design and implementation of a REST API-based MongoDB backends for a web frontend (Java,
Spring Boot, Angular).
* Implementation of unit and integration tests.
* CI/CD on Jenkins.

Java, Spring Boot, Kafka, NoSql, Angular, Rest API, MongoDB, Jenkins

Data Engineer

Blue Yonder GmbH
* Data modelling and database design (Exasol DB) of a client data access layer based on
aggregated and daily updated data (predictive analytics data for supermarket chains).
* Design and implementation of ETL workflows for the client data access layer (Python, Pandas,
SqlAlchemy, Dask, Apache Airflow).
* Implementation of REST API based data access services (Python, Flask, OpenAPI).
* Automated Unit and integration tests - design and implementation (pytest. Postman, Selenium)
CI/CD management on Jenkins.

Python, Pandas, Flask, Rest-API, Airflow, Dask, Exasol DB, Dash, Postman, Selenium, Jenkins, Docker

Big Data Engineer, Agile

Deutsche Bahn
* Layered data model design (storage/staging layer, analysis layer).
* Architectual design of a data processing and storage platform.
* Migration of the existing Data Lake to a new platform (from Hadoop to Dremio)
* Implementation of ETL Workflows using different tools and platforms (Hadoop, Alteryx, Apache
NiFi, Dremio, HBase, Kafka, Python, Scala).
* Dashboard creation with Tableau.
* Design and Implementation of Data (Micro)Services applications over REST API (Python, Nifi,
OpenAPI, Swagger, Docker).


Hadoop, Dremio, Alteryx, AWS, S3, Python, Scala, Apache NiFi, Kafka, Hbase, Open API, Tableau,
Docker, Kubernetes, Kerberos

Big Data Engineer, Scrum

Santander Bank
* Data Lake data model design.
* Data migration from SAS DWH to Hadoop (Cloudera).
* Entity resolution for client master data (NLP, similarity measures).
* Migration of reporting, implemented in MS Excel, into Hadoop (Impala, Spark).
* ETL implementation in Hadoop (Hive, Impala, Spark).
* ETL automation (Oozie Workflows).
* Design and implementation of lambda-Architecture (Real-time Ingestion and Analytical Lake in
parallel: Scala, Spark, Kafka, HBase).
* Entity resolution for client master data (Machine Lerning , Python, Spark, NLP, Similarity
measures)
* Solr - HBase integration for full text search.


Cloudera CDH (Apache Spark, Hive, Impala, Oozie), Kafka, Flume, Solr, Scala, Python (pandas, bokeh,
Jupyter notebook), Bash Scripting, Git

Consultant J2EE, JEE / Public service / Scrum

Mindware OÜ
* Refactoring of a security architecture of J2EE web application of the Statistics Estonia to
the CAS protocol (Central Authentication Service).
* Configuration of the WebLogic Security.
* Migration of J2EE application to Hibernate JPA and Spring MVC.
* Development of front- and backend components

* Development of the SIS II (Schengen Information System II generation) for the Estonian
Ministry of the Interior.
* Migration to the new version of Groovy and Grails
* Unit and Integration Testing


JEE, Servlets, Weblogic, CAS, SAML, Spring Security, JPA/Hibernate, Oracle, Groovy and Grails,
Spring MVC, JQuery, Spring, SOAP Webservices, Scrum

Consultant Java Frontend, JEE / Banking

tomaxx GmbH
* Development of a Web application for managing ATM
* Design and creation of JPA entity beans from Oracle database.
* Implementation of back-end services and creating JPA queries for the services.
* Implementation of JUnit tests.
* Development of front-end components with Google Web Toolkit.

JEE, EJB, JPA, EclipseLink, QueryDsl, Google Web Toolkit, HTML, CSS, JUnit, Oracle, RabbitMQ

Consultant HP Service Manager, webMethods / Telecom

Deutsche Telekom
* Extending the functionality of HP Service Manager (design and implementation) in areas of
incident and problem management.
* Integration of HP Service Manager with other systems through Web services interfaces.
* Functional Testing.

HP Service Manager, SOAP Webservices, SoapUI, Scala, Server-side Javascript, webMethods

Consultant Java Front-End / Scrum

Mindware OÜ
* Development of a web-based fund management Systems (Nasdaq OMX)
* Design and development of front-end components of Nasdaq OMX and its integration with backend
services.
JEE, Google Web Toolkit (GWT), Oracle, HTML, CSS, Tomcat, Axis Webservices, IBM Websphere

System Architect / Senior developer / Public service / RUP

MicroLink AS
* SOAT - Web Services Marketplace (SOA Trader, http://soatrader.com) components design and
realization
* VD (VAT declaration system for Estonian Tax and Customs Board) - maintenance
OOAD, UML, Enterprise Architect, J2EE, EJB 2, Spring, Hibernate, Tapestry, SOAP Webservices, SAAJ,
Maven, Struts, Weblogic, Oracle

Software developer / Banking

SEB Bank
* Development and integration of J2EE based components for Online Banking.
* Unit and integration tests
J2EE, EJB 2, IBM WebSphere, DB2, JMS, Sonic MQ, JUnit, TDD

Software developer / Public service / RUP

AS Datel
* 1. Design and realization of components for land information system of the Estonian Land Board
* Design and realization of a Customer Resource Management
web application for Seminars Department of AS Äripäev

Visual Basic, Rational Rose and automatic Test-Tools (Rational Robot), Oracle, PHP, JavaScript, XML,
Oracle
* 3. Requirements analysis for the document management System of the Estonian Defense Ministry
(use case and conceptual model)
Rational CASE and test automation tools (DevelopmentStudio, Rational Robot)

Freelancer

Small companies
* Inventory software applications for small companies, application for automatic creation of
crossword puzzles - C++) and other.
C++, Visual Basic, FoxPro, MS Excel VBA

Certificates

Large Language Models Professional Certificate

Databricks

2023

Contact form

Log in to get in touch

You need to be logged in to use the contact form.

Sign upLog in