Cloud Data Engineer
E.LECLERC
Keywords
Amazon Web Services
Cloud Computing
Continuous Integration
Infrastructure Management
Java (Programming Language)
JavaScript (Programming Language)
Airflow
Big Data
BigQuery
Cloud Computing Security
Skills
Cloud Computing
Expertise in GCP and AWS cloud platforms, with certifications in GCP Professional Cloud Security Engineer and AWS Certified Solutions Architect.
Data Engineering
Proficiency in designing and implementing scalable data pipelines, working with various databases including BigQuery, MySQL, Oracle, PostgreSQL, MongoDB, and DynamoDB.
Programming Languages
Strong skills in Python, Java, PySpark, JavaScript, and Scala for developing data solutions and applications.
DevOps & CI/CD
Experience with Jenkins for continuous integration and deployment, and Docker for containerization.
Big Data Technologies
Proficiency in Apache Spark for large-scale data processing and analysis.
Data Orchestration
Skilled in using Cloud Composer (Airflow) and Talend for workflow management and data integration.
Infrastructure as Code
Expertise in Terraform and Ansible for automating infrastructure provisioning and management.
Monitoring and Logging
Experience with ELK stack (Elasticsearch, Logstash, Kibana) for monitoring and log analysis.
Expertise in GCP and AWS cloud platforms, with certifications in GCP Professional Cloud Security Engineer and AWS Certified Solutions Architect.
Data Engineering
Proficiency in designing and implementing scalable data pipelines, working with various databases including BigQuery, MySQL, Oracle, PostgreSQL, MongoDB, and DynamoDB.
Programming Languages
Strong skills in Python, Java, PySpark, JavaScript, and Scala for developing data solutions and applications.
DevOps & CI/CD
Experience with Jenkins for continuous integration and deployment, and Docker for containerization.
Big Data Technologies
Proficiency in Apache Spark for large-scale data processing and analysis.
Data Orchestration
Skilled in using Cloud Composer (Airflow) and Talend for workflow management and data integration.
Infrastructure as Code
Expertise in Terraform and Ansible for automating infrastructure provisioning and management.
Monitoring and Logging
Experience with ELK stack (Elasticsearch, Logstash, Kibana) for monitoring and log analysis.
Project history
09/2022
-
Present
Migration of data warehouse from on-premise to Google Cloud, implementing scalable data pipelines and models to support business requirements.
11/2020
-
09/2022
Data Engineer GCP
WUEST PARTNER
Worked on various data projects in the real estate domain, including building ETL workflows, data monitoring, and developing REST APIs for asset management.
09/2019
-
10/2020
Apprentice Data Integrator
Amfine Services
Automated data acquisition, processing, and storage pipelines, implemented reporting tools, and set up API gateways for database management.
09/2018
-
09/2019
Apprentice BI
Minister of High Education
Developed a Master Data Management system, collected and aggregated data from various sources, and created dashboards for data visualization.
05/2018
-
07/2018
Stagiaire
Galilée Institute Laboratory
Implemented a Deep Learning model for image recognition, including image labeling and facial recognition tasks.
Certifications
Local Availability
Open to travel worldwide
