DATA ENGINEER
Wunderman thompson commerce
(Marketing, PR and Design, 1000-5000 employees)
Keywords
Microsoft Azure
Airflow
PostgreSQL
Git
HTML
Java (Programming Language)
JavaScript (Programming Language)
Application Programming Interfaces (APIs)
Amazon Web Services
Amazon S3
Skills
Power BI, DAX, SQL, Python, PySpark, AWS, Snowflake, Data warehouse, Redshift, Prefect, S3, GCP, IAM, BigQuery, Docker, Git, Digital Ocean, Filebeat, Logstash, Elasticsearch, Kibana, Mariadb, Linux, REST API, backend, node.js, puppeteer, PostgreSQL, PL/pgsql, continuous deployment, Azure Web App, Azure, Redis, ETL, Airflow, Json, Pandas, search engine, Flask, HTML/CSS, Mozilla, Data Analysis, data pipeline, open source, APIs, Cassandra, SQL server, MongoDB, Neo4j, Bigtable, MySQL, Big, Apache Airflow, Apache Kafka, Spark, Hadoop, Hive, ELK stack, Tableau, MSBI, SSIS, SSAS, SSRS, Talend, Selenium, Git/Github Actions, Express, js, MS Azure, D3.js, Programming, PL/SQL, R, C/C++, JavaScript, Java, Bash
Project history
03/2022
-
Present
* Analysing and diagnosing the existing Data warehouse implemented in AWS Redshift/Athena for performance and deadlock issues.
* Developing PoC's, benchmark tests and reports for alterntive solutions(Python, Prefect, S3, GCP, AWS, IAM, Snowflake, BigQuery, Docker, Git).
* Defining an automated migration solution and startegy to new Data warehousing environment(Snowflake) .
* Developing PoC's, benchmark tests and reports for alterntive solutions(Python, Prefect, S3, GCP, AWS, IAM, Snowflake, BigQuery, Docker, Git).
* Defining an automated migration solution and startegy to new Data warehousing environment(Snowflake) .
07/2022
-
10/2022
FREELANCE DATA ENGINEER
Subliminator
(Consumer goods and retail, 10-50 employees)
- Implementing a full Analytics and reporting module for a B2B E-commerce company in the netherlands based on the ELK stack(provisioning Linux server, docker for containerasation, parsing logs via TCP, indexing and mapping creation in ELASTICSEARCH, developping KPI's and establishing multiple detailed real time dashboards via Kibana)
06/2021
-
01/2022
PART-TIME SOFTWARE & DATA ENGINEER
Acentium
(Internet and Information Technology, 50-250 employees)
* Implementation of a REST API to serve as the backend for a PDF reporting engine(Express/node.js, puppeteer, D3.js, PostgreSQL, PL/pgsql).
* Handling permissions/security for AAD through Microsoft MSAL and continuous deployment via Azure Web App service.
* Deploying solution via Azure Web App Service & Implementing a cache layer for existing web visulizations using Azure Cache for Redis.
* Handling permissions/security for AAD through Microsoft MSAL and continuous deployment via Azure Web App service.
* Deploying solution via Azure Web App Service & Implementing a cache layer for existing web visulizations using Azure Cache for Redis.
07/2019
-
09/2020
INTERN DATA ENGINEER
Novancy One
(Banks and financial services, 50-250 employees)
* Desiging mapping model, scoring et language indexing parameters for ElasticSearch.
* Developing ETL and Data migration pipeline from PostgreSQL to Elasticsearch via Airflow(Python, SQL, Json, Pandas,..).
* Dashboarding detailed candidats statistics using Kibana & creating search engine interface for the HR staff(Flask, HTML/CSS).
* Optimising HR process by up to 30%.
Aca demic & Personal Projects
Data pipeline & monitoring platform for Mozilla's daily builds
BiG DATA PROJECT
* Preprocessing 400GB+ of flat files & setting Filebeat agent for the collection of Mozilla build logs.
* Configuring Logstash for streaming preprocessed files to Elasticsearch.
* Desiging a detailed Dashboard for monitoring builds via Kibana.
Real-time Financial Market Data Analysis App
REAL TiME DATA STREAMiNG ARCHiTECTURE PROJECT
* Developing a real time stock market data pipeline with event handling using Kafka and open source APIs.
* Setting up Cassandra as Data Warehouse for historical and real time financial data.
* Implementing Dashboards for time series data using Bokeh, and containerizing the project via Docker.
* Developing ETL and Data migration pipeline from PostgreSQL to Elasticsearch via Airflow(Python, SQL, Json, Pandas,..).
* Dashboarding detailed candidats statistics using Kibana & creating search engine interface for the HR staff(Flask, HTML/CSS).
* Optimising HR process by up to 30%.
Aca demic & Personal Projects
Data pipeline & monitoring platform for Mozilla's daily builds
BiG DATA PROJECT
* Preprocessing 400GB+ of flat files & setting Filebeat agent for the collection of Mozilla build logs.
* Configuring Logstash for streaming preprocessed files to Elasticsearch.
* Desiging a detailed Dashboard for monitoring builds via Kibana.
Real-time Financial Market Data Analysis App
REAL TiME DATA STREAMiNG ARCHiTECTURE PROJECT
* Developing a real time stock market data pipeline with event handling using Kafka and open source APIs.
* Setting up Cassandra as Data Warehouse for historical and real time financial data.
* Implementing Dashboards for time series data using Bokeh, and containerizing the project via Docker.
Local Availability
Only available in these countries:
Morocco
Currently based in Morocco but would have flexibility traveling depending on project
