08/24/2026 updated
partially available
info: Available evenings and weekends
Data Engineer | Streaming and Cloud Data Platforms
Sfax, Tunisia
Only remote
Engineer's Degree in Data Engineering (in progress, 2023-2028), Faculty of Sciences of SfaxApache AirflowCloud EngineeringData ArchitectureData TransformationData Transformation ServicesData WarehousingIBM InfoSphere DataStagePython (Programming Language)PrometheusDataOpsAzure Data LakeDatabase EnginesData StreamingDatadogCloud Platform System
Streaming and Distributed Data Processing
Expertise in building and operating real-time streaming pipelines using Apache Kafka (KRaft), Kafka Connect, Apache Spark, Spark Structured Streaming, Apache Beam, and Apache Airflow. Design and delivery of ingestion and transformation layers that act high data volumes reliably.
Cloud Data Platforms (GCP and Azure)
Hands-on experience with Google Cloud Platform services including Dataflow, Pub/Sub, BigQuery, GCS, and Dataform, as well as Azure services such as Databricks, Lakeflow, and VNet. Provisioning of cloud infrastructure with terraform and implementation of idempotent writings and dead letter handling.
Lakehouse and Medallion Architecture
Design and implementation of Delta Lake-based lakes with bronze, silver, and gold layers, including incremental REST ingestion, data quality checks with Great Expectations, and observability with Prometheus and Grafana.
Infrastructure as Code and DevOps
Provisioning and management of infrastructure using Terraform, Docker, and Kubernetes. CI/CD automation with GitHub Actions and monitoring with Prometheus and Grafana.
Machine Learning and Anomaly Detection
Application of scikit-learn, XGBoost, and Isolation Forest for anomaly detection tasks, including wildfire risk indexing and fraud detection. Integration of RAG pipelines using Ollama and ChromaDB for automated report generation.
Programming Languages
Proficiency in Python, SQL, Java, TypeScript, JavaScript, and C++, applied across data engineering, backend development, and web application contexts.
Web and backend development
Development of full-stack applications using Angular, React, .NET, and FastAPI, including REST API design and database integration.
Data Quality and Observability
Implementation of data quality gates using Great Expectations and pipeline observability using Prometheus and Grafana to ensure reliability across data platforms.
Experience
Professional experience0 - 5 years
Freelancer since2024
Languages
ArabicNative speakerEnglishFluentFrenchFluent
Project history
Regular contributor to streaming and data infrastructure projects, mainly reliability fixes, connector work, and developer tooling.
Built bronze, silver, and gold Delta Lake layers on Backblaze B2, fed by incremental REST ingestion with Great Expectations checks gating each promotion. Implemented Prometheus and Grafana for observability, Isolation Forest anomaly detection, and a wildfire risk index on the gold layer.
Used Kafka and Spark Structured Streaming to score transactions on arrival. Integrated a RAG step using Ollama and ChromaDB to draft Suspicious Activity Reports against CTAF reporting rules.