11/04/2026 updated


100 % available
Data Engineer | Databricks · PySpark · Microsoft Fabric · Azure · Snowflake
Pristina, Kosovo
Only remote
B.Sc. Computer Science and Engineering (UBT, in progress)About me
Data Engineer with 4 years building cloud data platforms on Databricks, Microsoft Fabric, Azure, GCP, AWS and Snowflake. PySpark, Delta Lake, SQL, Python; lakehouse/medallion, data modeling, data quality, cloud migration, GenAI/RAG pipelines. Certified Databricks DE, GCP ACE, Claude Architect
Delta LakeAzure DevOpsAmazon Web ServicesData AnalysisAutomationMicrosoft AzureBusiness IntelligenceBig DataGoogle BigQueryBusiness AnalysisCloud ComputingCloud EngineeringData ArchitectureData CleansingData Governance
• Data Engineering: lakehouse architecture, medallion layering (bronze/silver/gold), batch and streaming pipelines, ETL/ELT, data modeling (dimensional, SCD2), data warehousing, event-driven patterns, structured and unstructured ingestion, cloud migration and re-platforming
• Spark & Lakehouse: Apache Spark, PySpark, Spark SQL, Structured Streaming, Delta Lake, Auto Loader, Unity Catalog, Lakeflow, Spark performance tuning (partitioning, Z-ordering, file compaction, join and query tuning)
• Programming: Python, SQL, PySpark, REST APIs
• Cloud & Platforms: Databricks, Microsoft Azure (Data Factory, Synapse, Data Lake Storage, Azure Databricks), Microsoft Fabric (Lakehouse, Pipelines), Google Cloud Platform (BigQuery, Cloud Storage, Pub/Sub, Compute Engine), AWS (S3, EC2), Snowflake (Snowpipe, Streams and Tasks, Dynamic Tables), multi-cloud
• Orchestration & DevOps: Databricks Workflows, Azure Data Factory, Fabric Pipelines, Git, CI/CD (Azure DevOps), n8n
• Data Quality & Governance: data quality rules and reconciliation, observability (freshness, volume, SLA monitoring, alerting), data lineage, RBAC and masking policies, source-to-target mapping, GDPR-aware data handling
• GenAI & AI Data: RAG pipelines, LLM data preparation, Snowflake Cortex (Search, Analyst, Agents), LLM-powered automation and migration accelerators, model-ready datasets
• BI & Analytics: Power BI, Tableau, KPI dashboards, Power Query, statistical analysis
• Databases: PostgreSQL, MySQL, NoSQL
• Ways of Working: Agile, requirements discovery, stakeholder partnership, business process analysis, cross-functional collaboration with data scientists, analysts and business teams
• Certifications: Databricks Certified Data Engineer Associate, Google Cloud Associate Cloud Engineer, Claude Certified Architect – Foundations (Anthropic)
• Languages: Albanian (native), English C1, German C1
Experience
Professional experience0 - 5 years
Freelancer since2024
Languages
GermanFluentEnglishFluentAlbanianNative speaker
Project history
• Build and maintain production batch and near-real-time pipelines with PySpark, Spark SQL, and Delta Lake (Structured Streaming, Auto Loader, incremental loads) on Databricks and Microsoft Fabric
• Implement lakehouse architecture with medallion layering (bronze, silver, gold) and dimensional/SCD2 data models delivering curated datasets for reporting, analytics, and ML
• Set up data quality, governance, and observability: rule-based validation, freshness and volume checks, SLA monitoring and alerting, Unity Catalog RBAC and lineage
• Optimize Spark and Delta workloads (partitioning, Z-ordering, compaction, join and query tuning) and orchestrate jobs with Databricks Workflows, cutting processing time and compute cost
• Work with stakeholders, analysts, and data scientists to challenge assumptions and propose simpler, more scalable alternatives before building; document pipelines, lineage, and data definitions
• Developed an LLM-powered migration accelerator that re-platforms legacy BI and ETL workloads into PySpark and Lakeflow pipelines on Databricks, with human review gates, automated validation, and cost tracking
• Built Snowflake ELT pipelines (Snowpipe, Streams and Tasks, Dynamic Tables, SCD2, RBAC and masking policies) and GenAI assistants using RAG and agents with Snowflake Cortex (Search, Analyst)
• Led data engineering on SPAR, Deehive's flagship project: architected a Spark/PySpark lakehouse on Azure and Microsoft Fabric (Fabric Lakehouse, Delta tables) for high-volume batch and near-real-time ingestion, cleansing, and delivery of model-ready data for AI and analytics
• Defined and maintained data quality rules and controls (completeness, validity, consistency) across 10+ sources, with automated alerting on rule breaches and data freshness
• Designed and orchestrated ETL/ELT workflows with Azure Data Factory, SQL, and Python, reducing reporting turnaround from days to hours
• Introduced Git-based versioning and CI/CD (Azure DevOps) for pipelines and notebooks, removing manual deployment steps and keeping dev, test, and prod consistent
• Used Azure Data Lake Storage, Azure Databricks, and Synapse to build scalable storage, processing, and serving layers for BI, analytics, and data science teams
• Delivered Power BI data products that became the primary tool for performance monitoring, customer segmentation, and KPI tracking across the company
• Managed end-to-end data collection, validation, and reporting across multiple projects, and built standardized reporting templates that reduced onboarding time and improved consistency
Certificates
Databricks Certified Data Engineer Associate
Databricks2026
Google Cloud Associate Cloud Engineer
Google Cloud2026
Claude Certified Architect – Foundations
Anthropic2026