11/03/2026 updated
100 % available
Senior Azure Data Engineer / Architect - Databricks, Real-Time IoT Streaming, .NET
Dobra, Czech Republic
Only remote
Ing. (MSc), Physics: Optics & Quantum Electronics, Czech Technical University in PragueMicrosoft AzureC Sharp (Programming Language)Cloud EngineeringData ArchitectureAzure SQLAzure Data Lake.NET CoreAzure Data FactoryTerraformStream AnalyticsDatabricks
Senior Azure Data Engineer / Architect with 20 years in software and 8+ years building data platforms on Microsoft Azure. English-speaking, fully remote, based in the EU (Czechia, CET), own business entity.
CURRENT FOCUS: Azure Databricks lakehouse & real-time IoT streaming
• Real-time ingestion platform for 100 industrial plants / 500,000 sensors (~8,300 events/s, ~720M readings/day) built on Azure IoT Hub, Event Hubs, Stream Analytics and Azure Data Explorer. Self-healing, with automated monitoring and alerting.
• Databricks lakehouse unifying multiple third-party LIMS (lab) systems: Unity Catalog, medallion architecture, Spark Declarative Pipelines (DLT) with data-quality expectations, Lakeflow Connect.
• CI/CD with Databricks Asset Bundles, Azure DevOps and GitLab. Infrastructure as Code with Terraform across multiple environments.
LEADERSHIP & ARCHITECTURE
• 6 years as team leader of 15 developers (ABB), including remote team members: hiring, performance reviews, Scrum, CI/CD, code reviews.
• Software architect and product owner of microservice platforms (.NET, Kubernetes, MongoDB). Technical lead of a business-critical terminal automation system rolled out to ~10 container terminals (up to 5,000 trucks/day).
SKILLS
Databricks: Unity Catalog, Lakeflow Connect, Declarative Pipelines / DLT, Asset Bundles, Delta Lake, PySpark, Apache Spark
Azure: IoT Hub, Event Hubs, Stream Analytics, Data Explorer (ADX), Synapse, Data Factory, Functions, IoT Edge
DevOps / IaC: Terraform, Azure DevOps, GitLab CI/CD, Docker, Kubernetes
Engineering: C#, .NET, ASP.NET, microservices, Python, SQL, PostgreSQL, MS SQL, MongoDB
DOMAINS: Industrial IoT & manufacturing, laboratory data (LIMS), maritime & logistics, energy monitoring, medical devices.
EDUCATION: MSc (Ing.) in Physics, Czech Technical University in Prague: strong analytical and mathematical background.
Languages: English C1, Czech native. Available with 1 month notice for fully remote contracts.
Experience
Professional experience10+ years
Freelancer since2021
Languages
GermanBasic knowledgeEnglishFluentSpanishGood
Project history
Designed and built a cloud ingestion platform digitalizing cement plant operations for 100 plants with 500,000 sensors at 1-minute frequency. Built high-throughput ingestion with Azure IoT Hub, Event Hubs and Stream Analytics, with hot-path analytics in Azure Data Explorer. Wrote Terraform code provisioning Azure resources across multiple environments. Built a self-governing, self-healing platform with monitoring, dashboards and automated alerting. Consolidated lab results from multiple third-party LIMS systems into one Databricks lakehouse (Unity Catalog, medallion architecture). Replaced batch notebooks with Spark Declarative Pipelines and Lakeflow Connect, cutting latency from 120 to 20 minutes. Introduced Databricks Asset Bundles with Azure DevOps / GitLab CI/CD for version-controlled, repeatable pipeline releases. Developed background processing microservices in ASP.NET / C# with PostgreSQL.
Line manager of 15 software developers including remote team members: hiring, performance reviews and career growth. Technical oversight of the project portfolio and preparation of technical proposals for new projects. Introduced and improved engineering practices including Scrum, CI/CD, code reviews and technical excellence.
Built industrial and smart-city data ingestion pipelines on Azure using Azure Functions, IoT Edge, Docker, .NET Core and Python. Software architect and product owner for a microservice platform (.NET, Angular, MongoDB, Kubernetes) for Wallenius Marine vessel operations optimization. Technical lead for an automated gate/rail system (OCR, terminal operating system integration; C#, WebAPI, WCF, MS SQL) rolled out to approximately 10 container terminals handling up to 5,000 trucks/day. Technical lead for EMMA energy monitoring for cruise vessels with ABB Finland. Technical lead for a paperless ordering system (Angular SPA, .NET WebAPI, MS SQL).