10/23/2026 updated
100 % available
Senior Data Engineer | Data Architect | AI Engineer | AWS, Databricks, LLM
Porto, Portugal
Only remote
Mathematics, Bachelor of ScienceAbout me
I'm a data & AI engineer building RAG agents, AI tools, and ETL pipelines on AWS & Databricks. I manage cloud infrastructure with Terraform, ensure data quality with DBT, orchestrate workflows in Airflow, and model data in SQL/PySpark for PowerBI reports.
BedrockdbtLangChainApache AirflowAmazon S3Data ArchitecturePython (Programming Language)SQL DatabasesAWS LambdaInfrastructure as Code (IaC)AWS ECSPySparkAWS AuroraKubernetesAWS Fargate
• Building RAG agent in Bedrock for Salesforce process automatio.
See my article on AWS blog https://aws.amazon.com/blogs/industries/how-smart-europe-revolutionized-automotive-customer-support-with-amazon-bedrock/
• Deploy and manage internal AI chat platform
• Create various AI tools (bitbucket code review bot, DBT documentation bot
• Provisioning and managing infrastructure in Terraform and AWS
• Building ETL pipelines on AWS/Databricks
• Writing Unit tests for pipelines
• Setting up a data quality framework in DBT expectations and elementary
• Orchestrate code execution in AirFlow.
• Writing code in SQL/PySpark/Python to model data in DBT
• Creating star schemas for PowerBi reports
Experience
Professional experience5 - 10 years
Freelancer since2026
Languages
GermanNative speakerEnglishFluent
Project history
Talk-to-Data Chatbot with open webui, kubernetes and databricks. I created:
- a pipeline in open webui with langgraph
- an AI user in databricks with limited read permissions to 90 tables
- a knowledge base with sql query and table samples
- Create AI workflows in aws stepfunctions and aws lambda
- Setup knowledge bases on aws bedrock and aurora rds
- Scheduled job on databricks and airflow for knowledge base updates
- Create cicd pipelines on aws codepipeline
- Create prompts for Claude models for structured output