Solutions Architect / Tech Lead AWS, Big Data

2021 - Consulted for customers such as Amazon, BMW and Continental .

Responsibilities included:
- Built and ran server-less and AWS Batch based services incl. full
software lifecycle (dev, test, staging, pipeline, prod, monitoring) with
Python, Java
- Secure multi-tenant Autonomous Driving Data Collection and
Processing using S3, Batch, Event Bridges, Docker, Lambdas, and
Step-Functions etc.
- Architecture reviews and audits ("Well-Architected Review")
- Multi-Account/Multi-Environment Code Deployments with CDK and
Code Pipelines
- Cost reductions, Performance Optimizations and architectural
consulting incl. C-Level presentations
- Re-platform applications to AWS (e.g. Java Tomcat to Elastic Beanstalk
/ RDS)
- IaC, AWS and Serverless Workshops (e.g. CDK, CloudFormation, also
Terraform) for developers and operators

2014 - Lead a team of 9 full-time Engineers in a startup
Aug
2020 Responsibilities included:

- Developed from scratch, a Big Data on premise solution, to store and
profile mobile locations of all subscribers of a country for use by
investigative agencies.
- Used various NoSQL offerings like Hadoop, HBase, Cassandra,
MongoDB, Solr, Kafka, and Spark.
- Also involved in designing various microservices to generate profile,
algorithms for comparison of the profiles (in near-real time) to find
familial, communication and location patterns between subscribers
(Named on Patent)
- Developed the next-gen of the product, where-in Profiling is done in-line
with ingestion, with AWS S3 as the storage medium and AWS EMR and
AWS MSK for ingestion with some custom cardinality solutions using
Count-Min Sketch, Bloom-Filters, Hyper-Log-Log etc.