07/23/2025 updated
100 % available
Data Engineer & Technical Implementation Consultant with expertise in OneTrust, AWS & ETL
Ahmedabad, India
Only remote
Masters in Computer ScienceJava (Programming Language)Amazon Web ServicesAmazon S3AutomationMicrosoft AzureBig DataCloud ComputingComplianceComputer ProgrammingInformation EngineeringExtract Transform Load (ETL)Data VisualizationR (Programming Language)Apache HadoopApache Hive
Data Engineering & ETL
Development of robust ETL pipelines using AWS Lambda, S3, PySpark and Apache Hive for large-scale data processing with significant performance improvements.
Programming & Development
Proficiency in Python, Java, R, and SQL for implementing data processing solutions, API development, and automation of data exports.
Cloud & Big Data Technologies
Experience with AWS, Azure, Hadoop, Spark, and Kafka for real-time data streaming, processing, and analysis with demonstrated efficiency improvements.
Machine Learning & NLP
Implementation of Named Entity Recognition systems using LSTM networks and image classification models with PyTorch achieving high accuracy rates.
Data Visualization
Creation of interactive dashboards using Power BI, Tableau, and Python libraries for monitoring user interactions and providing business insights.
Consent Management
Implementation of Cookie Consent, Mobile App Consent, and Universal Consent solutions for enterprise clients ensuring regulatory compliance.
Database Management
Working knowledge of SQL, NoSQL, MySQL, PostgreSQL, and Hive for efficient data storage, retrieval, and management.
Development of robust ETL pipelines using AWS Lambda, S3, PySpark and Apache Hive for large-scale data processing with significant performance improvements.
Programming & Development
Proficiency in Python, Java, R, and SQL for implementing data processing solutions, API development, and automation of data exports.
Cloud & Big Data Technologies
Experience with AWS, Azure, Hadoop, Spark, and Kafka for real-time data streaming, processing, and analysis with demonstrated efficiency improvements.
Machine Learning & NLP
Implementation of Named Entity Recognition systems using LSTM networks and image classification models with PyTorch achieving high accuracy rates.
Data Visualization
Creation of interactive dashboards using Power BI, Tableau, and Python libraries for monitoring user interactions and providing business insights.
Consent Management
Implementation of Cookie Consent, Mobile App Consent, and Universal Consent solutions for enterprise clients ensuring regulatory compliance.
Database Management
Working knowledge of SQL, NoSQL, MySQL, PostgreSQL, and Hive for efficient data storage, retrieval, and management.
Experience
Professional experience5 - 10 years
Freelancer since2025
Languages
EnglishFluentHindiNative speaker
Project history
Major services worked with: Cookie Consent, Mobile App Consent, Universal Consent & Preference Management
- Collaborated with 100+ enterprise clients to ensure seamless integration and successful platform adoption.
- Deployed and tested banner SDK, crafting on-demand CSS and JavaScript to align with functional needs.
- Partnered cross-functionally with UI/UX, product management, and engineering teams for feature enhancement.
- Managed customer escalations, contract retentions, user training, and process refinement, aligning with business KPIs and fostering client satisfaction through partnership with Product Managers, UX Designers and analysts.Â
- Engineered robust ETL pipelines using AWS Lambda and S3 to scrape and store data for real-time analysis.
- Enhanced AWS and FNA integration optimizing scripts to improve efficiency and reduce response times by 20%.
- Created real-time dashboards to monitor user interactions, utilizing Python data visualization libraries.
- Contributed to data-driven decision-making by providing insights through in-depth analysis of key metrics.
- Utilized SQL, Spark, and Hadoop to process large-scale pharma data, improving data retrieval efficiency by 15%
- Deployed Kafka for real-time streaming, reducing latency by 20%; ensuring timely access to critical information.
- Engineered scalable APIs to automate data exports – lead to a 1.5x improvement in operational efficiency.
- Teamed up with engineering and marketing teams to design and optimize data pipelines, contributing to a 12% increase in overall data processing speed for research and development projects.