08/02/2026 updated


100 % available
Data Engineer | Big Data & Cloud Specialist | Azure Certified
Nagercoil, India
Only remote
B.E. in ECE, Anna UniversityBig Data Engineering
Around 5 years of experience in Big Data Engineering, including cross-platform integration using Hadoop, Spark, Core Java, Scala and Python for large-scale data processing and migration.
ETL/ELT & Data Integration
Strong experience in ETL, ELT, Batch processing and Streaming, including data integration from various source locations, generating reports based on SLA compliance and validating user expectations during data integration processes.
Cloud Platforms (AWS & Azure)
Good exposure to AWS (3 years) and Azure (2.5 years) cloud platforms, with a Microsoft Azure Data Engineer Associate certification, supporting cloud-based data engineering solutions.
Java
5 years of experience in Java, used extensively in Big Data and data engineering projects for cross-platform integration and processing.
Python
4 years of experience in Python, applied in data engineering workflows, analysis and automation tasks.
Hadoop/Spark
5 years of experience with Hadoop and Spark, including data migration from local and various data sources to HDFS and performing analysis on user data.
Kafka/SOLR
3 years of experience with Kafka and SOLR, supporting real-time streaming and near real-time search engine implementations.
SQL & NoSQL Databases
Strong working knowledge of various database technologies including SQL and NoSQL, applied across multiple domains such as Banking, Healthcare and Manufacturing.
NLP & Search Engine Implementation
Experience implementing NRT search engines and NLP-based search engines as part of BI Analytics tooling for Big Data platforms.
BI Analytics
Built a BI Analytics tool for Big Data from scratch, including scheduling and real-time streaming on various data sources.
Around 5 years of experience in Big Data Engineering, including cross-platform integration using Hadoop, Spark, Core Java, Scala and Python for large-scale data processing and migration.
ETL/ELT & Data Integration
Strong experience in ETL, ELT, Batch processing and Streaming, including data integration from various source locations, generating reports based on SLA compliance and validating user expectations during data integration processes.
Cloud Platforms (AWS & Azure)
Good exposure to AWS (3 years) and Azure (2.5 years) cloud platforms, with a Microsoft Azure Data Engineer Associate certification, supporting cloud-based data engineering solutions.
Java
5 years of experience in Java, used extensively in Big Data and data engineering projects for cross-platform integration and processing.
Python
4 years of experience in Python, applied in data engineering workflows, analysis and automation tasks.
Hadoop/Spark
5 years of experience with Hadoop and Spark, including data migration from local and various data sources to HDFS and performing analysis on user data.
Kafka/SOLR
3 years of experience with Kafka and SOLR, supporting real-time streaming and near real-time search engine implementations.
SQL & NoSQL Databases
Strong working knowledge of various database technologies including SQL and NoSQL, applied across multiple domains such as Banking, Healthcare and Manufacturing.
NLP & Search Engine Implementation
Experience implementing NRT search engines and NLP-based search engines as part of BI Analytics tooling for Big Data platforms.
BI Analytics
Built a BI Analytics tool for Big Data from scratch, including scheduling and real-time streaming on various data sources.
Experience
Professional experience5 - 10 years
Freelancer since2025
Languages
EnglishFluent
Project history
Working as a DIAL Engineer in an off-shore capacity for ABN AMRO Bank, Amsterdam NL.
Data integration and processing from various source locations and generating reports based on SLA compliance. Validating that user expectations are achieved during the data integration process.
Built a BI Analytics tool for Big Data from scratch. Implemented both scheduling and real-time streaming on various data sources. Implemented NRT search engine and NLP-based search engine.