12/16/2025 updated

**** ******** ****
100 % available

Senior Software Engineer - Big Data & Search Systems

bengaluru, India
Only remote
Masters of Science - Computer Science
bengaluru, India
Only remote
Masters of Science - Computer Science

Profile attachments

RIDHI_DUA_senior_v2.pdf

Java (Programming Language)Apache HTTP ServerBusiness IntelligenceBig DataExtract Transform Load (ETL)Data ModelingData QualityDistributed SystemsElasticsearchApache HadoopInfrastructure ManagementOnline Analytical ProcessingParallel ComputingSystems Development Life CycleRemote MonitoringData ProcessingIndexerInfrastructure DesignMicroservices
Big Data Analytics Infrastructure
Design and scaling of high-performance OLAP analytics infrastructure using Apache Pinot with distributed computing technologies

Java Development & Microservices
Extensive experience in Java programming with modern distributed computing technologies including microservices architecture

Search Engineering Systems
Development and optimization of search systems capable of handling 300M+ transactions per day with sub-second performance

Apache Hadoop Ecosystem
Implementation and management of Hadoop-based data processing pipelines for large-scale analytics

Elasticsearch & Data Indexing
Design and optimization of search indices and data modeling for high-performance querying

Surveillance Systems Development
Development of model-based surveillance platforms operating on millions of daily transactions

Data Quality Monitoring
Design and delivery of rule-based data quality monitoring platforms with enterprise-wide scaling

Distributed Computing
Implementation of scalable solutions using distributed shared memory clusters and parallel algorithms

ETL Processing
Development of ETL/ELT pipelines for data processing and business intelligence applications

Experience

Professional experience5 - 10 years
Freelancer since2025

Languages

EnglishNative speaker

Project history

Vice President, Core Search Engg

Goldman Sachs
Engineered and scaled high-performance OLAP analytics infrastructure using Apache Pinot. Designed data pipelines capable of ingesting and querying 300M+ transactions per day with 200+ columns. Delivered multiple Search Engineering initiatives to support high-performance search over structured and unstructured datasets.

Vice President, Surveillance Eng

Goldman Sachs
Managed engineers and quantitative modelers delivering model-based surveillance platforms operating on millions of daily transactions. Owned system design and architecture across the full lifecycle from greenfield design to production rollout.

AVP, Systems Engineer Cnslt

Bank of America, USA
Led the design and delivery of a rule-based data quality monitoring platform, scaling a prototype into an enterprise-wide solution. Served as product owner, driving feature prioritization, adoption strategy, and cross-team delivery.

Research Assistant

University of North Carolina at Charlotte, USA
Designed efficient parallel algorithms for existing serial algorithms at the Bioinformatics Research Center. Successfully implemented scalable and robust solutions using C++, MPI and OpenMP on a 504-core distributed shared memory cluster.

Software Engineer II

Persistent Systems Ltd, Pune
Received client appreciation and company wide recognition for individual contribution to data records extraction module performance improvement by more than 500%. Improved performance by over 60% by independently redesigning the packaged analytic module.

Contact form

Log in to get in touch

You need to be logged in to use the contact form.

Sign upLog in