08/06/2026 updated
AP
100 % available
Technical Lead - Big Data & Hadoop
Hyderabad, India
Only remote
M.TECH (Post Graduation), AVR&SVR Engineering College, JNTU, 2014Hadoop Ecosystem & Big Data
Extensive experience in supporting Hadoop applications and its components including HDFS, Nifi, Hive, Impala, Sqoop, and MapReduce. Involvement in design and development of technical specifications using Hadoop-Eco System tools, as well as data ingestion using Apache Nifi.
SQL & Data Querying (HiveQL, PL/SQL)
Strong proficiency in developing data queries using HiveQL and optimizing Hive queries. Knowledge in both importing and exporting data using Sqoop from HDFS to RDBMS, as well as working with SQL and PL/SQL in various project environments.
Spark & Scala / PySpark
Hands-on experience with Apache Spark using Scala and PySpark for large-scale data processing. Applied in multiple projects including Mercury Marine (NTT DATA) and MOT RISK-LCRS&LERS (HCL) for batch processing and data pipeline development.
Java Programming
Good programming knowledge in Object Oriented language Core Java, applied in various IT projects over 9+ years of experience.
Database Management (Oracle, Maria DB, Spark Hive)
Knowledge in Oracle 9i/10g, Maria DB, and Spark Hive. Configuration of metadata in Maria DB for batch job processing and good knowledge in Oracle and MySQL.
o9 Platform Integration
Experience working with the o9 tool, a cloud-based AI-powered supply chain and demand planning platform. Integration of o9 with internal systems via APIs and data pipelines, including inbound and outbound synchronization.
Schedulers (TWS, Cron)
Experience handling daily batch job processing scheduled in TWS (Tivoli Workload Scheduler) and Cron schedules across multiple projects.
Linux & Windows Operating Systems
Experience working in Linux (Solaris) and Windows environments, including server administration and troubleshooting.
Python
Usage of Python as a programming language in project environments such as MOT RISK-FRDV (Capgemini) and Pandora Supply and Planning (HCL).
JIRA & Development Tools (TOAD, PL/SQL Developer, Bit Bucket, PCF)
Familiarity with project management and development tools including JIRA, TOAD, PL/SQL Developer, Bit Bucket, and PCF 2.0 used across multiple client engagements.
Extensive experience in supporting Hadoop applications and its components including HDFS, Nifi, Hive, Impala, Sqoop, and MapReduce. Involvement in design and development of technical specifications using Hadoop-Eco System tools, as well as data ingestion using Apache Nifi.
SQL & Data Querying (HiveQL, PL/SQL)
Strong proficiency in developing data queries using HiveQL and optimizing Hive queries. Knowledge in both importing and exporting data using Sqoop from HDFS to RDBMS, as well as working with SQL and PL/SQL in various project environments.
Spark & Scala / PySpark
Hands-on experience with Apache Spark using Scala and PySpark for large-scale data processing. Applied in multiple projects including Mercury Marine (NTT DATA) and MOT RISK-LCRS&LERS (HCL) for batch processing and data pipeline development.
Java Programming
Good programming knowledge in Object Oriented language Core Java, applied in various IT projects over 9+ years of experience.
Database Management (Oracle, Maria DB, Spark Hive)
Knowledge in Oracle 9i/10g, Maria DB, and Spark Hive. Configuration of metadata in Maria DB for batch job processing and good knowledge in Oracle and MySQL.
o9 Platform Integration
Experience working with the o9 tool, a cloud-based AI-powered supply chain and demand planning platform. Integration of o9 with internal systems via APIs and data pipelines, including inbound and outbound synchronization.
Schedulers (TWS, Cron)
Experience handling daily batch job processing scheduled in TWS (Tivoli Workload Scheduler) and Cron schedules across multiple projects.
Linux & Windows Operating Systems
Experience working in Linux (Solaris) and Windows environments, including server administration and troubleshooting.
Python
Usage of Python as a programming language in project environments such as MOT RISK-FRDV (Capgemini) and Pandora Supply and Planning (HCL).
JIRA & Development Tools (TOAD, PL/SQL Developer, Bit Bucket, PCF)
Familiarity with project management and development tools including JIRA, TOAD, PL/SQL Developer, Bit Bucket, and PCF 2.0 used across multiple client engagements.
Experience
Professional experience5 - 10 years
Freelancer since2026
Languages
EnglishFluent
Project history
Working as Technical Lead at HCL Technologies. Projects include Pandora Supply and Planning (July 2022 - Present) integrating o9 platform with internal systems via APIs and data pipelines, and MOT RISK-LCRS&LERS (Mar 2022 - Apr 2024) for DBS Bank generating LCR regulatory reports and LERS large exposure metric reports using Spark/Scala, Maria DB, and Hive.
Worked on the Mercury Marine project for Brunswick Corporation. Dealt with manufacturing and sales data consolidation from different source systems including Oracle and mainframe systems. Data stored in Hadoop file system and processed using MapReduce jobs. Responsibilities included processing daily manufacturing/sales data, creating Hive tables, developing HiveQL queries, data ingestion using HDFS and Hive, and production support.
Worked on two projects: MOT RISK-FRDV for DBS Bank (May 2017 - Sep 2019) involving a Data Lake for Finance and Risk modules using SPARK HIVE, Maria DB, Python, and Hadoop technologies; and Michael Kors project (Aug 2015 - Apr 2017) in Bangalore using AS400, resolving issues in applications like RLM and JDA, troubleshooting retail application servers, scheduling tasks in Retail BI and Wholesale BI applications, and working as I-series admin.