03/21/2025 updated
100 % available
DWH Test Engineer with ETL and Data Validation Expertise
Pune, India
Only remote
B.Tech. in CSE from SIR CR Reddy College of Engineering, Eluru | Jul'17 - Aug'21Apache AirflowApache HTTP ServerAtlassian JiraAutomationComputer ProgrammingDatabasesCouchbase ServersData ValidationData IntegrityExtract Transform Load (ETL)Data MigrationFault Detection and IsolationApache HivePython (Programming Language)PostgreSQL
Data Validation and ETL Processes
Expertise in data validation, ETL processes, and SQL, ensuring data integrity and smooth data flows across complex platforms like Couchbase, PostgreSQL, and Hive.
Automation Development
Skilled in automation development, having created custom tools to streamline testing processes, reduce manual efforts, and enhance efficiency using Shell scripting, Airflow, and Jenkins.
Performance Monitoring and Optimization
Expertise in monitoring and issue resolution, improving system performance by addressing error detection, out-of-memory issues, and performance tuning through Red Hat OpenShift.
Database Management
Proficiency in various databases including Oracle SQL, NoSQL databases (e.g., Couchbase), Apache Iceberg, PostgreSQL, Hive, Snowflake, Teradata, and Cassandra DB.
Programming and Scripting
Competence in SQL, Python, and Shell scripting for automation and data processing tasks.
Data Processing Tools
Experience with Control-M, Informatica, Airflow, Red Hat OpenShift (OCP), Jenkins, AutoCloud, and Jira for data workflows and project management.
Performance Tuning
Skills in performance tuning strategies, data migration techniques, and SQL query optimization to enhance system efficiency.
Expertise in data validation, ETL processes, and SQL, ensuring data integrity and smooth data flows across complex platforms like Couchbase, PostgreSQL, and Hive.
Automation Development
Skilled in automation development, having created custom tools to streamline testing processes, reduce manual efforts, and enhance efficiency using Shell scripting, Airflow, and Jenkins.
Performance Monitoring and Optimization
Expertise in monitoring and issue resolution, improving system performance by addressing error detection, out-of-memory issues, and performance tuning through Red Hat OpenShift.
Database Management
Proficiency in various databases including Oracle SQL, NoSQL databases (e.g., Couchbase), Apache Iceberg, PostgreSQL, Hive, Snowflake, Teradata, and Cassandra DB.
Programming and Scripting
Competence in SQL, Python, and Shell scripting for automation and data processing tasks.
Data Processing Tools
Experience with Control-M, Informatica, Airflow, Red Hat OpenShift (OCP), Jenkins, AutoCloud, and Jira for data workflows and project management.
Performance Tuning
Skills in performance tuning strategies, data migration techniques, and SQL query optimization to enhance system efficiency.
Languages
EnglishFluentTeluguNative speaker
Project history
Responsible for DWH/ETL testing, ensuring data integrity and smooth data flows across complex platforms.
Focused on non-functional testing aspects of data systems.
Validated data flows from Couchbase, PostgreSQL, and Kafka to ScyllaDB, monitored and optimized Airflow jobs, and conducted comprehensive data validation.