Madhu Hiriyur available

Madhu Hiriyur

Senior Big Data Engineer

available
Profileimage by Madhu Hiriyur Senior Big Data Engineer from Fehmarn
  • 23769 Fehmarn Freelancer in
  • Graduation: Engineering in Computer science
  • Hourly-/Daily rates:
  • Languages: English (Full Professional)
  • Last update: 03.12.2020
KEYWORDS
PROFILE PICTURE
Profileimage by Madhu Hiriyur Senior Big Data Engineer from Fehmarn
ATTACHMENTS
CV Madhu Hiriyur

You need an account to view this information.

PORTFOLIO
SKILLS
  • Scala, Spark, Hadoop, Hive, Impala, Hue, Cloudera, Yarn, Gitlab & Jenkins
  • SSIS, SSRS, TSQL
PROJECT HISTORY
  • 08/2019 - Present

    • Market Researcher
    • >10.000 employees
    • Pharmaceuticals and medical technology
  • Nominative Data Bridging
  • In this Spain project we use Spark and Scala to perform ETL. Input non panel pharmacy data is loaded to Data Lake. Reference data is also loaded to Hive tables of Data Lake , from Input systems such as SQL server, Oracle & Exasol. Bridging process takes all these data and replaces manufacturer name, drug name, drug molecule and geographical region, it also adds panel data before producing output csv files into sftp location.

     

    Quality check module was developed to validate input data, we used a configurable JSON file to list all the quality checks. JSON file facilitates adding a quality check on the fly in different environments. Error notifications are sent through email and logs are captured in Cloudera. Kibana logs are also used to help production teams to troubleshoot the application. Impala was also used to help production teams in getting data using SQL quickly.

     

    All the modules are standalone applications which are then triggered by ESP scheduled tasks.

     

    Contributions:

    • Interacted with Clients & other teams
    • Design, development, testing & deployment of Scala application
    • Implemented factory pattern & CICD tools for code deployment/promotion to different environments

    Role : Lead Developer

     

    Technologies :

    • Spark,
    • Scala,
    • Hadoop,
    • Hive,
    • Impala,
    • Jenkin,
    • Gitlab,
    • Cloudera,
    • Kibana
    • ESP Cybermation

  • 01/2019 - 08/2019

    • Market Researcher
    • >10.000 employees
    • Pharmaceuticals and medical technology
  • Good Data Generator
  • This project estimates late arrival data of Switzerland data centers, Statistical team developed a prototype of estimating later arrival data using SAS. We have analyzed this SAS programs and datasets. Converted them to SQL server stored procedures.

     

    Contributions:

    • Technical lead
    • Assisting Design, development, testing & deployment of Stored Procedures.

     

    Role : Lead Developer

    Technologies:

    • TSQL
    • SQL Server
    • SAS

  • 03/2017 - 04/2018

    • Market Researcher
    • >10.000 employees
    • Pharmaceuticals and medical technology
  • Japan IMS Analysis Manager
  • This is a framework which servers for multiple clients, This consists of 6 offerings(cube) which are used by more than 1000 clients. Involved in all the ETL packages of this offering.

     

    Contributions:

    • Interacted with Clients & co-ordinated testing with vendors
    • Design, development, testing & deployment of SSIS & Stored procedures

     

    Role : Senior Developer

    Technologies:

    • SSIS
    • TSQL &
    • SSAS

  • 01/2016 - 02/2017

    • Market Researcher
    • >10.000 employees
    • Pharmaceuticals and medical technology
  • Drug Distributor Data
  • This package loads a GB of data to tables by applying many business logics. We have implemented single configuration file for multiple child packages.

    Contributions:

    • Interacted with Clients & coordinated testing with vendors
    • Design, development, testing & deployment of SSIS & Stored procedures

     

    Role : Senior Developer

    Technologies:

    • SSIS
    • TSQL
    • SSAS

  • 05/2013 - 12/2015

    • Market Researcher
    • >10.000 employees
    • Pharmaceuticals and medical technology
  • Incential Componsation
  • This is a windows application, which helps to calculate Medical representatives Incentives based on IMS data. Several pharmacy clients use this tool, every new client is introduced to this tool, we have to take  up customization. We also supported this tool on change requests.

    Contributions:

    • Interacted with Clients & coordinated testing
    • Design, development, testing & deployment of SSIS & Stored procedures

     

    Role : Senior Developer

    Technologies:

    • SSIS
    • TSQL

  • 12/2012 - 05/2013

    • Altisource Business Solutions
  • QMS reports
  • This project is part of the QMS automation. There are various reports at different levels & Ability to extract the data base in either word, excel or PDF format. The reports were deployed in SharePoint.

    There were multiple roaster sheets which were uploaded to the database from different departments and all these upload were handled through SSIS.

    Contributions:

    • Design, development, testing & deployment of SSIS, Stored procedures & SSRS
    • Configuration of SSRS in SharePoint integrated mode.
    • Configuring SSRS in SharePoint
    • Configuring oracle client in windows server.

     

    Role : Senior Developer

    Technologies:

    • SSIS,
    • SSRS,
    • SharePoint &
    • Oracle

  • 12/2011 - 11/2012

    • Altisource Business Solutions
  • PP&I
  • This application seamlessly integrates Real Remit invoices with Dynamics (AX). The invoices data contract has header, summary and detail rows. SSIS splits these values and inserts them to different tables. SSIS runs in concurrency with AX batch. SSIS sends email on success or failure.

    Similar to this we have developed many SSIS packages which interact with other Business units & Dynamics AX.

    Contributions:

    • Design, development, testing & deployment of SSIS
    • Design, development, testing & deployment of Stored procedures
    • Creating tables through AX AOT.

               

    Role : Senior Developer

    Technologies:

    • SSIS,
    • TSQL &
    • MS dynamics

  • 01/2009 - 01/2010

    • ITC Infotech
  • Super Vision
  • This is an upgraded application of an existing application. We are upgrading the current application by incorporating .net 3.5 features. This application monitors Bonds and Equity trading of a bank. Bonds and equity trading is handled by many windows services and Super Vision application tracks the information of these widows services along with displaying many log files. All the transactions to server are handled through wcf services.

    Contributions:

    • Design, development, testing & deployment of WCF & .net windows Applicaion
    • Involved in support activities also.

               

    Role : Senior Developer

    Technologies:

    • .Net Framework 3.5
    • wcf , C#.net
    • SQL Server 2005, SOA architecture

  • 07/2007 - 12/2008

    • Chimera Technologies
  • Sales Management Tool
  • This is a software product, which will be used by RV sellers to maintain customers (sales leads). It is having 3 users Sales Admin, Sales Manager & Sales Person.

                The sales manager can create and manage protocols, which will be used by sales persons to handle sales leads (customers).

    Contributions:

    • Worked in agile methodology.
    • Involved in Database design.
    • Handled client interactions independently.
    • Implemented Ajax & extensively used 3rd party controls (free text box and daypilot calendar control)

               

    Role : Developer

    Technologies:

    • ASP.NET 2.0, C#
    • Ajax
    • MS SQL SERVER 2005

  • 06/2007 - 12/2008

    • Chimera Technologies
  • eNcompass (Enterprise Application for Telecom Companies)
  • eNcompass  is a system upgrade project of Telecom companies based in Virginia, US. The primary goal of this Systems Project was to eliminate redundancy in telecom companies, thereby increasing efficiency. It established or enhanced integration with existing systems, enabled roles and responsibilities to be more easily managed, reduced operational errors and most importantly enhanced and improved service to the most important person for any business.  -  The Customer.

                    These goals were achieved by creating a system that integrated all applications so that the data was not initiated in more than one system.

    BEL, BLL, DBL & PL architecture is followed in development.

    Contributions:

    • Developed the front end using ASP.NET, extensively used RAD control (telluric asp.net), validation control & events.
    • Worked in agile methodology.
    • Worked on Analysis, Designing & Development

               

    Role : Senior Developer

    Technologies:

    • C#.net, Asp.Net 2.0
    • XML,Ajax
    • SQL Server 2005

  • 06/2005 - 07/2006

    • Radiant Info Systems
  • Performance Management System
  • This application tracks the quarterly performance of each employee of a company. The employee has to login with his credentials and submit his quarterly performance details. This submitted form would appear on, his reporting managers ICR/PLR forms list. Reporting manager can approve or reject the form. If any reporting or reviewing manager rejects the form, a mail will be sent to all the employees in the hierarchy. The application tracks the performance of all the employees of each branch. It has a feature of automatic performance rating calculation and printing reports.

    Contributions:

    • Implemented windows authentication (ADSI).
    • Worked on 3-tier hardware architecture (application server and file server interaction).
    • Developed the front end using ASP.NET, extensively used server control, validation control.
    • Created support tables, queries & stored procedures in MySql 5.0.
    • Used sqlyog to create queries & stored procedures.
    • Used Version Control through TortoiseCVS.

     

    Role : Trainee Engineer

    Technologies:

    • ASP.NET, C#.NET & MySql

TIME AND SPATIAL FLEXIBILITY
100% Home office
GET IN TOUCH

Message:

Sender:

WEB PRESENCE