01/16/2025 updated
KP
100 % available
Senior Data Engineering Professional
Hyderabad, India
Only remote
Bachelor of Engineering(Computer Science and Engineering) Visvesvaraya Technological University, Belagavi, IndiaJava (Programming Language)Artificial IntelligenceAmazon Web ServicesData AnalysisArchitectureAutomationBusiness IntelligenceBig DataCloud ComputingContinuous IntegrationInformation EngineeringData GovernanceData InfrastructureExtract Transform Load (ETL)Data Management
Data Engineering
Expertise in building and managing scalable data infrastructure, optimizing data processes, and implementing cloud-native technologies for high-performance data systems.
Cloud Technologies
Proficiency in cloud data engineering, architecture, and platform development using AWS, Snowflake, and other cloud services for robust and scalable solutions.
Data Analytics and Visualization
Strong capabilities in enterprise-wide analytics, ETL pipelines, and custom dashboard development for actionable business intelligence and reporting.
Programming Languages
Proficiency in Python, Java, and various data-related technologies such as SQL, NoSQL, and big data frameworks.
Data Governance and Security
Experience in implementing data governance strategies, ensuring compliance, and managing data security across various platforms.
Machine Learning and AI
Knowledge of integrating machine learning and AI capabilities into data platforms for advanced analytics and decision-making systems.
DevOps and Automation
Expertise in DevOps practices, CI/CD pipelines, and automation tools for efficient data infrastructure management and deployment.
Expertise in building and managing scalable data infrastructure, optimizing data processes, and implementing cloud-native technologies for high-performance data systems.
Cloud Technologies
Proficiency in cloud data engineering, architecture, and platform development using AWS, Snowflake, and other cloud services for robust and scalable solutions.
Data Analytics and Visualization
Strong capabilities in enterprise-wide analytics, ETL pipelines, and custom dashboard development for actionable business intelligence and reporting.
Programming Languages
Proficiency in Python, Java, and various data-related technologies such as SQL, NoSQL, and big data frameworks.
Data Governance and Security
Experience in implementing data governance strategies, ensuring compliance, and managing data security across various platforms.
Machine Learning and AI
Knowledge of integrating machine learning and AI capabilities into data platforms for advanced analytics and decision-making systems.
DevOps and Automation
Expertise in DevOps practices, CI/CD pipelines, and automation tools for efficient data infrastructure management and deployment.
Experience
Professional experience10+ years
Freelancer since2022
Languages
EnglishNative speaker
Project history
Set up databricks infrastructure for analytics platform using Databricks, Terraform, and Airflow. Optimized cloud resources and automated workflows for large-scale data processing.
Enabled startup growth in online credit card solutions by building data platform and management strategies. Implemented Agile processes and delivered projects ahead of schedule.
Led data engineering initiatives for an E-payment company, scaling from $400M to $2B annual transaction volume. Built comprehensive data platform using various technologies and established Agile processes.