Hadoop Administrator

Warsaw  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Apache Hadoop Controles de Acceso Capacity Planning Data Governance Data Integrity Extract Transform Load (ETL) Data Retention Disaster Recovery Hadoop Distributed File System Apache HBase Apache Hive Infrastructure Management Performance Tuning Security Policies Stakeholder Management Tax Efficiency Workflows Apache Yarn Apache Spark Resource Utilization Apache Kafka Data Pipeline

Description

As a Hadoop Administrator, you will play a crucial role in managing and maintaining our Hadoop ecosystem to ensure optimal performance, reliability, and security. You will collaborate closely with our data engineers, analysts, and other stakeholders to understand their requirements and provide efficient solutions.

Your responsibilities will include but are not limited to:

  • Installing, configuring, and maintaining Hadoop clusters, including HDFS, YARN, Hive, HBase, Kafka, Spark, and other related technologies.
  • Monitoring cluster health and performance, diagnosing and troubleshooting issues, and implementing solutions to minimize downtime.
  • Capacity planning and scaling the Hadoop infrastructure to accommodate growing data volumes and user demands.
  • Implementing and enforcing security policies, access controls, and data governance measures to protect sensitive information.
  • Performing regular backups, disaster recovery planning, and data retention policies to ensure data integrity and availability.
  • Collaborating with cross-functional teams to design and implement data pipelines, ETL processes, and data workflows.
  • Evaluating new technologies and upgrades, conducting performance tuning, and optimizing resource utilization for cost efficiency.
  • Providing technical guidance, training, and support to junior team members and end-users to promote best practices and knowledge sharing.
Start date
n.a
From
Brabers Consultancy
Published at
16.05.2024
Project ID:
2751246
Contract type
Freelance
To apply to this project you must log in.
Register