Description
Responsible for implementation and ongoing administration of Hadoop infrastructureResponsibilities:
- Cluster maintenance as well as creation and removal of nodes.
- HDFS support and maintenance.
- Backup and restores
- Cluster Monitoring and Troubleshooting
- Manage and review Hadoop log files
- File system management and monitoring.
- Design, implement, and maintain security
- Data capacity and node forecasting and planning.
- Closely working with the infrastructure, network, database, application, and Business Intelligence teams to ensure data quality and availability.
- Works with application teams to install operating system and Hadoop updates, patches, version upgrades as required.
SKILLS/REQUIRED:
1+ years' experience with the Hadoop stack (MapReduce, Sqoop, Pig, Hive, Flume, Hcatalog) preferably Cloudera Distribution - Stong Linux knowledge is a MUST. Teamwork, strong communication and ability to cultivate positive customer relationships - Knowledge of NoSQL platforms such as HBase, Cassandra, MongoDB, MarkLogic