Description
Big Data/Data Hub Platform Manager, Hive, Hadoop MapR - Investment Banking
Big Data/Data Hub Platform Manager with Hive Drill, HBase, HDFS Hadoop MapR -, the primary focus of the role is to manage the MapR (Hadoop) infrastructure of the CIB Big Data platform. The role will involve working closely with the other Data SSC Solution Architects and development teams onshore and offshore to configure and manage the platform.
Essential
- Knowledge of Big Data technologies (Hive, Drill, HBase, HDFS ) and Hadoop distributions, in particular MapR
- Conception of a data warehouse and the different layers to integrate and distribute the data.
- Linux OS knowledge
- Knowledge of security and authentication topics on Big Data technologies
- Management of Hadoop cluster, with all included services
- Ability to solve any ongoing issues with operating the cluster
Big Data Platform Management
- Platform infrastructure design
- Platform configuration and performance tuning for use cases
- Monitoring of platform health
- Planning capacity increase
- Reporting on platform health, capacity and usage
Skills & Competencies
- Strong solution architecture experience in delivery of IT projects
- Strong data analytics/big data solution architecture experience in delivery of large systems
- 12+ years' experience in IT, at least 6 with BI and data systems
- Deep technical knowledge of data analytics technologies
- Deep technical knowledge of Big Data/Hadoop technologies, especially MapR
- Experience working with ETL technologies
- Knowledge of data management tools, eg Ab Initio, Callibra
- Experience working in onshore/offshore delivery centres, including interaction with geographically distributed clients
- Encourage continuous improvement, innovation and creativity
- Facilitate problem solving & collaboration
- Ability to discover and analyse problems, and present solutions in a clear and concise manner
- Excellent oral and written communication skills with the ability to effectively present to target audience
Highly Desirable
- Experience with Spark development optional.
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
- Experience with various messaging systems, such as Kafka.
Nice to have
- Experience working with ETL technologies using Ab Initio
Adlam Consulting operates as an Employment Agency & an Employment Business Applicants must be eligible to work in the specified location