Description
A world-leading technology consultancy is seeking an experienced Hadoop Developer to work on-site at a Global Investment Bank, as part of a brand new Risk Externalisation Programme.
Part of the Risk Externalisation Programme, the DevOps consultants will work within a team in GFX IT. They will be charged with taking risk data from several systems, aggregating it into a big data platform, performing reconciliations on the data and making the data available to downstream consumers.
The RSL is a platform that will provide risk and PnL services to Front Office, Traded Risk and Finance teams. This will replace several existing Asset Class specific repositories for Front Office risk and PnL valuation, as well as provide more robust patterns for accessing this data instead of sending file extracts from the PTS to downstream systems.
RSL forms a part of the GBM IT strategic risk externalisation programme.
Phase 1 of the RSL project is for GFX to use RSL to store risk data for use by downstream systems to replace reports from NFOS NY so that NFOS NY can be decommissioned.
Wider team of two existing Big Data consultants:
- Commercial experience with Hadoop and understanding of Hadoop architecture and its administration and support.
- Knowledge of Hortonworks HDP stack is a plus.
- Proficient in YARN, Kafka, Zookeeper, HBASE, HDFS, Pig, Hive. Spark knowledge is a plus.
- Shell Scripting and Linux system knowledge.
- Good understanding of Java and can code if required.
- Looking to manage full application stacks from the OS up through custom applications, including build and deployment.
- Knowledge of application deployment tools like Ansible, continuous delivery and rolling upgrades.
- Banking - experience of working with trade data (eg knowledge that trade will have multiple trade identifiers, that trades have legs, the typical fields on a trade like nominal, settlement date, etc.)
- Spark & Drive - must be self-starter
- FX