Description
DataStage Engineer
A DataStage Engineer is urgently required for a long-term, lucrative contract position with a market leading financial services client based in Amsterdam.
The client is building a Data Lake, which will be an ambitious implementation of IBM InfoSphere (Datastage, TWS-D and Information Governance Catalog), Netezza and Hadoop. The DataStage Engineer will be part of a team aimed at boosting standards, build patters and automating the data pipeline.
The DataStage Engineer will work in a team that loads a variety of data sources into the client's Information Warehouse and also delivers Data Marts for Cognos reporting. Sources deliver in batch but also in Real Time, from fixed width files to XML. The physical modelling method used in the client's Information Warehouse is 'Key-Version'-modelling. Data Vault practitioners will feel right at home. Our Data Marts are dimensionally modelled. Automation is not limited to Datastage, but to the complete end-to-end delivery, including automated testing and continuous delivery.
The DataStage Engineer will ideally have 65%+ of the following skills and experience:
- Fluent English, Dutch speakers preferred
- Experience with de end-to-end delivery of data integration solutions, including operations
- Knowledge of and experience with Infosphere DataStage Enterprise Edition
- Knowledge of and experience with Scheduling tools (preferably TWS-D)
- Knowledge of and experience with SQL
- Knowledge of IBM PureData Analytics (Netezza) or other MPP architecture (nice to have)
- Knowledge of and experience with UNIX, Linux
- Knowledge of and experience with Shell Scripting (bash)
- Agile/SCRUM
- Familiarity with test driven development (nice to have)
- Knowledge of and experience with Data Vault modelling (nice to have)
- Knowledge of and experience with dimensional modelling
- Knowledge of and experience with Automated Testing (nice to have)
- Knowledge of and experience with GIT
- Familiarity with Continuous Delivery
- Knowledge of and experience with Continuous Delivery and tools like: Nolio, Ansible, Artifactory, etc. (nice to have)
- Knowledge of and experience with Hadoop/NoSQL (nice to have)
This is an urgent requirement and interviews are scheduled for next week.