Description
EDW Data Engineer
Responsibilities
- Analyze & translate functional specifications & change requests into technical specifications.
- Design, Develop, Implement ETL framework for Enterprise DW system.
- Executing unit tests and validating expected results; iterating until test conditions have passed Translate business needs into end-user applications.
- Ensure accuracy & integrity of data & applications through analysis, coding, writing clear documentation & problem resolution.
- Troubleshoot and remediate issues impacting processes in ETL framework.
- Modifying existing code to provide defect fixes for existing ETLs.
- Coordinate and Collaborate with ETL team and business users to implement all ETL procedures for all new projects and maintain effective awareness of all production activities according to required standards and provide support to all existing applications.
- Provide support to all ETL schedule and maintain compliance to same and develop and maintain various standards to perform ETL codes and maintain an effective project life cycle on all ETL processes.
- Keep abreast of the tools, techniques and components being used in the industry through research and applies this knowledge to the system(s) being developed.
Requirements
- Hands-on experience with all aspects of designing, developing, testing and implementing ETL solutions
- Strong Scripting skills - Python ( a big plus ), Shell etc.
- Hands on experience in Database technologies like Oracle, MySQL, Teradata or likes.
- Knowledge of Big data systems - Hadoop, Hive, Spark etc.
- Experience with data warehousing and star-schema (dimensional) data models a plus.
- Working knowledge of Linux/Unix Operating systems
- Working knowledge of MPP systems
- Packaging and release management.
- Ability to work in a fast-paced environment on several projects
- Solid understanding of SDLC, software best practices and development methodologies
- Strong analytical and diagnostic skills
- Good knowledge of metadata, and using/managing metadata
- Ability to develop and organize high-quality documentation
- Take responsibility for performance tuning
- Excellent verbal and written communication skills
For mor info please call Michael.