Description
Title: ETL Developer
Location: Oakland, CA
Duration: 6 Month +
ITDSS ETL Developer - Job Description December 2011
Position Summary:
The IT Business Intelligence & Reporting group of IR&C Application Services is charged with the development and maintenance of conversion and interface programs to support the implementation of UCPath. The position requires considerable administrative and technical coordination in a highly complex technical and organizational environment and results in systems designed to meet the conversion and interface requirements.
Under direction of the IT Business Intelligence Manager and other members of the BI team, the incumbent is responsible for designing and implementing robust Extract Transform and Load applications and processes to load data and supporting metadata into the decision support systems. Responsible for the ongoing operational stability of the ETL processes ensuring they are properly monitored and audited to provide data integrity, accuracy and timeliness of delivery.
Proposed Job Duties
Function % Duties Ess Duty?
Build and Maintain ETL processes
90%
Working closely with Data Architect, data modelers, data analysts, business analysts and BI developers to understand requirements and using the InfoSphere toolkit and ETL best practices, develop ETL processes in support of the requirements, validate that they meet business and technical specifications;, ensure that any issues raised during testing are addressed prior to migration into production; and manage ongoing maintenance of the system and data.
Work includes:
- Design, build, test and maintenance of extract processes to assure the selection of correct data, including design, test and implementation of parsing rules to assure selection of correct data and build of data profiling to assure ongoing correctness of extracted data.
- Design, build, test and maintenance of transform rules and processes to derive the correct data from the extracted data and to transform it into the required format and structure to support the business requirements
- Design, build, test and maintenance of the process to properly load the transformed data into the target database and the associated metadata into the enterprise metadata repository.
- Development and execution of ETL test plans.
- Manage maintenance of the system and data including monitoring and data profiling to assure ongoing data quality, ongoing monitoring and optimization of the system to manage scalability and performance; and identification and implementation of improvement opportunities for key development processes.
- Provide the BI Manager and the Data Architect with status and progress reports on development and maintenance activities as required.
- Related Activities 10% Other duties as assigned.
Proposed Job Requirements
Job Requirements Req/Pref Disp Ord
Minimum four years experience in data related work with at least 2 years as a senior ETL analyst/developer for large, complex decision support systems. Hands on experience with IBM DataStage 8.1, including extensive experience with parallel job design and development and strong SQL coding skills, is required. Experience with IBM QualityStage and FastTrack is preferred. Working experience with revision control systems, Linux platform, Shell Scripting, and DB2 database is preferred. Strong familiarity with multi-dimensional Star schema and general DBMS concepts is required.
R
1
Extensive experience in extract transform and load, data profiling, data quality, metadata management and data intake for large complex data systems. Ability to analyze,verify, and document the accuracy of the developed ETL code through self-directed testing.
R
2
Bachelors Degree in Information Systems or a related field or an equivalent combination of education and experience.
P
Strong interpersonal skills; ability to work on cross-functional teams.
P
Strong verbal and written communication skills with an ability to express complex technical concepts in business terms and complex business concepts in technical terms
P
Self motivated and independent, able to work with a minimum of supervision and able to work well with stakeholders and project staff
P
Ability to prioritize and multi task across numerous work streams
P
Ability to plan and organize technical work and deliverables. Able to lead teams to consensus decisions on complex business and technical data challenges. Ability to follow guidelines and adhere to the established software development standards and conventions.
P
Deep knowledge of best practices through relevant experience across data-related disciplines and technologies particularly for enterprise wide data architectures and data warehousing/BI.
P
Experience with IBM Datawarehouse environment, InfoSphere tool set and Business Objects tool set. P
Significant Contacts
Title/Organization Purpose of Contact Frequency
Business Sponsor/Stakeholder/Project Manager
Elicit requirements, translate into technical ETL requirements, plan and participate in development of test plans and activities
As needed
Business Intelligence Group Manager and Technical Leads
Take direction, provide status as required, plan and execute work plans and initiatives
Daily
Other IR&C Managers and Technical Experts Collaborate with other IR&C staff to assure deliver of the decision support system.
As scheduled