Description
I am looking for a Data Quality Engineer for a leading multinational in the area of Amsterdam who can start as soon as possible. The organisation is embracing Big Data technologies to enable data-driven decisions and thus is looking to expand their Data Engineering Team to stay ahead of the competition. The freelance contract will be six months with possibilities to extension.
Your primary accountability will be to maintain and mature our Data Quality Services platform. This includes Data Quality, Data Services (Virtualization) and Master Data Management. You will collaborate with data stewards, information and data architects, subject matter experts, BSAs, and other IT teams to establish the technical vision and analyze tradeoffs between usability, supportability and performance needs.
Responsibilities:
Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution.
Build utilities, user defined functions, and frameworks to better enable data flow patterns.
Research, evaluate and utilize new technologies/tools/frameworks centered around Hadoop and other elements in the Big Data space, be a strategic thinker
Build and incorporate automated unit tests, participate in integration testing efforts.
Work with teams to resolving operational & performance issues, be an effective communicator
Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
Does this sound of interest to you, or someone in your network, please contact me.