Description
Software Data Engineer
Amsterdam
Contract
EUR/day
The Company
A leading technology business developing an exciting ecosystem
The Role
You will contribute to a variety of exciting projects ranging from designing robust and fully automated ETL/ELT processes to building tools for improving company-wide productivity with data. You have a passion for designing, implementing and operating stable, scalable and efficient solutions to flow data from disparate sources into data lake. As the Data Engineer, you will influence data architecture and technology decisions for engineering best practices.
Build scalable and reliable near Real Time data pipeline that collects, transforms, loads and process data from various internal and external data sources,
Build a scalable distributed data store
Own data quality for the pipelines you build and make them auditable,
Collaborate with data scientists to make data available for ad-hoc querying, Real Time dashboards, and production machine learning models,
Build self-service tools that helps the business users to extract, analyze and visualize data faster and perform advanced analysis,
Evaluate new technologies and build prototypes for continuous improvements in Data Engineering.
The Individual
BS/MS with quantitative focus (eg Computer Science, Economics, Mathematics, Physics, Statistics) or equivalent practical experience,
Experience in Big Data and data streaming technologies (Hadoop, Kinesis, Kafka, Spark),
Experience in designing ETL/data pipeline solutions (AWS Glue/Apache Airflow preferred),
Experience in Amazon Redshift and/or Snowflake highly preferred,
Experience in building large-scale, distributed systems using Python, Java or Scala,
Positive outlook towards work, strong work ethic and ability to work in a team environment.
ConSol Partners
We are a leading consultancy in the niche IT sector. We work with companies ranging from small start-ups to multinational conglomerates on both permanent and freelance positions.
ConSol Partners focus only on niche markets to give unrivalled access to our extensive network of highly skilled candidates so we can delivery only the highest quality to our clients.
Founded in 2008, ConSol Partners are one of the world's leading technology recruitment brands with headquarters in the City of London and international offices in Los Angeles & Boston. ConSol Partners provide permanent and contract recruitment solutions to FTSE & Fortune 500 companies, global brands and start-ups across the Internet supply chain of Communications, Cloud and Digital.