Description
Senior Data Engineer
A global company pioneering the use of captured financial data are seeking a Senior Data Engineer to assist with the build and management of their advanced data platform, ingesting large quantities of data (petabytes) at a rapid scale. This is an exciting opportunity to work on a unique and innovative platform, the only of its kind in the world.
Responsibilities:
- Responsibility and design of Data warehouse
- Management of data pipelines and ETL processes
- Build advanced data streaming tools and functions
- Work with third parties for access to data and with internal teams
To be successful as the Data Engineer, you will need the following:
- High ability in functional programming (Python or Scala)
- Strong knowledge of data streaming, ideally using Spark and Kafka
- Demonstrable experience working in a cloud platform, Azure, AWS, or GCP
- Ideally previous work building solutions in Linux environment
If you are a Senior Data Engineer looking for a new role then send your CV along with availability.