Description
Talend On Cloud Data EngineerWorking From Home/Brentford
3 Month Contract
Ability to work with both IT and business in integrating analytics, analyse business requirements, use-cases in order to define the optimal ETL design and build data pipelines using Talend Enterprise edition latest version (7.x)
Strong ability to design, build and maintain data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management for large, heterogeneous datasets and multiple file types like flat, csv & parquet.
Demonstrated ability to work across multiple deployment environments including [cloud, on-premises and hybrid], multiple operating systems and through containerization techniques such as [Docker, Kubernetes, and others].
Experience should include [ETL/ELT, data replication/CDC, message-oriented data movement, API design and access] and upcoming data ingestion and integration technologies such as [stream data integration, CEP and data virtualization].
Writing SQL queries against any RDBMS with query optimization with strong analytical, problem solving, and troubleshooting abilities
Experience working with a cloud-based environment (Azure) mainly with delta data lake implementation
Hands-on development exposure on Microsoft Azure cloud services-Spark structure streaming with Azure, Spark on HD insight, Azure Stream Analytics, Azure Data Factory (v1 & v2), Azure Blob Storage, Azure Data Lake Store (Gen2), Delta Lake
Dev-Ops processes (including CI/CD) and Infrastructure as code fundamental
Data Engineer - Talend Data Integration Developer Certification is must for this requirement.
Good Communication skills