Description
An IT Services company are currently partnering with a global banking organisation who are undergoing a large IT transformation programme, which has created an opportunity for a Data Engineer to join their Cyber Security team.
Responsibilities:
*Designing and implementing data pipelines and data buses that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data warehouses and data lakes.
*Using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring such data is available at each stage in the data flow, and in the form needed for each system, service, and customer along said data flow.
*Working within the regulatory, and system requirements, to ensure data quality, data security, data compliance needs are met.
*Provide ongoing support to the customers within, and external to, the science and analytics environment.
*Creating innovative data driven capabilities and prototypes that push the bounds of computer security analytics.
Required skills:
*Experience designing, building, and maintaining data pipelines and ETL workflows across disparate data sets
*Experience with common data engineering tooling such as Azure Data Factory, Azure Databricks, Azure functions, Azure Logic App, Azure Monitor, Azure Log Analytics, Azure Data Lake Store, S3, Synapse Analytics and/or PowerBI.
*Experience with streaming platforms such as Azure Event Hubs or Kafka and stream processing services such as Spark streaming.
*Experience with Azure DevOps, ability to script (bash/Powershell, Azure CLI), code, query (SQL, Kusto query language) coupled with experience with software versioning control systems (eg git) and CI/CD systems.
*Advanced understanding of data transport, data pipelining, data cleaning, and data quality methods
Please note that at this stage, successful candidates will only be allowed to proceed via PAYE/Umbrella company due to IR35.
Remote - Please apply for more info.
ECS Resource Group are an Equal Opportunity Employer, for more information please click the following link:
In accordance with the Equality Act 2010, if you require an alternative form of application please click the following link: Flexible Application Process -