07/09/2023 updated

ZM
100 % available

Data Engineer

United Kingdom
Only remote
M.Phil in Mathematics
United Kingdom
Only remote
M.Phil in Mathematics

Profile attachments

ZainabResume.pdf

Asset ManagementCloud ComputingComputer ProgrammingDatabasesInformation EngineeringData ManagementMachine LearningVisualizationRequirements AnalysisSolution ArchitectureScriptingTeam Management
Self-motivated and highly experienced Solution Architect with an excellent track record of designing, developing and delivering digital solutions for customers in the public and private sector. Possess almost two decades of professional experience in: data, machine learning, scripting, programming, database, cloud and data-visualization, enterprise analysis, requirements planning and management, requirements elicitation, communication, solution assessment & validation and building multi-asset class enterprise level data management solutions, and leading cross-functional teams globally to new levels of success in a fast-paced environment.

Experience

Professional experience10+ years
Freelancer since2013

Languages

EnglishFluent

Project history

Data Engineer

Inovedia Technologies

Internet & IT

50-250 team member

I am the primary contact for all data engineering, data visualization and machine learning engagements.
  • Data modeler for a large-scale enterprise-wide multi-million-dollar data transformation project.
  • Replace the traditional ETL with a full-fledged real-time data management self-serve solution using Python and Azure (Synapse, Data Factory and Databricks).
  • Enhance a web application for data management of liquidity and market risk data using Django.
  • Implement data ingestion pipelines (using Airflow) to load data from Kafka and other databases and generate reports and dashboard using Power BI.
  • Implement a full DevOps process to build, test and deploy code using CI\CD and integrate package sharing using Azure Artifacts.
  • Define XSD and JSON schemas for Event Driven Architectures and Restful Web Services.
  • Define a global data dictionary to enforce strong and logical ubiquitous naming standards which eased communication and cross application integration.
  • Data Migration from on prem access, sql, and oracle database to cloud database.
  • Feature Detection in Python: Implemented a neural network for deep learning using Keras and Tensor flows to detect key facial features.
  • Data Visualization and Text Mining in Python: using matplotlib for static plots, folium for interactive plots, sklearn for text mining.

Developer

Local Pensions Partnership Investment

Banking & Financial Services

50-250 team member

Primarily responsible for developing a cloud-based data management solution thereby automating client and regulatory reporting.
Key Deliverables
  • Designed and implemented an Azure solution with an end-to-end real-time self-serve data management solution using Azure Data Factory and Syanpse.
  • Developed a DevOps process with Azure using GIT for version control of SQL objects, data pipelines and power BI reports,
  • Automated all monthly manual excel based reporting to near real-time reporting using PowerBI dashboards.
  • Process data from multiple sources to generate performance metrics.
  • Modelled and created a SQL engine to calculate expected fees using terms and conditions specified in the IMAs.
  • Power BI fee wallet displaying the current fees being charged versus what’s expected.
  • Implemented Python scripts to flatten multi-level nested JSON hierarchies.

Developer

Invesco

Banking & Financial Services

5000-10.000 team member

Primarily responsible for supporting the global needs of risk and performance clients across a range of projects.
Key Deliverables
  • Designed and implemented an end-to-end data workflow to generate golden copy OTC positions used for counterparty risk reporting.
  • Process daily data from multiple sources to generate liquidity metrics and produce daily batch reports to aid regulatory reporting.
  • Designed an exception handling and reporting process and integrate it in the existing Counterparty Risk framework processing data from multiple sources.
  • Developed daily emails using Python for Counterparty and Liquidity processes to report data exceptions and metric outliers using Traffic Light convention.
  • Extended the DevOps process for Counterparty risk using TFS for deploying web applications
  • Use Python to load performance data, generate analytics and email watchlists.
  • Model and implement processing of CMLN, Reverse Repos, TBAs, Synthetic ETFs using Excel, SQL and Python to enhance risk reporting.
  • Collaborative development of a web application for data management of counterparty risk using C# and Xamarin

Developer

Mitsubishi UFJ Securities International plc

Banking & Financial Services

1000-5000 team member

Primarily responsible for designing and implementing workflows for management of security and market data using MS SQL technologies.
Key Deliverables
  • Implement data marts for exporting daily data to Murex
  • Analyze deadlocks and optimize performance of SQL queries and stored procedures by tuning indexes through SQL Server Management Studio.
  • Created reports using T-SQL to alert about database growth and failed jobs.
  • Implemented data-quality MS-Excel reports using T-SQL and Control-M for historical data to fulfill audit and regulatory requirements.
  • Designed wireframes and developed user interfaces (powered by SQL and HTML5) for requesting new securities from Bloomberg Server API.
  • Implemented a real-time data management workflow for the Data Management Office for monitoring data and managing reference data.
  • Refine the exception management workflow to ensure the team has a manageable set of exceptions to work against on a day-to-day basis.
  • Built UIs to provide transparency on the incoming and outgoing datasets with Markit EDM

BI Specialist

LGIM

Banking & Financial Services

>10.000 team member

Primarily responsible for designing and implementing user interfaces for the Data Management Office.
Key Deliverables
  • Designed and documented an end-to-end workflow for the Data Management Office using MS SQL and HTML5.
  • Developed user interface powered by SQL for Index Management, Security enquiry, Matcher Inbox and Exception management. This involves full navigation and search functionality with full transparency using grids and graphs.

Developer

APG Asset Management

Banking & Financial Services

>10.000 team member

Primarily responsible for implementing and extending the pricing module as part of the CFAR project working alongside a team spread across Heerlen and Amsterdam.
Key Deliverables
  • Extended the logical and physical data model; and implemented the SQL database schema for managing market data.
  • Design and implement ETL processes for modelling market data from multiple vendors using T-SQL.
  • Workflow design for distributing real-time market-data and pricing data to accounting systems through TIBCO, a data distribution layer.
  • Developed a workbench in EDM using SQL to manage static and market data returns.

Developer

HSBC

Banking & Financial Services

>10.000 team member

  • Kimball’s dimensional modelling using MS SQL: designed and implemented dimension & fact tables for managing history using star schema.
  • Developed a SQL driven multi-asset class end to end ETL solution.
  • Designed and implemented a programmatic xml interface for requesting & receiving asset data and acknowledgement messages.
  • Developed a subscription based Operational Data Service in MS SQL to deliver positions and transactions data xml to consumers.
  • Implemented a reference data model in SQL for managing business static data and data for managing the publishing layer.
  • Built an Asset of Interest model to help with delivering of asset and associated data to consumers.
  • Write Fitnesse tests to ensure all SQL objects are developed in line with naming standards and integrate these tests in overnight TeamCity builds.

Over the course of 7 years, I worked as a Database Developer, Program Manager, Senior Business Analyst, Product Manager, Technical team lead, Risk Model Database Tester

Sungard

Banking & Financial Services

>10.000 team member

  • Developed a complete ETL solution processing multi-asset class data from 15+ vendors daily, and encompassed the following:
    • Setting up daily end to end data management process using SSIS.
    • On-going maintenance of the data management system, monitoring failed data processing, database growth, transaction log overflow.
    • Setting up an end-to-end exception management workflow for the operations.
    • Achievement: After significant failures of the previous project teams, I turned around this project with a team of four people (including myself) in two phases over 6 months, which is helping the organization save millions of dollars annually on an ongoing basis.
  • Designed an integrated risk management buy-side solution that would deliver to the needs of a middle office risk management team
  • Worked with the R&D team to implement a robust yield curve generation system using SQL supplemented with user-friendly SSRS reports.
  • Testing multi-asset class economically motivated risk models and performing data validation and impact analysis on client portfolios.
  • Manage the entire product life cycle from strategic planning to tactical activities by working with cross functional on-shore and off-shore global teams such as business analysts, development, quality assurance and client support.

Contact form

Log in to get in touch

You need to be logged in to use the contact form.

Sign upLog in