Cloud Big Data Solution Architect/Delivery Lead
Kantarmedia
Keywords
Skills
Digital Media, Web Analytics, Databricks, Hadoop, Spark, Kafka, HBase, Hive LLAP, Machine Learning, Cloudera, Platform on cloud providers Azure, AWS, Azure Cloud services, SQL Managed Instance, MySQL, Data Factory, Key Vault, Power BI, Azure Data Lake, Blob storage, Cognitive Search, Elastic Search, Hortonworks, Platform, Flume, Sqoop, Phoenix, Nifi, Streamsets, Storm, Scala, Solr, Banana, Python, Data Architecture, Cloud, Azure, Big Data, Hortonworks/Cloudera Data Platform, IBM BigInsights, BigData, Spark Streaming, Data Science, Cloudera Data Science Workbench, Zeppelin, Data Warehouse Appliances, IBM Netezza, Amazon Redshift, Azure SQL Managed Instance, Oracle, SQL Server, DB2, Informix, MS-Access, Dashboarding, PowerBI, SAP Business Objects, OBIEE, IBM Cognos, QlikView, Data Analytics/Data Mining, SAS, FastStats, ER-Win, ER Studio, ETL, Informatica, Oracle Warehouse Builder, Ab-Initio, Integrator, IBM Ascential DataStage, UNIX, PL/SQL ETL, Database Administration, Visual C#, Visual Basic, Oracle Forms Developer, SQL, PL/SQL, C, Java, Servlets, JSP, Linux, Solaris, Windows, Microsoft Project, Analytics, Data Migration, Elastic, Isilon, HDFS, Data Warehouse, Azure Cloud, Azure Cloud technologies, LTE, Visualization, Hive, IBM, BigInsights, large data, data modelling, Master Data Management, Scrum, BigData Technologies, Omniture, data mining, Physical data models, Oracle databases, Dimensional Modeling, ERWin, Reveleus, PLSQL, SDLC, Oracle Developer 2000, Unit testing, System integration, database, Oracle Pro
Project history
07/2019
-
09/2020
End Client Business Domain: Digital Media, Advertisement Intelligence/Analytics
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for modern big data advertisement
intelligence/analytics platform to perform near real-time advertising activities including
creative classification, spend, media performance and connected competitor intelligence.
* Lead architects, data modellers and data engineers to architect and deliver the solutions
that fulfil the business requirements and align with the enterprise wide vision and strategy
* Delivery lead for multiple big data projects which include end-to-end Databricks Spark
Streaming/batch pipelines for processing terabytes of digital media data from multiple data
sources and complex ETL processes.
* Have been providing advice, guidance and direction in the programme delivery processes
* Strategy to deliver Data Migration
Result: A successful implementation of Advertisement Intelligence/Analytics Platform using Azure
services like Databricks Big Data Cluster (Spark, Spark Streaming and Delta), SQL Managed
Instance, MySQL, Event Hubs, Data Factory, Key Vault, Power BI, Azure Data Lake, Blob storage,
Cognitive Search and Elastic Search.
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for modern big data advertisement
intelligence/analytics platform to perform near real-time advertising activities including
creative classification, spend, media performance and connected competitor intelligence.
* Lead architects, data modellers and data engineers to architect and deliver the solutions
that fulfil the business requirements and align with the enterprise wide vision and strategy
* Delivery lead for multiple big data projects which include end-to-end Databricks Spark
Streaming/batch pipelines for processing terabytes of digital media data from multiple data
sources and complex ETL processes.
* Have been providing advice, guidance and direction in the programme delivery processes
* Strategy to deliver Data Migration
Result: A successful implementation of Advertisement Intelligence/Analytics Platform using Azure
services like Databricks Big Data Cluster (Spark, Spark Streaming and Delta), SQL Managed
Instance, MySQL, Event Hubs, Data Factory, Key Vault, Power BI, Azure Data Lake, Blob storage,
Cognitive Search and Elastic Search.
01/2019
-
07/2019
Big Data Platform/Solution Architect
Cloudera
End Clients' Business Domains:
* Life Sciences(Bioinformatics/Genomics) and
* Banking
My Responsibilities:
* Architecture and built Big Data Cluster using Hortonworks/Cloudera Data Platform, Dell EMC
Isilon as HDFS Storage Cluster and Cloudera Data Science Workbench for self-service machine
learning.
* Designed and built end-to-end workflow pipelines for processing terabytes of genomics data.
* Designed and built end-to-end complex Data Science Machine Learning pipelines and
productionised relevant models
Result: A successful implementation of Hortonworks/Cloudera Big Data Cluster with end-to-end
workflow pipelines for processing terabytes of data and complex machine learning models.
* Life Sciences(Bioinformatics/Genomics) and
* Banking
My Responsibilities:
* Architecture and built Big Data Cluster using Hortonworks/Cloudera Data Platform, Dell EMC
Isilon as HDFS Storage Cluster and Cloudera Data Science Workbench for self-service machine
learning.
* Designed and built end-to-end workflow pipelines for processing terabytes of genomics data.
* Designed and built end-to-end complex Data Science Machine Learning pipelines and
productionised relevant models
Result: A successful implementation of Hortonworks/Cloudera Big Data Cluster with end-to-end
workflow pipelines for processing terabytes of data and complex machine learning models.
03/2018
-
10/2018
Lead Big Data Solution Architect/Delivery Lead
Tele2
Business Domain: Media and Mobile Telecommunications
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for modern big data lake/enterprise data
warehouse architecture to deliver business solutions like Sales
Orders/Renewals/Upgrades/Downgrades, Customer Base and Churn, Network Usage, Bad debt,
Fraud, Online analytics and Customer Life Cycle Value insights.
* Responsible for deploying Big Data Cluster using Hortonworks/Cloudera Data Platform on Azure
Cloud and on Premise Data Centre.
* Hands on implementation on Azure Cloud technologies.
* Helped LTE Network teams(Radio Active Network) and Core Network to analyse the parameters
which are causing the voice performance issues and take best decisions to tune the network,
there by reducing customer churn by providing better voice quality.
* Hands on experience in designing and implementing the Real-Time Geo Visualization Dashboards
with actionable insights
* Hands on implementation using Big Data technologies like Hadoop, Hive LLAP, Flume, Sqoop,
Hbase, Phoenix, Streamsets, Kafka, Storm, Spark, Spark Streaming, Scala, Zeppelin, Solr,
Banana and Python.
* Stakeholder management
* Coaching/Guiding teams to use this Big data platform based on the architectural strategies
designed by me.
* Act as a guardian for the big data cluster and make sure all the teams in the organization
follow similar guidelines.
Result: A successful implementation of Hortonworks/Cloudera Big Data Cluster, delivered advanced
analytical insights and Geo Visualization of Sales Orders/Renewals, Churn and LTE Voice
Performance metrics.
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for modern big data lake/enterprise data
warehouse architecture to deliver business solutions like Sales
Orders/Renewals/Upgrades/Downgrades, Customer Base and Churn, Network Usage, Bad debt,
Fraud, Online analytics and Customer Life Cycle Value insights.
* Responsible for deploying Big Data Cluster using Hortonworks/Cloudera Data Platform on Azure
Cloud and on Premise Data Centre.
* Hands on implementation on Azure Cloud technologies.
* Helped LTE Network teams(Radio Active Network) and Core Network to analyse the parameters
which are causing the voice performance issues and take best decisions to tune the network,
there by reducing customer churn by providing better voice quality.
* Hands on experience in designing and implementing the Real-Time Geo Visualization Dashboards
with actionable insights
* Hands on implementation using Big Data technologies like Hadoop, Hive LLAP, Flume, Sqoop,
Hbase, Phoenix, Streamsets, Kafka, Storm, Spark, Spark Streaming, Scala, Zeppelin, Solr,
Banana and Python.
* Stakeholder management
* Coaching/Guiding teams to use this Big data platform based on the architectural strategies
designed by me.
* Act as a guardian for the big data cluster and make sure all the teams in the organization
follow similar guidelines.
Result: A successful implementation of Hortonworks/Cloudera Big Data Cluster, delivered advanced
analytical insights and Geo Visualization of Sales Orders/Renewals, Churn and LTE Voice
Performance metrics.
08/2012
-
02/2018
Lead Big Data Architect/Delivery Lead
Virgin Media
Programme which consists of more than 40 data projects worth more than £10M.
Business Domain: Media and Mobile Telecommunications
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for designing large big data lake and
data warehouse which is of more than 900TB Hadoop Storage Size which helps to generate
business critical KPIs/data analytics, real-time analytics, business intelligence and high
query response solutions for meeting various requirements.
* Hands on implementation using Big Data technologies like Hadoop, Hive, Flume, Sqoop, Hbase,
Phoenix, Nifi, Kafka, Storm, Spark, Scala, Solr, Banana and Python.
* Migration from legacy data warehouses to the new data warehouse.
* End-to-end delivery and lead a large team of architects, designers, data modelers, data
analysts and developers in Mobile Transformation Programme in Virgin Mobile.
* Stakeholder management
Result: A successful delivery of a massive data warehouse on IBM BigInsights Hadoop cluster which
delivered the key KPIs of Virgin Media including Customer Base, Network Usage, Service Margin,
Sales, Stock and Care and also delivered operational processes for nearly 35 downstream systems
which meet day-to-day business needs.
Business Domain: Media and Mobile Telecommunications
My Responsibilities:
* Deliver Architecture, Strategy, Roadmap and Vision for designing large big data lake and
data warehouse which is of more than 900TB Hadoop Storage Size which helps to generate
business critical KPIs/data analytics, real-time analytics, business intelligence and high
query response solutions for meeting various requirements.
* Hands on implementation using Big Data technologies like Hadoop, Hive, Flume, Sqoop, Hbase,
Phoenix, Nifi, Kafka, Storm, Spark, Scala, Solr, Banana and Python.
* Migration from legacy data warehouses to the new data warehouse.
* End-to-end delivery and lead a large team of architects, designers, data modelers, data
analysts and developers in Mobile Transformation Programme in Virgin Mobile.
* Stakeholder management
Result: A successful delivery of a massive data warehouse on IBM BigInsights Hadoop cluster which
delivered the key KPIs of Virgin Media including Customer Base, Network Usage, Service Margin,
Sales, Stock and Care and also delivered operational processes for nearly 35 downstream systems
which meet day-to-day business needs.
04/2011
-
08/2012
Principal Consultant
BAE Systems Detica
Business Domain: Mobile Telecommunications
My Responsibilities:
* Worked as a Data warehouse Architect consultant for Virgin Media, a leading mobile telecom
and media company in UK
* Responsible for data warehouse architecture, project estimations and designed one of the
large data warehouse and business intelligence solution, data modelling, end-to-end delivery
and team management
* Involved in pre-sales and bid preparation activities
* Stakeholder management
* Master Data Management Strategy
* Lead Reviewer to choose the subcontract partners
* Lead a team of architects, designers, data modelers, analysts and developers
My Responsibilities:
* Worked as a Data warehouse Architect consultant for Virgin Media, a leading mobile telecom
and media company in UK
* Responsible for data warehouse architecture, project estimations and designed one of the
large data warehouse and business intelligence solution, data modelling, end-to-end delivery
and team management
* Involved in pre-sales and bid preparation activities
* Stakeholder management
* Master Data Management Strategy
* Lead Reviewer to choose the subcontract partners
* Lead a team of architects, designers, data modelers, analysts and developers
04/2010
-
04/2011
Data warehouse Development Manager
BSkyB Ltd.
Business Domain: Online Web Analytics, Media and Advertising
My Responsibilities:
* Managing staff of data warehouse solution architect, designers and developers in Sky Online
Business.
* Responsible for Agile project management (Scrum Master), effort estimation, cost estimation,
planning and efficiently managing budget.
* Implemented proof of concept using BigData Technologies like Hadoop, Hive, Flume, Sqoop,
Hbase, Kafka, Spark, Scala and Python in online Web Analytics space.
* Collaboratively work with directors, product managers and teams to prioritize work requests,
allocate resources and resolve technical issues.
* Lead delivery of data warehouse projects within Sky Online Business. Direct the teams to
design and build data warehouse projects which provide business intelligence
dashboards/reports and analytics related to Sky TV and Online business.
* Responsible for establishing and building relationships with directors and product managers
in various departments within Sky.
My Responsibilities:
* Managing staff of data warehouse solution architect, designers and developers in Sky Online
Business.
* Responsible for Agile project management (Scrum Master), effort estimation, cost estimation,
planning and efficiently managing budget.
* Implemented proof of concept using BigData Technologies like Hadoop, Hive, Flume, Sqoop,
Hbase, Kafka, Spark, Scala and Python in online Web Analytics space.
* Collaboratively work with directors, product managers and teams to prioritize work requests,
allocate resources and resolve technical issues.
* Lead delivery of data warehouse projects within Sky Online Business. Direct the teams to
design and build data warehouse projects which provide business intelligence
dashboards/reports and analytics related to Sky TV and Online business.
* Responsible for establishing and building relationships with directors and product managers
in various departments within Sky.
10/2007
-
03/2010
Data warehouse Architect
AOL Europe
Business Domain: Online Web Analytics, Media and Advertising
My Responsibilities:
* Design Authority
* Architectural guidance to ensure effective AOL Europe Business Intelligence (EUBI) data
warehouse delivery with high quality and low cost.
* Managed staff of solution architect, designers, developers and analysts in UK, Germany,
France, India and USA.
* Experienced in processing terabytes of Web Click stream data (Omniture), Online Ad Server
data (Adtech) and provided valuable BI reports and supported in SAS data mining activities.
* Review Conceptual, Logical and Physical data models and end-to-end ETL process/data flows
created by data modelers/solution architects and provide valuable review comments.
My Responsibilities:
* Design Authority
* Architectural guidance to ensure effective AOL Europe Business Intelligence (EUBI) data
warehouse delivery with high quality and low cost.
* Managed staff of solution architect, designers, developers and analysts in UK, Germany,
France, India and USA.
* Experienced in processing terabytes of Web Click stream data (Omniture), Online Ad Server
data (Adtech) and provided valuable BI reports and supported in SAS data mining activities.
* Review Conceptual, Logical and Physical data models and end-to-end ETL process/data flows
created by data modelers/solution architects and provide valuable review comments.
07/2005
-
09/2007
Senior Data Intelligence Technical Lead Consultant
Ericsson Services Ltd.; Satyam Computer Services Ltd.
Business Domain: Mobile Telecommunications
My Responsibilities:
* Designed scalable solutions for very large data warehouses
* Participated in Impact Assessment Workshops
* Project estimation
* Managed more than 40 team members at different levels.
* Involved in pre-sales and bid preparations
* Solution designs and analysis specifications reviews
* Performance tuning of very large data warehouses running on Oracle databases
* Onsite - Offshore team coordination
My Responsibilities:
* Designed scalable solutions for very large data warehouses
* Participated in Impact Assessment Workshops
* Project estimation
* Managed more than 40 team members at different levels.
* Involved in pre-sales and bid preparations
* Solution designs and analysis specifications reviews
* Performance tuning of very large data warehouses running on Oracle databases
* Onsite - Offshore team coordination
07/2004
-
07/2005
Senior Technical Lead
I-Flex Solutions Ltd
Business Domain: Finance, Accounting & Banking
My Responsibilities:
* Gathering requirements from customers across USA, Canada, Europe and Asia and putting
together in requirements documents
* Project Management. Managed a team size of 5 members.
* Analyzing, Multi-Dimensional Modeling and Designing using ERWin for large data warehouse
implementations of 2 Terabytes storage size
* Designing and developing customized ETL process using Reveleus/ PLSQL ETL
* Implementing end-to-end data warehouse solutions (BI and analytical solutions) for Banking
and Financial institutions.
My Responsibilities:
* Gathering requirements from customers across USA, Canada, Europe and Asia and putting
together in requirements documents
* Project Management. Managed a team size of 5 members.
* Analyzing, Multi-Dimensional Modeling and Designing using ERWin for large data warehouse
implementations of 2 Terabytes storage size
* Designing and developing customized ETL process using Reveleus/ PLSQL ETL
* Implementing end-to-end data warehouse solutions (BI and analytical solutions) for Banking
and Financial institutions.
12/1997
-
03/2001
Project Leader
Vensoft
Business Domain: Marketing, Human Resources
My Responsibilities:
* Designing & Developing applications using Oracle Developer 2000, Java, Visual Basic, Unit
testing and System integration testing
* Managing a team of 4 members
My Responsibilities:
* Designing & Developing applications using Oracle Developer 2000, Java, Visual Basic, Unit
testing and System integration testing
* Managing a team of 4 members
02/1997
-
11/1997
Sr. Programmer
Gemini International
Business Domain: Human Resources
My Responsibilities:
* Developing database applications using Oracle Pro*C & Production support
My Responsibilities:
* Developing database applications using Oracle Pro*C & Production support
Local Availability
Only available in these countries:
United Kingdom
