Description
Data EngineerRemote with travel to Brentford/Ware adhoc
Up to £620 per day Umbrella
Contract until August 2022
GSK are seeking an experienced Data engineer to join them on an interim basis to join the Pharma Supply Chain CoE, supporting on a number of projects.
Essential Tech Skills:
- Around 4+ years cloud experience (Azure, AWS or GCP). Azure preferred.
- Minimum 3 years' experience with Spark/Azure Databricks, SparkScala, pyspark(preferred)
- Must have Hands on experience with Databricks Deltalake
- Must have Hands on experience with lakehouse architectures - Databricks Structured streaming, use of Event Hubs, Kafka, Azure Stream analytics
- Strong experience of working with big data solutions & data platform products & services on Microsoft Azure such as Databricks, Synapse (DW and Analytics), Data Factory, Data
- Explorer, SQL Database, PySpark, Azure Datalake Gen2, Storage Accounts etc.
- Knowledge of Object Oriented programming experience eg: Python, Scala, R etc
- Hands on experience with Azure Devops, Git, setting up CI/CD pipelines
- Hands On experience with PyTest, Unit Test
- Knowledge of Azure Analysis Service Tabular Models and PowerBI reports
- Experience of utilising the appropriate development, data engineering (ETL, Real Time processing) principles to suite requirements
- Experience of applying appropriate standards and principles when delivering data ingestion and data transformation into target data models
- Knowledge of Software Development Lifecycle and Agile methodologies (SCRUM)
- Strong written and verbal communication skills to gather requirements
Desirable Skills:
- Experience of leading a team of data engineers
- Experience in the commodities R&D or Pharma services
- Knowledge of application development architecture tools, technology frameworks and security principles
- MDM, Collibra data catalogue
Personal Attributes:
- Adaptable to change, versatile and pragmatic
- Uses best practice development techniques but can change approach according to conflicting timelines/risks involved
- Comfortable talking to R&D business users and can translate business needs into tangible IT deliverables
- Keeps up-to-date knowledge with recent IT software developments (open source and cloud in particular)
- Uses initiative and owns end-to-end solution delivery
- Brings ideas to the table, is inquisitive and excited by new technology
- Proactively communicates and shares understanding and experience within a team
- Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items