Description
Cloud Architect - Central Government
- Fully Remote Working
- Outside IR35
- Until 31st March 2021 initially, likely to extend
Our Central UK Government client is looking for an Cloud Architect to deliver the technical capability across a number of data-driven projects, utilising a range of technologies. You will have exposure to a range of Cloud platforms with a particular focus on and Google Cloud Platform, (GCP.)
Working with leads of our cross-functional team you will be pivotal in guiding the team to help shape and design our cloud strategy. As a lead in this space you will enable data-driven decision making and participate in the design and build of the data processing system(s) with a emphasis on security and compliance, scalability and efficiency, reliability, flexibility and portability. At this point in time there is no expectation for machine learning.
You will:
- Designing data processing systems to enable our reproducible analytical pipelines to operate at required flexible scale; trading off latency, storage and throughput considerations. Our solution is likely to include both batch and streaming data: Cloud Dataflow, Cloud Dataproc, Apache Beam, Cloud Pub/Sub, Apache Kafka etc. while Apache Spark and the Hadoop ecosystem may be an option for dealing with large volume data such as the Census. Job automation and orchestration such as Cloud Composer are also necessary concerns.
- Designing storage systems while considering the effective use of managed services (eg Cloud Bigtable, Cloud Spanner, Cloud SQL, BigQuery, Cloud Storage, Cloud Datastore, Cloud Memorystore) and balancing strategic decisions against the storage costs and performance.
- Designing for security and compliance to meet the requirements of our platform for identity and access management (eg Cloud IAM), data security (encryption, key management), privacy (eg Data Loss Prevention API) and legal compliance (eg General Data Protection Regulation (GDPR).
- Designing for resilience and efficiency via test suites, pipeline monitoring, autoscaling resources, planning and stress testing data recovery (fault tolerance etc.).