Description
We are building a data platform based on MS Azure to run proof of concepts to test cutting edge technologies applied to our business. We are looking for a MS Azure Big Data Architect to set up a data lake platform based on customer high level design, ensure the provisioning and configuration of the required services, a person who takes the technical ownership of the platform and works closely with the customer's architecture team and PoC teams during the design and implementation of the PoCs.
Location: Remote from Bucharest and very little travel.
1.1 Responsibilities
- Define and assess about the infrastructure and resources required from Azure Paas
- Support the different proof of concepts in the Azure Solutions portfolio and integration with other clouds and backends.
- Provide sizing and requirements to install different Azure resources, including data storage, data transformation, serving layer, data governance, and security compliance.
- When required, decommission Azure Solutions ensuring knowledge acquired is retained.
- Elaborate policies and procedures to govern the data platform and the different services based in their experience and best practices.
- Monitor the platform and provide KPI about performance, consumption and cost.
- Assess about improvements in the process and tools.
- Data Lake Specific:
- Ability to identify the different options for data ingestion from MS Azure offering and matches with the business requirement - streaming, sftp, data factory and also SDI to get data from SAP BW
- Ability to set up the proper data folder organization (data governance) considering type of data, quality of the data, security and performance
- Ability to identify the data transformation offering from Azure - data bricks, data analytics and define which one to be used according to the transformation requirements.
- Broad knowledge in terms of serving layer options: HD Insight, Hadoop, Spark, Cosmos DB, Azure SQL, Azure SQL Datawarehouse, Analysis Services and defining which one should be used for the business requirements
- Ability to code in different languages: C#, R, SQL, Python, etc.
- Ability to set up the data catalog for metadata management
- Sizing the storage and computing requirement
- Recommend/Apply known best practices to ensure sustainability and scalability
- Full understanding of MS azure services management/provisioning/configuration
1.2 Technical Skills
- Minimum of 10 years' experience in the technology field.
- Specific technology components and languages: HD Insight, Hadoop, Spark, Cosmos DB, Azure SQL, Azure SQL Datawarehouse, Analysis Services,C#, R, SQL, Python, etc., streaming, sftp, data factory, SAP BW.
- 4+ years of strong experience with Azure cloud including PaaS and IaaS architectures. Others like Amazon Web Services (AWS) or Google Cloud Platform is an asset.
- Capable of technical deep dives into infrastructure, databases, and applications as needed, yet cognitively agile enough to have strategy discussions with leadership.
- Experience in
- implementing, running and monitoring Azure cloud platforms.
- Planning and implementing wide range Azure solutions.
- Azure integration with other backends (SAP, Oracle, ), API management.
- Analytics.
- Data Lake. Data Management.
- DevOps, Continuous Integration and Continuous Delivery tools.
1.3 Additional Skills
- Excellent organizational, coordination, interpersonal and communication skills, proficient in English language.
- Must understand the Agile frameworks and have worked on an agile team.
- Proactive and problem-solving aptitude.
- Able to work independently, setting deadlines to achieve the goals.
- Good organizational skills.
- Proficient in English language.
- Experience in working in international and multicultural environments.
- BSc/BA in Computer Science, Engineering or a related field.
Start: ASAP
Location: Remote and Bucharest
Duration: 6 months + Extensions