Data Engineer - Google Cloud data models

Lesser Poland Voivodeship, Krakow  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Data Modeling Continuous Integration Google Cloud Git Jenkins Java (Programming Language) Architecture JIRA Big Data BigQuery Collaborative Softwares Computer Security Information Engineering Extract Transform Load (ETL) DevOps Financial Instrument Groovy Infrastructure Management Investment Banking Python (Programming Language) Cisco Nexus Switches Visualization DataOps Requirements Analysis Software Engineering SONAR (Symantec) Stored Procedure SQL Databases Stock Control Data Streaming Tableau (Software) User Stories Filing Backlogs Onboarding Qlikview Checkmarx Looker Analytics

Description

Location: Krakow, Poland
Experience: 7+ Years of Experience
Requirement:
• Design, build, test and deploy Google Cloud data models and transformations in BigQuery, Datafusion environment (e.g. SQL, stored procedures, indexes, clusters, partitions, triggers, etc.)
• Optimize data views for specific visualization use cases making use of schema design partitions, indexes, down-sampling, archiving, etc. to manage trade-offs such as performance and flexibility
• Review and refine, interpret and implement business and technical requirements
• Ensure you are part of the on-going productivity and priorities by refining User Stories, Epics and Backlogs in Jira
• Onboarding new data sources, design, build, test and deploy Cloud data ingest, pipelines, warehouse and data models/products (GCP DataFusion, Spark and etc.)
• Manage code artefacts and CI/CD using tools like Git, Jenkins, Google Secrets Manager, etc.
Responsibility:
• Experience developing BI/MI reports and dashboards in a popular tool like Qlik (VizLib Library, VizLib Collaboration, Mashups, etc.), Tableau, Looker etc.
• Experience in GCP based big data / ETL solutions DevOps / DataOps model
• Experience of deploying and operating Datafusion/CDAP based solutions
• Experience in building and operating CI/CD life-cycle management Git, Jenkins, Groovy, Checkmarx, Nexus, Sonar IQ and etc.
• Expertise of Java, Python, DataFlow
• Broad experience with IT development and collaboration tools.
• An understanding of IT Security and Application Development best practice.
• Understanding of and interest in various investment products and life cycle and the nature of the investment banking business.
• Experience of working with infrastructure teams to deliver the best architecture for applications.
Job Types: Full-time, Contract
Contract length: 6 months + Contract, Full Time
Start date
ASAP
Duration
6 months
(extension possible)
From
N Consulting UG
Published at
05.10.2023
Contact person:
Kirubanandam Swayamprakasam
Project ID:
2663897
Industry
IT
Contract type
Freelance
To apply to this project you must log in.
Register