Description
Senior C# Developer
Whitehall Resources is looking for a Senior C# Developer
Role in the team:
The Developers will be part of a team building the data platform. For start, we will be transforming data from existing SQL Server Columnstore indexes into custom formats.
We will also work on optimisation of existing data processes.
Description:
- Optimisation of WP operation setup for High- Performance Scientific DB inbound data setup:
- Optimisation of existing data replication
- Extraction of data from SQL Server
- Transforming data
- Add TagName column (join a table based on TID, which is part of the main table.
- Transform from tag-oriented format, which means each tag value is placed in a separate row this.
- Output data, must be transformed to row- oriented format, which means each tag must become individual columns to the row.
- Divide data into a few row groups (2-4 groups)
- The business will define the roles for this transformation
- Data to be delivered ad files (one file per WP-farm per row group per day)
- Output files are delivered to an interface (probably Apache NiFi)
- First step is a flow to transfer all historical data from existing DB.
- Next step (in scope) is refine the solution as an ongoing floe, which three times a day new arrived data
- Business decides in which order these (first/next) steps are implemented
Key requirements:
- Experience in being a Senior C# Developer
- Strong skills on SQL Server
- Experience in T-SQL and query tuning
- Practical experience on SQL Server Columnstore would be a plus.
All of our opportunities require that applicants are eligible to work in the specified country/location, unless otherwise stated in the job description.