Big Data Developer

Lesser Poland Voivodeship, Krakow  ‐ Onsite
This project has been archived and is not accepting more applications.
Browse open projects on our job board.

Keywords

Big Data Application Programming Interfaces (APIs) Agile Methodology Databases Data Cleansing Information Engineering Web Scraping Data Store Apache Hadoop MapReduce Apache HBase Apache Hive Visualization SQL Databases Stock Control Apache Cassandra Data Science Real Time Data Apache Kafka Spark Streaming Presto Data Pipeline

Description

Responsibilities
Below are some of the responsibilities of a big data Developer:
• Design the Development of our big data platform
• Perform and oversee tasks such as writing scripts, calling APIs, web scraping, and writing SQL queries
• Design and implement data stores that support the scalable processing and storage of our high-frequency data
• Maintain our data pipeline
• Customize and oversee integration tools, warehouses, databases, and analytical systems
• Configure and provide availability for data-access tools used by all data scientists
Job Qualifications and Skill Sets
Below are the qualifications expected of a big data engineer:
• 8+ years of relevant data engineering experience
• Bachelor’s degree or higher in computer science, data science, or a related field
• Hands-on experience with data cleaning, visualization, and reporting
• At least 2 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming
• Experience working in an agile environment
• Familiarity with the Hadoop ecosystem
• Experience with platforms such as MapReduce, Apache Cassandra, Hive, Presto, and HBase
• Excellent analytical and problem-solving skills
• Excellent communication and interpersonal skills
Start date
ASAP
Duration
6 months
(extension possible)
From
N Consulting UG
Published at
18.01.2024
Contact person:
Kirubanandam Swayamprakasam
Project ID:
2704055
Industry
IT
Contract type
Freelance
To apply to this project you must log in.
Register