Description
Senior Big Data Engineer/Big Data Architect/Big Data Principle - Portugal, Porto, 2-3 Month Contract - Competitive daily rate (dependant on experience)
My client, a growing eCommerce company based in Porto, Portugal is looking for someone with a strong background in Big Data, who would be happy to help to define the strategy for the full shift to scalable data processing using big data, but also able to discuss technical details with the team.
Required skills:
- Data Architecture/Data Integration/Databases/Hadoop/Project Management
- Experience in leading projects for international companies, from architecture to implementation
- Tech Skills:
- Hadoop, HDFS, Map Reduce, Pig, Hive, HBase, Sqoop, Flume, Oozie, SPARK, Play and SCALA
- ETL tools: SSIS (plus), Airflow as orchestration (plus)
- Experience in Big Data Ecosystems: Hadoop Cluster, CDH, Cloudera Manager, MapReduce, YARN, HBase, Zookeeper, Sqoop, Name
- Node, Data Node, Oozie, Flume, Hive, Impala.
- Capable of processing large sets of structured, semi-structured and unstructured data
- Excellent knowledge of data architecture including data ingestion pipeline design, Hadoop architecture, Lambda Architecture, partitioning,
- compression, advanced data processing
- NoSQL: Cassandra, MongoDB, HBase
- Able to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review.
- Data warehouse architecture Dimensional Modeling (Star Schema) and NoSQL Modeling.
- Good Experience: SQL, Stored procedures, database table design, partitioning, materialized view, indexes and performance tuning in
- SQL Server (ideally).
- Previous experience with Onshore and Offshore delivery model.
- Well organized, strong work ethics and willingness to work hard to achieve employer objectives.
- Strong team player with Excellent Leadership, Interpersonal and Communication Skills and ready to take an independent challenge
Is this exciting opportunity of interest? If so, please send an updated CV to (see below) and call Kate to discuss in more detail.