Description
Big Data Engineer
Exciting opportunity to work with an enterprise organization on their state of the art Big Data Platforms. In this position, you will need to be strong with Hadoop, Spark and hands-on with implementing solutions. You must have experience with Hadoop, Spark, Data Ingestion, SQOOP or similar and big data technologies. This role will be helping to build out a state of the art big data platform for an enterprise organization on a highly visible team!
The ideal candidate will have come from a software engineering or data science background and have deep knowledge of statistical analysis including technologies such as Spark, Hadoop, Storm ect. and be able to work with large, complex data sets.
This is a long term contract located in the heart of Midtown, walking distance from Marta. In this position, you will have the opportunity to work in sync with an innovative team that is disrupting their industry. Excellent team and work environment with flex hours.
REQUIRED SKILLS:
- 4+ years technical experience with a background in software engineering or data science
- 2+ years experience with Big Data
- Experience with stream-processing/workflow systems: Apache Nifi, Storm, Spark-Streaming ect.
- Experience with Spark, Hadoop, Kafka ect.
- SQOOP or similar
- Experience with HBASE or Cassandra
- Experience Building Big Data ingestion pipelines between Data Source and Data Lake
- Excellent communication skills and ability to work in fast-pace environment
PREFERRED SKILLS:
- HBase, MapReduce, Pig & Hive, Qubole, Databricks, etc.
- Scripting ability (bash or powershell)
- Linux knowledge
- Experience scaling applications and following agile methodologies
- MS/MIS in Computer Science or equivalent education/training/experience
Must be authorized to work in the U.S./Sponsorships are not available