Description
Senior Big Data Developer - Spark
Are you a Spark master who eats, sleeps, and breathes Big Data Technologies? We have an excellent opportunity in Atlanta for a Senior Big Data Developer who specializes in Spark and Spark Streaming for a premier IoT company. Conveniently located in the perimeter area, you will be responsible for a leading a team of engineers and architecting a Big Data infrastructure.
You must have experience processing really large data up to or more than a million transactions within a minute. This role is a for a subject matter expert that loves working with big data and has professional experience with Spark and Hadoop. You have an opportunity to work for a Fortune 30 company and have great exposure to a well known brand in Atlanta and Nationwide, working on innovative technology.
Senior Big Data Developer Requirements:
- 5+ years in Data Analytics platform using Big Data Technologies of Hadoop Ecosystem
- Spark, Spark Streaming and Spark SQL
- Strong background in Hadoop, Map-Reduce, HDFS and Hive
- Experience with Real Time analytics using stream processing frameworks (Spark/Storm ) is key
- Must have a minimum of 2 implementations on analytics on streaming data.
- Proven experience working with Kafka messaging system
- Excellent knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Knowledge and experience with Java/Scala
- Excellent communication required - will be required to work with both technical and business teams
Senior Big Data Developer Preferred Skills:
- Sqoop, Flume, nifi
- Cassandra, MongoDB, and other platforms preferred
- Implementation experience with Master Data Management or Customer 360 analytics utilizing Hadoop technologies