Description
Big Data Software Engineer
Responsibilities include: Cleanse and process large raw data sets using Hadoop ecosystem and RDBMS technologies Design and develop web-based Java platforms and services to process, store, and serve large volumes of data at scale Help with ad-hoc requests from business partners for reports based on data residing in Hadoop or RDBMS Work closely with Front End web application and database developers
Analyze business requirements for complex projects. Develop proof of concepts of new technologies and evaluate the state of the art in large-scale data processing and distributed computing Demonstrate excellent oral and written communication skills to explain and document ideas
Required skills: Bachelor's degree in Computer Science/Software Engineering, Mathematics, related field, or equivalent industry experience Core Java expertise Familiarity with Scala Proficient knowledge of Apache Hadoop ecosystem Experience developing with MapReduce, Pig, and Hive Familiarity with Spark Experience developing in NoSQL databases such as HBase, Cassandra, or Accumulo Expertise with RDBMS including one of mysql, postgres, MS SQL, or Oracle
Strong Scripting skills in shell, python, perl, or ruby. Experience with best practices in software development including agile methods, code review, unit/functional/integration testing, continuous integration/deployment Expertise with the Linux Ability to learn new technologies quickly
Desired skills: Master's degree in Computer Science/Software Engineering Machine learning or probability/statistics Information retrieval with Solr/elasticsearch/mapreduce Operating distributed applications at scale including instrumenting,
The regular schedule is weekday business hours but irregular hours may be required in response to important projects or operational emergencies. This position will require 24/7 on-call readiness as directed by management. collecting, and visualizing metrics.
. Not accepting 3rd party candidates at this time.