Description
Spark Data Engineer
Tremendous opportunity for a Spark Data Engineer to join a progressive technology company. You will be working on cutting edge Big Data Analytics, Data Warehousing, Business Intelligence, and ETL software projects.
You will be responsible for working on the replacement of a data platform, home grown ETL tool, and other Big Data projects for healthcare data analytics products.
Duties:Design and analyze current data ingestion processes and jobs and its logic into a new data platform, acquire data from client or secondary data sources and develop data pipeline, transform and validate data, develop and manage guidelines to ensure consistency, apply quality assurance best practices, provide production support, troubleshoot data load job failures or performance deficiencies, performance tune the data pipelines, and automate the data load processes.
Our technology stack includes Spark, MySQL, Cassandra, SQL, MapReduce, Apache, Linux, AWS, Java, Hadoop, etc.
This is a 6 month contract with the option to extend or convert. We also have a direct hire position open. THe position is based in the Roswell/Alpharetta area. Great work environment including flexible hours and the option to telecommute one day a week after 90 days. Will consider recent grads on a OPT, sponsorship, and assistance with relocation expenses for direct hire candidates.
REQUIRED SKILLS:
- 1+ years as a Data Engineer (junior to senior level)
- 1+ years of Spark Development using Java or Scala
- Experience building data pipelines
- ETL tools
- Strong SQL
- MySQL or PostgreSQL
- Strong data analysis, data analytics, and data based projects
- Linux
- Consultative personality
- Excellent facilitation and listening skills
- Ability to think outside the box for technical solutions
- Excellent communication skills
PREFERRED SKILLS:
- Agile/Scrum
- SaaS
- Hadoop
- Cassandra
- PostgreSQL
- Tableau
- Adobe Analytics
- Jira, Confluence, Hipchat
- Healthcare