Description
- We are looking for a Developer with experience working as Big Data and Cloud(AWS, Microsoft Azure) Engineer with that Designs, modifies, develops and implements software programming applications and components. Supports and/or installs software applications and components. Works from written specifications and pre-established guidelines to perform the functions of the job
- Primary expertise in an emerging technology where there may be fewer available resources such as Hadoop, Big Data, Spark Shell, Impala, Oozie
- 2+ years of experience working as Big Data and Cloud(AWS, Microsoft Azure) Engineer with a proven track record of designing, developing and implementing large-scale intuitive enterprise solutions
- AWS Certified Associate - Solution Architect, Developer, and SysOps Administrator
- Proficient in utilizing cloud computing virtualization technologies, storage architecture & AWS technologies such EC2, S3, EMR, Redshift
- Strong competency in HIVE schema design, Partitions, Bucketing and high-speed query engine Impala, data imports and analysis
- Expertise in technologies like Hadoop ecosystem components, HDFS, YARN, Tez, PIG, Hue, HQL, HIVE, Impala, Sqoop, Flume HBase, Oozie, Hadoop distribution (CDH/HDP), Spark, Scala, Python
- Familiarity with DevOps related automation tool
- Experience in working with both agile and waterfall methodologies
- Strong interpersonal, analytical, and problem-solving skills with proven capability to deliver excellent results in competitive environment
- Experience with Spark Shell
- Experience with other financial services clients also preferred