Description
AWS Data Engineer
My client has a requirement for an experienced AWS Data Engineer to join their project.
Experience Required
- Hands on experience with AWS ETL services like Glue, Lambda, EMR and experience in Real Time AWS/Big Data Analytics AWS with Python hands-on programmer requirement.
- Good to have knowledge on terraform Knowledge and experience in Agile project delivery, ie, sprint planning and updates using tools like Atlassian JIRA etc.
- Experience on Python and/or Spark programming, working with data transformation, data migration implementations and creation and use of functions, libraries, data frames
- Must have experience using Python IDEs, debugging, error-handling
- Knowledge on Python integration with Cloud service tools for ETL
- Handling CDC data with AWS pipelines.
- Willing to develop and test code using Python and AWS glue, lambda.