Description
My Client based in Dublin is looking for an AWS Data Engineer who can REMOTE, but you must be willing to go to client site when required and safe to do so.
Important Skills: hands-on experience on relevant skills related to AWS Data Lake inclusive of Glue, S3, Athena, EMR, DynamoDB along with PySpark (mandatory) and CI/CD exposure.
- Hands on experience with AWS ETL services like Glue, Lambda, EMR and experience in Real Time AWS/Big Data Analytics AWS with Python hands-on programmer requirement.
- Good to have knowledge on terraform Knowledge and experience in Agile project delivery, ie, sprint planning and updates using tools like Atlassian JIRA etc.
- Experience on Python and/or Spark programming, working with data transformation, data migration implementations and creation and use of functions, libraries, data frames
- Must have experience using Python IDEs, debugging, error-handling
- Knowledge on Python integration with Cloud service tools for ETL
- Handling CDC data with AWS pipelines.
- Willing to develop and test code using Python and AWS glue, lambda.