Join FinXL Professional Services - Data Engineer

FinXL Professional Services is a leading provider of professional consulting solutions, partnering with Australia's most respected organisations to deliver critical technology and business outcomes. We pride ourselves on connecting top-tier consultants with challenging and rewarding assignments.

FinXL is partnering with a prominent institution within the Banking sector for a 12-month assignment based in Sydney CBD.

About the Assignment

We are seeking a Data Engineer to join an enterprise data platforms team. The core focus of this engagement is a major migration project, moving from existing custom frameworks like Spark to a new AWS Glue environment. You will be instrumental in the design, development, and implementation of data pipelines, ensuring a seamless and efficient transition. This is an opportunity to apply your expertise in large-scale data processing and contribute to a significant digital transformation initiative.

Key Deliverables

• Design and build robust and scalable data pipelines for the migration to AWS Glue.
• Migrate existing custom data frameworks (e.g., Spark) to the new AWS Glue platform.
• Work with multiple data clusters, including Starburst Presto and Spark, to ensure smooth data flow.
• Implement Big Data processing solutions using technologies such as Hive, Spark, and Starburst Presto.
• Collaborate with cross-functional teams to deliver project outcomes in a fast-paced Agile and DevOps environment.

Skills & Experience

• 5-7+ years of enterprise experience as a Data Engineer.
• Demonstrated hands-on experience with AWS cloud platforms and services, including S3, EKS, and Redshift.
• Strong scripting skills in Python and/or Bash.
• Experience in a DevOps, Agile, Scrum, or Continuous Delivery environment.
• Experience with big data technologies such as Spark, Starburst Presto, and Hive.
• Excellent communication and interpersonal skills.

Application Note

Please apply now and address your application to Julia Leung. Due to the high volume of applications, only shortlisted candidates will be contacted.

Diversity & Inclusion

FinXL is an equal opportunity employer committed to a diverse and inclusive workplace. We encourage applications from all qualified individuals.