Data Engineer

Job description

FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors.

FinXL is seeking a Data Engineer to join our consulting team and be deployed with a leading organisation.

As the Data Engineer you will be part of a program that will implement contextual monitoring capabilities using products such as Quantexa.

Key Skills & Experience

  • Data and Platform Engineer background
  • Demonstrable experience designing and developing data pipelines
  • Experience in Spark, Scala (or Java), Python, Elastic, SQL (Oracle/PostgreSQL/MySQL), Restful APIs, JSON.
  • Development experience in Control-M, Airflow, Argo Workflows
  • Experience in PARQUET, ORC, CSV.
  • Experience with AWS technologies: EC2, S3, IAM, EKS, RDS, Linux.
  • Experience implementing Quantexa.
  • Experience with CI/CD tools - Bitbucket, Bamboo, Git, Argo
  • Experience working on projects involving fraud & financial crime
  • Experience with operational environments, DevOps, restart/recovery.
  • Experience building with container frameworks: Docker, Kubernetes.
  • Experience in code control, IDEs, unit testing, design, and documentation.
  • Experience in big data querying tools: Presto or Trino.
  • Experience with data quality measurement and monitoring.
  • Experience with metadata, control totals, and check sums for load assurance.
  • Experienced with DevOps approaches.
  • Experience in data mapping, relational data, and object orientation.
  • Experience in ETL tools-frameworks - DBT, parsing & handling data quality issues.
  • Agile development methodology experience.
  • Experience in Data Warehousing & ETL concepts.

Next Steps

If you would like to apply to this fantastic opportunity please apply online or call Jackie Gibbons on 0432 268 298

Code: S12