Senior Data Engineer

Job description

Senior Data Engineer
Leading government client (consulting through FinXL)

FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors.

Shape the flow of critical data and drive a major national transformation! FinXL is seeking a Senior Data Engineer to join our consulting team and be deployed with a leading government client on a key transformation engagement. FinXL is also able to take over existing visas and provide sponsorship for consultants.

Responsibilities

  • Design and implement MS SQL ETL pipelines to ingest and enrich NetFlow data.

  • Build high-performance T-SQL ETL jobs for deduplication, enrichment, and aggregation.

  • Produce validated deployment feeds (JSON/CSV) for CSM and APIC consumption.

  • Implement data lineage tracking from aggregated tuples back to raw flows for auditing.

  • Create and manage Tidal job definitions, retries, alerts, and exception handling.

  • Optimise partitioning, indexing, and query plans for very large NetFlow tables.

Key Skills & Experience

  • Expert skills in MS SQL Server including T-SQL, indexing, and partitioning.

  • Proven experience with query tuning and window functions on large datasets.

  • Experience producing controller-ready export formats such as JSON and CSV.

  • Familiarity with scheduled job orchestration tools, preferably Tidal.

  • Understanding of operational alerting and exception handling processes.

  • Experience with Dask/Spark for prototyping and data lineage is desirable.

  • Experience with PowerBI or similar visualisation tooling is highly regarded.

Why Join FinXL?

  • Long-term 6-12 month contract with a major government client.

  • Design & build critical high-performance T-SQL ETL pipelines.

  • Sydney hybrid role offering work-life balance and flexibility.

Next Steps

If you would like to apply for this opportunity, please submit your CV via SEEK. Please note that due to the volume of responses, only shortlisted consultants will be contacted.