Data Engineer
Oct 30, 2024Information & Communication Technology Permanent Australia, Full-Time
A leading firm are in need a Databricks/Azure Data Engineer. They are building a large scale Data & Analytics platform on Azure / Databricks. This role involves working in a high performing team supporting and contributing to the development of scalable, secure data solutions, mentored by a skilled team who are supporting the organization’s digital transformation.
Banking / Financial Services Sector: You will be be heavily involved in the design, architecture, pipeline development, governance & implementation of greenfield warehouse. Working closely data architects, engineers, delivery leads & program manager to turn high-level architecture into actionable plans.
Key Responsibilities
- Design and develop of data pipelines, ETL processes, and data models on Azure Databricks
- Ensure best practices in data engineering, including quality, performance, security, and version control.
- Work with data architects and IT teams to integrate solutions and communicate insights to stakeholders.
- Uphold data governance, security, and quality standards throughout the data lifecycle.
- Working in a delivery team of 8-10 Engineers in a wider data / technology function of 30-35.
Requirements
- 4+ years experience in Business Intelligence, Data or Software Engineering verticals
- Exposure across Data pipeline builds, Modeling & Visualisations
- Strong background in ETL, Azure Cloud, Databricks, and DevOps.
- Strong experience in Python, SQL, PySpark & exposure in CI/CD
- Experienced in Power BI is nice to have as you will use infrequently
- Finance, Banking or FinTech experience highly regarded
This is a full greenfield project and a great opportunity to stamp your legacy in the Databricks world.
This position requires Full Australian work rights; Citizenship or Permanent Residency. Only applicants with the same will be considered.
Apply Online