Data Engineer (Azure DataBricks)

An opportunity exists for an experienced Data Engineer to support the development and optimisation of enterprise data platforms within the technology environment. Reporting to the Data Platforms Engineering Lead, this role is responsible for designing, building and maintaining scalable and secure data infrastructure that enables analytics, reporting and data-driven decision making.

Working within the Technology team, the role collaborates with data scientists, analysts, developers and business stakeholders to deliver reliable data pipelines and modern data solutions that support operational and strategic outcomes.

Key Responsibilities

Data pipeline development

• Design, build and maintain scalable data pipelines and ETL processes using Azure Data Factory and Databricks.
• Integrate data from multiple sources including APIs, databases and structured datasets.
• Develop notebooks and workflows using PySpark and Spark SQL.

Data platform optimisation

• Monitor, optimise and maintain data workflows to ensure data quality, reliability and performance.
• Support the development of modern cloud-based data solutions using Azure technologies.
• Maintain best practices for data security, governance and platform performance.

Collaboration and delivery

• Work closely with data scientists, analysts, developers and business stakeholders to support data requirements.
• Contribute to the delivery and improvement of enterprise data platforms and engineering practices.
• Support the monitoring and reporting of platform performance and operational metrics.

What You Will Bring

• Bachelor’s degree in Information Technology, Computer Science or a related discipline.
• Around 5+ years’ experience in data engineering or data platform roles.
• Experience building and maintaining Azure-based data pipelines using Data Factory and Databricks.
• Strong skills in PySpark, Spark SQL and modern data engineering frameworks.
• Experience working with Azure services such as Data Lake and cloud data platforms.
• Understanding of Apache Spark, Delta Lake and data integration frameworks.
• Experience with CI/CD deployment practices using Azure DevOps and Git.
• Strong analytical and problem-solving skills with attention to detail.
• Ability to collaborate with cross-functional teams and communicate technical concepts clearly.

Benefits Of Working with Downer

• Work with an ASX listed company, working with market leaders.
• Grow your career with us, we are passionate about giving our people opportunities to grow through personal and professional development and continuous learning:
  • Professional development programs
    • Access to professional memberships and industry networks
• Be part of a team that cares, we foster a work environment built on support that is flexible around our employee’s wellbeing needs:
  • Flexible work arrangements
    • Parental leave
    • Employee Assistance Program
    • Programs promoting diversity and inclusion
• A range of Corporate Benefits, including: 
  • Discounted services (car hires, hotels, insurance, retail stores, gyms) 

Why Downer?

As a trusted name in infrastructure, transport, facilities management, and construction, Downer is committed to delivering projects that create a lasting, positive legacy. We’re committed to building a team that reflects the diverse communities we serve, and we welcome people of all ages, genders, sexual orientations, cultures, abilities, and lived experiences. We especially encourage applications from those whose voices have traditionally been underrepresented in our industry, including women, Aboriginal and Torres Strait Islander Peoples, Māori and Pasifika Peoples, veterans, people with disability, and neurodivergent individuals.  Even if your experience doesn’t align perfectly with this role, we’d still like to hear from you. If it feels like the right fit, apply - potential counts, and so do you.

As a WORK180 Endorsed Employer, we support flexibility that works for your life, inclusive leadership that values your voice, and equitable access to opportunity so you can do your best work and bring your whole self to it.