DataBricks Engineering Lead

The DataBricks Engineering Lead plays a key role in shaping and delivering enterprise data capabilities across Downer. This role leads the design, implementation and optimisation of modern cloud-based data platforms, enabling reliable, secure and scalable data solutions that support data-driven decision-making across the organisation. Working closely with cross-functional teams, vendors and business stakeholders, this position combines deep technical expertise with strong leadership to drive innovation and continuous improvement across the enterprise data ecosystem.

Key Responsibilities

• Lead the design, development and optimisation of enterprise data solutions using Azure Databricks to support analytics and reporting solutions.
• Build and manage scalable data pipelines and transformation frameworks, ensuring data quality, integrity and performance across the platform.
• Provide technical leadership and guidance to internal and vendor engineering teams, supporting best practice data engineering and modern DevOps and CI/CD practices.
• Collaborate with business units, digital teams and data stakeholders to deliver high-quality data solutions aligned with enterprise strategy.
• Drive continuous improvement in platform performance, cost optimisation, governance and data security.

What You Will Bring

• Extensive experience (10+ years) in data engineering and cloud-based data platforms, particularly within Azure and Databricks environments.
• Strong technical expertise in PySpark, Spark SQL, data pipelines, cloud data lakes and modern data architecture practices.
• Proven experience leading engineering teams and collaborating with vendors and stakeholders in large enterprise environments.
• Solid understanding of data governance, security frameworks and enterprise data management principles.
• Experience with analytics and reporting tools such as Power BI and familiarity with emerging AI and data technologies.
• Excellent problem-solving, communication and stakeholder management skills, with the ability to influence and drive outcomes across technical and business teams.

Benefits Of Working with Downer

• Work with an ASX listed company, working with market leaders.
• Grow your career with us, we are passionate about giving our people opportunities to grow through personal and professional development and continuous learning:
  • Professional development programs
    • Access to professional memberships and industry networks
• Be part of a team that cares, we foster a work environment built on support that is flexible around our employee’s wellbeing needs:
  • Flexible work arrangements
    • Parental leave
    • Employee Assistance Program
    • Programs promoting diversity and inclusion
• A range of Corporate Benefits, including: 
  • Discounted services (car hires, hotels, insurance, retail stores, gyms) 

Why Downer?

As a trusted name in infrastructure, transport, facilities management, and construction, Downer is committed to delivering projects that create a lasting, positive legacy. We’re committed to building a team that reflects the diverse communities we serve, and we welcome people of all ages, genders, sexual orientations, cultures, abilities, and lived experiences. We especially encourage applications from those whose voices have traditionally been underrepresented in our industry, including women, Aboriginal and Torres Strait Islander Peoples, Māori and Pasifika Peoples, veterans, people with disability, and neurodivergent individuals.  Even if your experience doesn’t align perfectly with this role, we’d still like to hear from you. If it feels like the right fit, apply - potential counts, and so do you.

As a WORK180 Endorsed Employer, we support flexibility that works for your life, inclusive leadership that values your voice, and equitable access to opportunity so you can do your best work and bring your whole self to it.