You will play a key role in modernising and operationalising an existing microsimulation capability, helping to improve performance, scalability, governance and testing processes within an Azure Databricks environment. The successful candidate will bring strong R programming expertise, a solid understanding of software engineering principles and experience deploying complex analytical models into production.
Key Responsibilities:
- Analyse, review and optimise a complex microsimulation model for production deployment.
- Refactor and improve code quality, performance and maintainability.
- Optimise Spark workloads and improve computational efficiency across large-scale processing environments.
- Develop and maintain scalable data pipelines using Azure Databricks, Delta Lake and associated technologies.
- Implement best-practice software engineering and data engineering standards, including automated testing, version control, monitoring and error handling.
- Work closely with data scientists, analysts, engineers and business stakeholders to ensure accurate and effective model implementation.
- Produce technical documentation, operational procedures and architecture artefacts.
- Strong experience developing complex analytical solutions using R, including writing and maintaining custom functions.
- Demonstrated experience deploying complex models into production environments.
- Experience designing and implementing testing frameworks, validation processes and repeatable scenario testing methodologies.
- Strong knowledge of Apache Spark and large-scale data processing environments.
- Understanding of software engineering principles including modular design, automated testing and source control.
- Excellent stakeholder engagement and collaboration skills.
- Experience with Azure Data Factory, Azure Storage and Unity Catalog.
- Exposure to labour market analytics, ABS datasets and ABS TableBuilder.
- Previous experience within Federal Government or other regulated environments.
- AGSVA Baseline (or higher) security clearance
- Contract through to June 2027 with a high-profile Federal Government program.
- Work with modern cloud technologies including Azure Databricks, Spark and Delta Lake.
- Flexible locations available across multiple Australian capital cities and regional centres.
- Opportunity to contribute to high-impact modelling and analytics initiatives that support government decision-making.
- Collaborative environment working alongside experienced data scientists, engineers and analysts.
Due to the nature of this role, this job is open to Australian Citizens only who hold an AGSVA security clearance.
Calleo is an equal opportunity employer and we encourage applications from all people including Aboriginal and Torres Strait Islander peoples.
Follow Calleo on LinkedIn and visit our website to keep up to date on all our current job vacancies:
www.linkedin.com/company/calleoresourcing
www.calleo.com.au
