- Role until June 2026 with 12 month extensions
- Candidates must hold a current AGSVA Baseline Security Clearance or higher
- Flexible working arrangements available
About the company
This government agency is Australia’s economic regulator accelerating carbon abatement. They do this by administering national schemes that measure, manage, reduce and offset Australia’s carbon emissions, supporting transparent, responsible and effective climate action across the economy
About the role
The AI Business Analyst will build a deep understanding of business problems and data/AI capabilities, translating them into clear, testable user stories and acceptance criteria for multi disciplinary agile teams. You will shape AI enabled features and services that are ethical, transparent and compliant, and ensure the right human in the loop controls, explainability and auditability are in place across the AI lifecycle.
Duties
- Elicit, analyse and translate business, data and AI requirements into epics, features and user stories, including non‑functional needs such as safety, transparency, robustness, latency, security and privacy.
- Map processes and decision points to determine AI vs rules‑based logic; define human authority levels and HITL checkpoints; document model and prompt assumptions, guardrails and safety constraints.
- Co‑design evaluation frameworks (ground truth, baselines, drift/fairness monitoring) and develop acceptance criteria and test plans for AI/ML features, including shadow testing, A/B trials, red teaming and rollback.
- Partner with data scientists, engineers and product owners to convert outcomes into model objectives and data constraints; ensure alignment with Agency AI/Data Governance and support PIAs, TRAs and records management.
- Lead workshops, discovery and backlog refinement; produce service blueprints and future‑state workflows; support change, comms and training for AI‑enabled processes and contribute to Communities of Practice.
Skills & experience
- Minimum 3+ years’ experience as a BA/Systems Analyst in digital/service delivery environments, including agile teams
- Hands‑on experience supporting AI‑enabled products in the Microsoft ecosystem (ML, NLP/LLMs, Copilot, intelligent automation) from discovery through delivery.
- Proven ability to write testable user stories and acceptance criteria for AI features, including evaluation metrics and guardrails.
- Working knowledge of responsible and secure AI practices (privacy by design, human oversight, explainability, bias mitigation) and strong stakeholder engagement/workshop facilitation skills.
- Proficient with Azure DevOps and Miro (or equivalents), with excellent written and verbal communication that influences decisions through evidence and prototypes.
Benefits
- Long term role
- Flexible working arrangements
How to apply
Candidates must be Australian Citizens with a current AGSVA Baseline Security clearance.
If you would like to discuss further, please contact Megan Hudson - megan.hudson@calleo.com.au
Calleo is an equal opportunity employer and we encourage applications from all people including Aboriginal and Torres Strait Islander peoples.
Follow Calleo on LinkedIn and visit our website to keep up to date on all our current job vacancies:
www.linkedin.com/company/calleoresourcing
www.calleo.com.au
