Our Federal Government client is seeking experienced Senior Data Engineers with strong expertise in modern data engineering and cloud-based data platforms.
The successful candidates will have demonstrated experience in migrating SAS code, workflows, and reporting processes to Databricks, while preserving existing business logic and ensuring data integrity, accuracy, and quality throughout the migration process.
Job Requirement
- Demonstrated experience designing and delivering scalable Databricks data solutions using PySpark, Spark SQL, SQL and Delta Lake.
- Demonstrated experience migrating SAS code, workflows and reporting processes to Databricks while preserving business logic and data quality.
- Experience building maintainable ETL/ELT pipelines and data models, including automated validation, monitoring and performance optimisation.
- Proven capability with Azure DevOps, Git, CI/CD, source control and controlled deployment practices.
- Ability to apply security, privacy, metadata and data governance controls and produce clear technical documentation.
Canberra
If you are interested in the above job opportunity, please apply through the links provided or please feel free to contact Newman for more details.
newman.ponniah@calleo.com.au
0404 331 242
Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.
Calleo is an equal opportunity employer, and we encourage applications from all people including Aboriginal and Torres Strait Islander people.
Follow Calleo on LinkedIn and visit our website to keep up to date on all our current job vacancies:
www.linkedin.com/company/calleoresourcing
www.calleo.com.au
