AI Engineer, AI & Applications

Firmus Technologies is hiring an AI Engineer in Sydney to build the operational backbone for its AI Factory platform. The day-to-day work involves creating end-to-end workflows that manage the full lifecycle of machine learning models, from initial training through to deployment and ongoing monitoring. You will establish rigorous governance structures, including automated evaluation gates and clear promotion paths to ensure that model releases are repeatable and safe for production use. A significant part of the role focuses on enabling the Model Arena initiative by designing evaluation pipelines that allow for data-driven, reproducible choices for retrieval-augmented generation and agentic applications. You will also be responsible for maintaining the reliability of core AI features, such as inference services and training jobs, while defining quality standards and incident response procedures. The position requires hands-on experience with MLflow to manage model registries, versioning, and access controls, ensuring full traceability and lineage across all artifacts. Collaboration is central to this job, as you will partner with software engineers on continuous integration and deployment gates, work with data scientists on quality metrics, and support operations teams during high-level incident response. The advert describes this as a pioneering role for an experienced professional who wants to treat AI systems with the same level of trustworthiness and observability as core infrastructure. No specific educational qualifications, language requirements, or hybrid working arrangements are detailed in the provided text.