Australia's highest-paid public servant announced his resignation on Thursday.