The outgoing prime minister said he leaves “with a smile” as his “work is done”