The speaker isn't a job laid out in law other than being listed as 3rd in succession. It exists at the acceptance of some rules adopted by a majority of the house. Those rules could just as well not include any speaker, it could call for everyone to dress as a banana on Tuesday.