From ChatGPT: There have been several speakers of the House who have come from the minority party: James K. Polk (1835-1839), two terms, of the minority Democratic Party. Nathaniel P. Banks (1856-1857) was also a member of the minority American Party