Windows 95 also runs on top of MS-DOS. Only the startup process has been automated to go from MS-DOS straight into Windows. Since Windows XP the complete DOS layer between computer and Windows has been removed.
But you are right, 3.11 was the last Windows that had to be booted manually from DOS.
Nostalgic anyway to see all this old screens in this video :)