You can download and run the installer for each version, which automatically installs the versions in separate directories.
Installing multiple Java versions in parallel is incredibly easy in Windows. Let's go… Step 1: Installing Multiple Java Versions
To enable these Java version change commands on your system as well, follow this step-by-step guide.