The first step is to open up the registry editor on Windows by pressing the Windows Key + R to bring up the RUn dialog and then type in regedt32 and hit return.
You can also search from the Start Menu and find the program as well.
You will get a UAC prompt to OK the use of the registry editor since it does make system level changes.
After you approve that prompt the registry editor will open.
You now need to drill down to this folder in the registry editor:
HKEY_CURRENT_USER>SOFTWARE>Microsoft>Windows>CurrentVersion>Explorer