The reason is v14 includes the Outlining and other properties which use more settings. These settings are stores in the INI files if you use the portable version. If you are placing emeditor.exe in an USB drive, you might want to copy emeditor files into a hard drive, and run EmEditor from the hard drive.
However, we still encourage using the installer whenever possible. EmEditor runs faster in the installed version (using the Registry).