Yes, you literally download the installer from python.org and select the installation folder you want. This folder may very well be on a USB drive. You can also install PyCharm on your drive – and now you have a fully featured portable development environment.