WinSCP

I just found out that the WinSCP guy has a portable version of his Windows based SCP client that is a single executable which can be run from a flash drive, without being installed on the system. Check out:

http://winscp.net/eng/download.php