USB 2.0 can transfer at 480 megabits per second - that's a gigabyte in less than 17 seconds.
HOWEVER few devices can cope with this sort of speed. A typical USB stick will peak at a third of this speed. Lower priced sticks are often very slow indeed.
USB 3, where connectors have a blue section, improves things by a LARGE margin. Again, devices are rarely as fast as the standard allows. However a USB 3 stick often works a lot faster than a USB 2 one, even in a USB 2 socket.
Hint: If you are copying files to a USB device, don't leave Explorer pointing at that device. It will spend a lot of time updating the display to reflect the files being created there rather than allowing more data to be written.