Zip drives are small and becoming obsolete - why not an external hard drive? They're getting cheaper and cheaper and are less prone to the problems you'd have with flash media like memory sticks.
You could also just burn CDs/DVDs but the longer-term storage is questionable on them.
You could also just burn CDs/DVDs but the longer-term storage is questionable on them.