Yes, you CAN take it with you:

[...] [[...]]

"Portable Apps Suite Contains: Portable Firefox (web browser), Portable Thunderbird (email client), Portable [...] (office suite), Portable AbiWord (word processor), Portable NVU (web editor), Portable Sunbird (... Login to read more.