Launching the emulator from a USB drive is the most flexible method for most users.
Since many PS2 consoles now have failing disc drives, you might prefer:
Formatted to FAT32 to store your emulator and games.
The modern standard for PS2 homebrew involves using FreeMCBoot (a softmod via memory card) or a network adapter with an internal hard drive.