In Morrowind, you could just leave it whereever you like, except in containers (because some containers change content when you level up). In Oblivion, I don't know. I use the saddle bag mod, myself.