If the foot is the same as the Yamaha's that I'm familiar with, the nut isn't much more than finger tight. The lock plate holds it on. Under the nut are some washers and IIRC there are two plastic washers that keep tension on the impeller/nut.
Check with outboard jets (name of the company)-they can either fax or email you instructions on how everything goes back together. And you can get some new impeller keys as well. Keep a few for spares. A rock gets into the pump and it'll shear the key off, exactly like it's supposed to. Also if the impeller nut was not tight enough, the impeller rattling back and forth will do the same thing.
Jets aren't exactly maintenance free unfortunately.