My shared host won't let me install ffmpeg and some similar libraries, will it work if I just upload in flv?
As long as you link to the FLV from the PHPmotion script then yes.
Opinion: Find a host that allows ffmpeg as it will be quite a burden on potential users to encode their own FLV files.