I think the only way this will work is if you have a really compelling universe to tie this all in. If it's a generic fictional universe with nothing special to it, or something that isn't really popular or well known, people will just be WTF because they play a game expecting an experience largely defined by the game mechanics.
The kind of idea you have here is really best done with a well established commercial game world such as GTA (later installments having multiple modes of play), or even one of those Mario Party packs full of minigames (except tied into a story). In terms of a flash game though, you'd have to do a load of actionscripting and include a load of sprites and different sounds and it'd just be extremely tedious, or so rudimentary that I'm not sure it'd be worth the effort.
Ambitious idea but flash is probably not the best platform in to consider implementing it right now.
