That would depend on what kind of sprite you're looking for. I'm sure there are places that host generic sprites, as well as those that have themed sprites for specific fanbases- you should Google for that.
As for music, you could always stop by the Newgrounds audio portal.
You could make your own or you could find ripped sprites online. I don't think there are many original sprites that people will give you for free though.