However, I have found a great site that makes this very easy.
I was looking for a site that would take the embed codes from like a vimeo or youtube and allow you to create a playlist and then post a player and play list on your site. This site does exactly that. and even give a pretty clean look.
Click on this image to see the actual player.