How you host the videos is also important. We use windows media server to host our videos. Each video is in multiple bandwidths and we detect the bandwith of the user automatically and serve them the best stream for their connection.

Windows media server has a special fast start feature just for this.


for Flash you can also use flash media server for the same purpose.