What video format are you using?
If it's quicktime make sure "Fast Start" is enabled.