The only time it really became a problem for me was with a Taiwanese BBS.
I'd allowed for hotlinking to go on for a short while as I used it myself to promote my site. But when I woke up one day to see 80GB of bandwidth sucked up in 6 hours by this Taiwanese BBS I finally went ahead and disabled hotlinking throughout the entire site.