Websites are very dynamic these days. Sometimes, crawlers that worked yesterday, don't seem to work today.