I completely forgot about the YQL rate limits and was being capped by YQL servers. I have brought the service back-up and am currently implementing cache to minimize YQL calls.