Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I have used Selenium for this with quite a bit of success, or as others have mentioned, just figure out where the API endpoints are with fiddler and pull the data directly from the source.

Sometimes this can be a PITA though, for example Tableau obfuscates the JSON they send back, so it's easier to use Selenium to wait ten seconds and then scrape the resulting HTML.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: