Puppeteer vs. Selenium for Web Scraping, Tested on the Same Chrome(scrapfly.io)
2 pointsby noorsimar4 hours ago1 comment
  • bediger40004 hours ago
    When it comes to web scraping with a real browser,

    There are darn few reasons for doing this if you're ethical and want to respect what people wrote in their robots.txt. I'm assuming the worst about you.

    • yawpitch2 hours ago
      There are lots of ethical uses for these sort of scraping tools, a very basic example being the year’s worth of our own transaction data I need to do my family’s taxes each year which an idiot bank only allows me to download via a poorly-formatted PDF, each page of which is a single download using the same file name that contains at most 25 entries.

      As my highschool English teacher taught me, don’t assume: it makes an ass out of you and an ass out of me.