They also have splash which is their own html/javascript renderer.
I think it’s straight up professional and industrial.
I’ve seen floki and I’ve done beautifulsoup. Scrapy straight up is the tool you want if you want to webscrape website you can scrape like 90% or more of the websites out there with it.
I do webscrapping professionally for one startup stint and I’ve been doing it on the side for the side projects. I also got paid to webscrape linkedin and it didn’t go anywhere, linkedin is pretty dang hard unless you’re willing to put in lots of man hours into it.
I am willing to put my reputation on that tool. It’s really really good. It’s python though.
