I have a list of 100’s of different domains that I am hunting across for certain links. I got crawly working on one, but crawly’s config expects a single base_url, e.g. https://www.foo.com.
Any suggestions?
I have a list of 100’s of different domains that I am hunting across for certain links. I got crawly working on one, but crawly’s config expects a single base_url, e.g. https://www.foo.com.
Any suggestions?
© Copyright Elixir Forum | Terms | Privacy & Cookies
