I think the choice depends on whether you need to evaluate js or not.
If you do, then in elixir there is hound [0] for this. I haven’t used it though since I usually use selenium with python. Actually, I usually try to avoid evaluating js completely by figuring out what apis it calls and calling them myself.
If you don’t, then just an html parser like floki [1] will do. You might be interested in reading the source code for magnetissimo [2] to see how a scraper works with it.
[0] GitHub - HashNuke/hound: Elixir library for writing integration tests and browser automation · GitHub
[1] GitHub - philss/floki: Floki is a simple HTML parser that enables search for nodes using CSS selectors. · GitHub
[2] GitHub - sergiotapia/magnetissimo: Web application that indexes all popular torrent sites, and saves it to the local database. · GitHub
