Euros
Euros is a web spider framework that can spider a domain and collect useful information about the pages it visits. It is versatile, allowing you to write your own specialized spider tasks quickly and easily.
Installation
If available in Hex, the package can be installed
by adding euros to your list of dependencies in mix.exs:
def deps do
[
{:euros, "~> 0.1.1"}
]
endUsage
iex> url = "https://euros-test.blogspot.jp/"
iex> Euros.Core.crawl(url, fn(page) -> IO.puts(inspect(page)) end)
%HTTPoison.Response{body: "<!DOCTYPE html><html dir='ltr'><head><meta content='width=device-width, initial-scale=1' name='viewport'/><title>euros test blog</title>....License
Copyright (c) 2017 kytiken
Released under the MIT license
https://github.com/kytiken/euros/blob/master/LICENSEDocumentation can be generated with ExDoc and published on HexDocs. Once published, the docs can be found at https://hexdocs.pm/euros.