jakemcc / yokogiri

Nokogiri for Clojure

yokogiri

status

getting started

In your project.clj: [yokogiri "1.5.7"]

  (ns myproject.core
    (:require [yokogiri.core :as $]))

or

  (ns myproject.core
    (:use [yokogiri.core]))

usage

  (def client (make-client))

  ;; with javascript enabled (look at the docstring for make-client
  ;; for all of the available options.):
  (def client (make-client :javascript false))

  ;; Curious what options are set by default?
  (get-client-options (make-client))
  ;=> {:redirects true, :javascript true, ...}

  ;; XPATH
  ;; First, we get the page.
  (def page (get-page client "http://example.com"))

  (xpath page "//a")
  ;=> [#<HtmlAnchor HtmlAnchor[<a href="http://www.iana.org/domains/example">]>]

  (map attrs (xpath page "//a"))
  ;=> ({:text "More information...", :href "http://www.iana.org/domains/example"})

  (map node-text (xpath page "//a"))
  ;=> ("More information...")

  ;; CSS
  (def footer-feedback-text
    (map node-text (css page "div.footer-beta-feedback")))

  ;; Get specific attributes
  (def a-attr-href
    (map #(select-keys (attrs %) [:href])
      (-> page (css "div.link a"))))

  ;; Not necessary to pass around client:
  (get-page "http://example.com/")

  ;; Rebind *client*
  (with-client (make-client :javascript false)
    (get-page "http://www.example.com/"))

  ;; Treat a local HTML file as a page:
  (xpath (as-page "docs/uberdoc.html") "//a")

documentation

Check out the nicely formatted documentation.

license

Copyright (C) 2013 Devin Walters

Distributed under the Eclipse Public License, the same as Clojure.