RL

This is a url utility library that parses URL's conforming to RFC-3986.

Why?

While the java platform gives a lot, many things aren't relevant or outdated. This library tries to update the understanding of a url or uri to a deeper level. We process a bunch of feeds that get added arbitrarily. We use this library to canonicalize and disambiguate between all the urls pointing to the same domain.

What?

The library implements a uri parser defined by the ABNF grammar in RFC-3986. In addition to parsing a url, it also normalizes and canonicalizes public domains with the list found at: public suffix list. So how does this library improve on the current URL and URI implementations?

url encoding conforms to RFC-3986
normalizes urls along the following guidelines cfr. RFC-3986
canonicalizes urls by stripping common query string parameters and reordering the remaining query strings in alphabetical order.

Usage

There are 2 main uses for this library:

normalizing urls
expanding urls

Normalizing a url

rl.Uri("http://www.詹姆斯.org/path/../path/to/somewhere/?id=45&dskafd=safla&sdkfa=sd#dksd$sdl").normalize.asciiString
// http://www.xn--8ws00zhy3a.org/path/to/somewhere/?sdkfa=sd&dskafd=safla&id=45#dksd$sdl

Expanding a url

val expandUrl = rl.expand.UrlExpander()
expandUrl(rl.Uri("http://goo.gl/VM830")) onSuccess {
  case uri: Uri => println("The final uri: "+uri.asciiString)
}
expandUrl.stop() // stop thread pools etc.
// The final uri: http://trollcats.com/wp-content/uploads/2009/09/whoopdefuckingdoo_trollcat.jpg

Patches

Patches are gladly accepted from their original author. Along with any patches, please state that the patch is your original work and that you license the work to the rl project under the MIT License.

License

MIT licensed. check the LICENSE file

TODO

Make the parsers pluggable so that the scala parser combinator based one can be replaced as it's slow as.


## Thanks

to the following projects for leading the way:  

*  [ipv6-testcases](http://forums.dartware.com/viewtopic.php?t=452), [perl script](http://download.dartware.com/thirdparty/test-ipv6-regex.pl)
*  [postrank-uri](https://github.com/postrank-labs/postrank-uri)  
*  [domainatrix](https://github.com/pauldix/domainatrix)  
*  [google-guava](http://code.google.com/p/guava-libraries/)

scalatra / rl

RL