dhgarrette / gfl

GFL-Scala

This is a scala interface to the CMU GFL parser, originally written in python.

FUDG

http://www.ark.cs.cmu.edu/FUDG/ https://github.com/brendano/gfl_syntax/blob/master/scripts/FUDG_JSON.md

Including GFL-Scala as a dependency

In build.sbt:

resolvers ++= Seq(
  "dhg releases repo" at "http://www.cs.utexas.edu/~dhg/maven-repository/releases",
  "dhg snapshot repo" at "http://www.cs.utexas.edu/~dhg/maven-repository/snapshots"
)

libraryDependencies += "dhg" % "gfl-scala_2.11" % "0.0.1-SNAPSHOT"

Setup Dependencies

git clone [e-mail]:brendano/gfl_syntax.git
git clone [e-mail]:erikrose/parsimonious.git

export PYTHONPATH=$PYTHONPATH:$(pwd)/gfl_syntax/scripts/
export PYTHONPATH=$PYTHONPATH:$(pwd)/gfl_syntax/parser/
export PYTHONPATH=$PYTHONPATH:$(pwd)/parsimonious/

Usage

API: http://www.cs.utexas.edu/~dhg/maven-repository/snapshots/dhg/gfl-scala_2.11/0.0.1-SNAPSHOT/api/

Load a single sentence:

import dhg.gfl.Fudg._
import dhg.util._

val text = "The man walks a big dog ."
val annotation = """
    (The man walks < (a dog*))  .
    big > dog
    (The man)
    """
val sentence = fromGfl(text, annotation).getOrElseThrow()

Read annotation from files:

import dhg.util.CollectionUtil._
import dhg.util.FileUtil._
import scalaz._, Scalaz._

import dhg.gfl.Fudg._
val NonHiddenFile = "[^.].*".r

val sentencesByLanguage =
  File("data/gfl").listFilesRecursive(NonHiddenFile).flatMap { f =>
    f.readLines.map(fromAnnotationJson)
  }.reduce(_ |+| _)

val english = sentencesByLanguage("eng")
val firstSentence = english.head

Getting sentence information:

sentence.tokens
sentence.nodes
sentence.edges

/* 
 * Get all brackets inferred from this annotation.
 * A "bracket" is a pair (start,end) such that `sentence.tokens.slice(start,end)` 
 * is a bracketed unit.
 */
val allBrackets: Set[(Int, Int)] = sentence.brackets

/* 
 * Get (and draw) the tree of `deps`.
 */
val fudgTree = sentence.fudgTree
dhg.util.viz.TreeViz.drawTree(fudgTree)