Chenxi Tong's repositories
FairSchedulerPlus
A upgrade Extended FairScheduler that takes Sub-Groups into account.
Flume.NettyAvroAsyncRpcClient
This is a layer on top of the Flume NettyAvroRpcClient that allows for multiple connects to a server.
Kairos
Kairos, combines a focused crawler and an information extraction engine, to convert a list of conference websites into a index filled with fields of metadata that correspond to individual papers. Using event date metadata extracted from the conference website, Kairos proactively harvests metadata about the individual papers soon after they are made public. We use a Maximum Entropy classifier to classify uniform resource locators (URLs) as scientific conference websites and use Conditional Random Fields (CRF) to extract individual paper metadata from such websites. The crawler is built on top of the popular open-source crawler Nutch.