This is a Ruby-on-Rails app for running (German) news aggregator websites. Today, it powers:
- http://www.hrfilter.de (German news of HR/personal/recruiting)
- http://www.fahrrad-filter.de (German/English news of cycling topic)
I want to follow news of those two areas but struggle with RSS, as it is too much for me too process - I want to see the most "relevant" sources at once, without investing too much time. Other sources, like Twitter + Reddit I found too noisy to follow.
This is why I created that app
The admin of the apps curates a list of trusted sources. Those will regularly checked for new content. Following news sources are supported:
- RSS/Atom feeds (FeedSource)
- Podcast via RSS/Atom (similar as FeedSource but different visual)
- Twitter Streams
- (in planning) RedditSources - subscribe whole /r/'s
In similar fashion, the app checks popularity of the news in social network, that means:
- Facebook likecount (as reported by Facebook Like Button)
- Twitter retweets + favorites (as reported by Twitter API)
- XING + LinkedIn shares (as reported by regarding Widgets)
- Reddit total score sum in all subreddits (if exists)
- Each of those sources is configured with a different value (e.g. Facebook likes are more common, so less value than XING share)
The admin of the sites can give a Source individual:
- Base factor (that means, how much "Likes" any link of that website is worth, can also be negative too remove noise from some sources)
- Multiplicator, e.g. 0.2, 1.0, 2.0 - each like will be multiplied by that number -- Some sources have a much higher reach and can be leveled out so the news are more broad
Altogether, the score is calculated regularly for fresh links. For Display on the homepage, the freshness is also important - the older the link, the more the score is reduced.
The topic matching is very simple - just simple keyword lists. That means, the categorization is far far from perfect or even good. It might be an area of further development :)
It is possible to subscribe via E-Mail. Then, once per week on sunday, you will receive a Mail with from the selected topics.
As it is a fully functioning Rails app, you can try to run it yourself. First make sure to have Ruby at least 2.0 installed and bundler, then:
git clone ...
cd ...
bundle install
rake environment db:create
rake db:migrate
rails server
before the rake commands, you might have to create a config/application.yml (see config/application.hrfilter.yml as example) and adjust config/database.yml and config/secrets.yml too your needs.
If you'd like, you can try to import some of the HRfilter sources for an initial seed:
rails r 'Setting.read_yaml'
rake db:seed
If you have issues to get the data with db:seed you can also try:
rails runner 'Source.cronjob'
rails runner 'NewsItem.cronjob'
The necessary tasks are at: config/schedule.rb