alonmln / ILNewsDiff

Code for the ILNewsDiff Twitter account

Home Page:https://twitter.com/ILNewsDiff

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ILNewsDiff

See feed here: https://twitter.com/ILNewsDiff

Interested in contributing to this project? Send us a direct message on twitter

A Twitter bot that keeps track of changes made in Israeli news websites.

Currently tracking:

How does it work?

Once a minute the code queries news feeds and compares them to a previous state saved in a local SQLite DB.

If an interesting change is found, a tweet is published with the diff.

The first tweet of a diff is always the article itself as a link, and all the subsequent changes are chained by order.

What is interesting?

A change that

  • Has happened and is not there because of a delay in the RSS feed. The code queries the article's page to look for the change.
  • Is not comprised of only whitespace or punctuation.
  • Has a difference of more than one letter (Though adding/removing a question mark '?' is interesting)

Installation

  • The phantomjs binary needs to be installed, and the path updated in the run_diff.sh file.
  • pip install -r requirements.txt

Twitter keys are needed.

Credits

For contributing to this repo:

Based on @j-e-d's code for the Twitter bot @nyt_diff.
RSS feed fetching added for @xuv's Twitter bot @lesoir_diff

About

Code for the ILNewsDiff Twitter account

https://twitter.com/ILNewsDiff


Languages

Language:Python 92.9%Language:CSS 3.5%Language:HTML 2.4%Language:Shell 1.2%