myneuronews / twetsent

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Description:

This program takes a user's twitter search query where it then scrapes tweets up to a certain point. It is then ungoes sentiment analysis and is aggregated into an sqLite database. These tweets are then displayed on a python webserver where the sentiment over time is displayed.

How to Run Project:

Running the program driver

python3 main.py

Running the webserver

python3 app.py

How to Run Web Crawler Directly:

In order to deploy the scrapy crawler directly... first cd into scrapy project "TwitterScraper/" directory and type:

scrapy crawl twitter

Built With

  • Flask - Lightweight python Web framework library
  • Selenium, Scrapy, BeautifulSoup - Used for scraping and parsing tweets)
  • Highcharts - Displaying sentiment oer time

About

License:Apache License 2.0


Languages

Language:Python 61.5%Language:JavaScript 28.7%Language:HTML 9.1%Language:CSS 0.7%