MichaelAquilina / Reddit-Recommender-Bot

Indentifying Interesting Documents for Reddit using Recommender Techniques

MichaelAquilina/Reddit-Recommender-Bot Issues

Create a webcrawler that follows standard conventions
Closed 10 years ago1
Create Singular main script
Closed 10 years ago
Consider implementing PEBL as you now mention its use in your thesis
Closed 10 years ago2
Use JSON Configuration files rather than Command Line Arguments
Closed 10 years ago
Urls which fail word_concepts
Closed 10 years ago11
Merge in second order ranking improvements
Closed 10 years ago
Fast TFIDF lookup may work on the latest second-order-improvement branch
Closed 10 years ago
Prune concepts which occur once or too many times?
Closed 10 years ago1
Follow guidelines of Robots.txt when crawling websites
Closed 10 years ago
Writeup
Closed 10 years ago
Current word_concepts really easily confuses programming languages
Closed 10 years ago2
Better post_extractor filtering?
Closed 10 years ago
Would n-grams work?
Closed 10 years ago
Some form of PageRank procedure could significantly increase accuracy
Closed 10 years ago
Wiki.py should occasionally update DocumentFrequencies table for fast lookup
Closed 10 years ago
Check out `normalize-incoming-links` branch
Closed 10 years ago1
This url should work, check whats going on
Closed 10 years ago1
Determine which pages are being misclassified in nlptest.py
Closed 10 years ago
Numerous tables are not automatically generated for WikiIndex
Closed 10 years ago
load_stopwords in wikiindex.py will fail if not in the correct directory
Closed 10 years ago
WikiIndex should gracefully degrade methods based on table support
Closed 10 years ago
Noise often generated by current word_concepts / second_order_ranking
Closed 10 years ago
Better performance with get_documents using TfidfValues table?
Closed 10 years ago1
Why is Python (genus) showing Python (programming language) in its results?
Closed 10 years ago2
Goose returns empty text on certain pages
Closed 10 years ago
Append multiple instances of tokens in the title to boost their rank
Closed 10 years ago
Pages should be penalised for having a lot of high weighted tfidf terms
Closed 10 years ago2
second_order_ranking can be made faster with more numpy operations
Closed 10 years ago
Consider sending pull request for Unicode fix to Goose
Closed 10 years ago
Add goose to main.py and datasource
Closed 10 years ago
Noise within pages is affecting some results
Closed 10 years ago1
Use python-boilerpipe or python-goose to extract the main text body from articles
Closed 10 years ago
No proper way to resolve page disambiguation over Captilisation
Closed 10 years ago
Weight terms based on position in Page
Closed 10 years ago1
Consider Deleting all TermOccurrences with Counter=1
Closed 10 years ago2
Query expansion using wordnet?
Closed 10 years ago1
Ordering by Counter is slow because of lack of Index
Closed 10 years ago2
Consider changing back to InnoDB
Closed 10 years ago2
Delete all unprocessed pages on Index completion
Closed 10 years ago1
Reduce number of terms by filtering tfidf values of query vector
Closed 10 years ago
Calculating corpus size takes too long, should be precalculated
Closed 10 years ago2
SQL Queries slow due to Fetch performance
Closed 10 years ago1
Consider creating SQLIndex class which follows same structure of HashedIndex
Closed 10 years ago1
Counting the number of links in Wiki pages could improve accuracy
Closed 10 years ago4
Current word_tokenizer handles http urls really badly
Closed 10 years ago
Consider more extensive stopword list
Closed 10 years ago
Current Wiki Prune Operation does not prune the Terms table
Closed 10 years ago
Word Tokeniser failures
Closed 10 years ago
Create more efficient way to generate Document Lengths for Wiki Index
Closed 10 years ago
Ignore Wikipedia pages less than 500 words long
Closed 10 years ago2