colealbon / cafe-society.news

breaking news tool - RSS aggregator and ML filter augmented with nostr collaboration

Home Page:https://cafe-society.news

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

spike: determine feasibility of reducing text size for large articles.

colealbon opened this issue · comments

#1

  • we've seen in the field that large posts inherently increase the score of an article.
  • we would like to truncate the post text for scoring
  • we would like to truncate the post text saved to processed posts

changed mlText to 50 words max for scores and prediction. Will monitor over time and see how scores respond.

#8