KnicKnic / webtoons-comments

feed generator for webtoons comments

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Goal

Generate an RSS feed of the comments for a webtoons comic.

Sub-Goal

I also wanted to play with mongodb and learn a little about it.

Status

It works! See example https://rss.croppy.duckdns.org/117474-rss.xml

Deploy instructions

see deploy/readme.md

TODO

Completed items

  • get list of chapters in comic
  • get list of comments in comic
    • I think I need to grab replies in comic
    • figure out if there are new replies and then grab them
  • load results into database
  • show results in database based on time processed
    • last 50 inserted into database
  • grab Image for page & put url into db
  • generate list with images
  • generate content that includes replied post in results
  • periodically rescrape results
  • create docker-compose for results

Some notes

see scraping_notes.md and fetch.md

Translation is supported

see deploy/readme.md

About

feed generator for webtoons comments

License:MIT License


Languages

Language:JavaScript 97.8%Language:Shell 1.5%Language:Dockerfile 0.7%