[BUG] doesn't download saved comments
Zireael07 opened this issue · comments
- [ x] I am reporting a bug.
- [ x] I am running the latest version of BDfR
- I have read the Opening an issue
Description
I went to download latest saved posts, and noticed it skipped "jfzpldz is not a submission" and by looking at the list of what was just before and after that I figured out it was a single saved comment. Now that I remember, I know I saw similar messages when downloading my entire saved posts history a couple weeks before.... probably were single comments too.
Command
bdfr clone ./clonereddit --user username here --saved --authenticate -L 28
Environment (please complete the following information)
- OS: Linux Manjaro
- Python version: [e.g. 3.9.4]
Logs
See comment below
Logs are NOT OPTIONAL. Please supply them or this issue will be closed.
[2023-07-02 19:08:49,099 - bdfr.connector - DEBUG] - Disabling the following modules:
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created download filter
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created time filter
[2023-07-02 19:08:49,099 - bdfr.connector - Level 9] - Created sort filter
[2023-07-02 19:08:49,100 - bdfr.connector - Level 9] - Create file name formatter
[2023-07-02 19:08:49,100 - bdfr.connector - DEBUG] - Using authenticated Reddit instance
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Created site authenticator
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved subreddits
[2023-07-02 19:08:49,101 - bdfr.connector - Level 9] - Retrieved multireddits
[2023-07-02 19:08:49,101 - bdfr.oauth2 - Level 9] - Loaded OAuth2 token for authoriser
[2023-07-02 19:08:49,532 - bdfr.oauth2 - Level 9] - Written OAuth2 token from authoriser to /home/kasia/.config/bdfr/default_config.cfg
[2023-07-02 19:08:50,000 - bdfr.connector - DEBUG] - Retrieving saved posts of user Zireael07
[2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved user data
[2023-07-02 19:08:50,001 - bdfr.connector - Level 9] - Retrieved submissions for given links
[2023-07-02 19:08:50,933 - bdfr.downloader - DEBUG] - Attempting to download submission 14obxuk
[2023-07-02 19:08:50,937 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/14obxuk/wizards_seems_to_value_conditions_as_virtual/
[2023-07-02 19:08:51,201 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.txt
[2023-07-02 19:08:51,202 - bdfr.downloader - DEBUG] - Hash added to master list: d326d8914554075011f0edfdd1b4c8c7
[2023-07-02 19:08:51,202 - bdfr.downloader - INFO] - Downloaded submission 14obxuk from dndnext
[2023-07-02 19:08:51,202 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14obxuk
[2023-07-02 19:08:51,872 - bdfr.archiver - DEBUG] - Writing entry 14obxuk to file in JSON format at /home/kasia/clonereddit/dndnext/FallenDank_Wizards seems to value conditions as virtual damage when it comes to design_14obxuk.json
[2023-07-02 19:08:51,872 - bdfr.archiver - INFO] - Record for entry item 14obxuk written to disk
[2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Attempting to download submission 14n8tb5
[2023-07-02 19:08:51,872 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14n8tb5/looking_for_help_with_adding_abilities_that/
[2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.txt
[2023-07-02 19:08:52,139 - bdfr.downloader - DEBUG] - Hash added to master list: 1e9993d1b2bb5b7b3864a3dbf781d0b0
[2023-07-02 19:08:52,139 - bdfr.downloader - INFO] - Downloaded submission 14n8tb5 from RPGdesign
[2023-07-02 19:08:52,139 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14n8tb5
[2023-07-02 19:08:52,598 - bdfr.archiver - DEBUG] - Writing entry 14n8tb5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/snowbirdnerd_Looking for help with adding abilities that modify my dice pool mechanic._14n8tb5.json
[2023-07-02 19:08:52,598 - bdfr.archiver - INFO] - Record for entry item 14n8tb5 written to disk
[2023-07-02 19:08:52,598 - bdfr.downloader - DEBUG] - Attempting to download submission 14mjemt
[2023-07-02 19:08:52,599 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/14mjemt/what_are_your_favorite_sub_systems_to_graft_onto/
[2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.txt
[2023-07-02 19:08:52,888 - bdfr.downloader - DEBUG] - Hash added to master list: 58dbc52c29c72e7f820b6af2473da069
[2023-07-02 19:08:52,889 - bdfr.downloader - INFO] - Downloaded submission 14mjemt from rpg
[2023-07-02 19:08:52,889 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14mjemt
[2023-07-02 19:08:53,651 - bdfr.archiver - DEBUG] - Writing entry 14mjemt to file in JSON format at /home/kasia/clonereddit/rpg/Additional_Score_275_What are your favorite sub systems to graft onto other systems?_14mjemt.json
[2023-07-02 19:08:53,652 - bdfr.archiver - INFO] - Record for entry item 14mjemt written to disk
[2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Attempting to download submission 14l8raf
[2023-07-02 19:08:53,652 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/r2ay00i9ar8b1.png
[2023-07-02 19:08:54,024 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.png
[2023-07-02 19:08:54,025 - bdfr.downloader - DEBUG] - Hash added to master list: 26611ec01b0471ae828ed68eb0ad4ffe
[2023-07-02 19:08:54,025 - bdfr.downloader - INFO] - Downloaded submission 14l8raf from neography
[2023-07-02 19:08:54,026 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14l8raf
[2023-07-02 19:08:54,435 - bdfr.archiver - DEBUG] - Writing entry 14l8raf to file in JSON format at /home/kasia/clonereddit/neography/Flacson8528_Mongul, Hangul styled writing system for Mongolian_14l8raf.json
[2023-07-02 19:08:54,437 - bdfr.archiver - INFO] - Record for entry item 14l8raf written to disk
[2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Attempting to download submission 14ky1i6
[2023-07-02 19:08:54,437 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/14ky1i6
[2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:08:54,816 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_1.jpg
[2023-07-02 19:08:55,141 - bdfr.downloader - DEBUG] - Hash added to master list: 4a4a70b36e751fa7f066bc37d5f1565c
[2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6_2.jpg
[2023-07-02 19:08:55,539 - bdfr.downloader - DEBUG] - Hash added to master list: 8d8be87153aec600dcca1c4f5f69bf16
[2023-07-02 19:08:55,539 - bdfr.downloader - INFO] - Downloaded submission 14ky1i6 from neography
[2023-07-02 19:08:55,539 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ky1i6
[2023-07-02 19:08:55,914 - bdfr.archiver - DEBUG] - Writing entry 14ky1i6 to file in JSON format at /home/kasia/clonereddit/neography/Ryjok_Heknik_Cursive Cuneform_14ky1i6.json
[2023-07-02 19:08:55,914 - bdfr.archiver - INFO] - Record for entry item 14ky1i6 written to disk
[2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Attempting to download submission 14hu28p
[2023-07-02 19:08:55,914 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14hu28p/are_there_any_good_ways_to_make_both_sides_of_a/
[2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.txt
[2023-07-02 19:08:56,182 - bdfr.downloader - DEBUG] - Hash added to master list: a769ed5d879ddd37f4a91fff3c51b262
[2023-07-02 19:08:56,182 - bdfr.downloader - INFO] - Downloaded submission 14hu28p from worldbuilding
[2023-07-02 19:08:56,182 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14hu28p
[2023-07-02 19:08:58,550 - bdfr.archiver - DEBUG] - Writing entry 14hu28p to file in JSON format at /home/kasia/clonereddit/worldbuilding/Aggressive_Novel1207_Are there any good ways to make both sides of a rebellion justified?_14hu28p.json
[2023-07-02 19:08:58,551 - bdfr.archiver - INFO] - Record for entry item 14hu28p written to disk
[2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Attempting to download submission 14h8dqf
[2023-07-02 19:08:58,551 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/worldbuilding/comments/14h8dqf/why_are_religions_in_worldbuilding_often_just_a/
[2023-07-02 19:08:58,829 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.txt
[2023-07-02 19:08:58,830 - bdfr.downloader - DEBUG] - Hash added to master list: 2985201fa89977c0b676ab6626c1cee9
[2023-07-02 19:08:58,830 - bdfr.downloader - INFO] - Downloaded submission 14h8dqf from worldbuilding
[2023-07-02 19:08:58,830 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14h8dqf
[2023-07-02 19:09:01,791 - bdfr.archiver - DEBUG] - Writing entry 14h8dqf to file in JSON format at /home/kasia/clonereddit/worldbuilding/Initial_Twist_3138_Why are religions in worldbuilding often just a reskinned Christianity (catholic)?_14h8dqf.json
[2023-07-02 19:09:01,792 - bdfr.archiver - INFO] - Record for entry item 14h8dqf written to disk
[2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Attempting to download submission 14ger4e
[2023-07-02 19:09:01,792 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14ger4e/rent_free_players/
[2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.txt
[2023-07-02 19:09:02,051 - bdfr.downloader - DEBUG] - Hash added to master list: 962d9d89f2b11b542052ba4eae826d88
[2023-07-02 19:09:02,052 - bdfr.downloader - INFO] - Downloaded submission 14ger4e from cyberpunkred
[2023-07-02 19:09:02,052 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14ger4e
[2023-07-02 19:09:02,727 - bdfr.archiver - DEBUG] - Writing entry 14ger4e to file in JSON format at /home/kasia/clonereddit/cyberpunkred/WannabeComicReader_Rent Free players!?!_14ger4e.json
[2023-07-02 19:09:02,727 - bdfr.archiver - INFO] - Record for entry item 14ger4e written to disk
[2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Attempting to download submission 14dkoih
[2023-07-02 19:09:02,727 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/14dkoih/how_to_make_healingfirst_aid_compelling/
[2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.txt
[2023-07-02 19:09:02,967 - bdfr.downloader - DEBUG] - Hash added to master list: 30c8f4822598a5bfbaaeda42fb5d1e6e
[2023-07-02 19:09:02,968 - bdfr.downloader - INFO] - Downloaded submission 14dkoih from RPGdesign
[2023-07-02 19:09:02,968 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14dkoih
[2023-07-02 19:09:03,396 - bdfr.archiver - DEBUG] - Writing entry 14dkoih to file in JSON format at /home/kasia/clonereddit/RPGdesign/ItWasInevitable45_How to make healingfirst aid compelling ?_14dkoih.json
[2023-07-02 19:09:03,396 - bdfr.archiver - INFO] - Record for entry item 14dkoih written to disk
[2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Attempting to download submission 14cwd24
[2023-07-02 19:09:03,397 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/14cwd24/cyberpunk_red_podcast/
[2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.txt
[2023-07-02 19:09:03,659 - bdfr.downloader - DEBUG] - Hash added to master list: bdb35548f1f317c34cbc5cdc3d1ea980
[2023-07-02 19:09:03,659 - bdfr.downloader - INFO] - Downloaded submission 14cwd24 from cyberpunkred
[2023-07-02 19:09:03,659 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cwd24
[2023-07-02 19:09:04,183 - bdfr.archiver - DEBUG] - Writing entry 14cwd24 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/MemesByJames_Cyberpunk Red Podcast?_14cwd24.json
[2023-07-02 19:09:04,183 - bdfr.archiver - INFO] - Record for entry item 14cwd24 written to disk
[2023-07-02 19:09:04,183 - bdfr.downloader - DEBUG] - Attempting to download submission 14cpk3w
[2023-07-02 19:09:04,184 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/IsaacArthur/comments/14cpk3w/how_to_have_ships_docking_with_the_rotating_skin/
[2023-07-02 19:09:04,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.txt
[2023-07-02 19:09:04,456 - bdfr.downloader - DEBUG] - Hash added to master list: 502a1f8fa1ba6343865bb63c43052764
[2023-07-02 19:09:04,456 - bdfr.downloader - INFO] - Downloaded submission 14cpk3w from IsaacArthur
[2023-07-02 19:09:04,457 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14cpk3w
[2023-07-02 19:09:05,261 - bdfr.archiver - DEBUG] - Writing entry 14cpk3w to file in JSON format at /home/kasia/clonereddit/IsaacArthur/MiamisLastCapitalist_How to have ships docking with the rotating skin of a habitat?_14cpk3w.json
[2023-07-02 19:09:05,261 - bdfr.archiver - INFO] - Record for entry item 14cpk3w written to disk
[2023-07-02 19:09:05,261 - bdfr.downloader - DEBUG] - Attempting to download submission 14b10yf
[2023-07-02 19:09:06,348 - bdfr.downloader - ERROR] - Could not download submission 14b10yf: No downloader module exists for url https://www.theverge.com/2023/6/16/23763538/reddit-blackout-api-protest-mod-replacement-threat
[2023-07-02 19:09:06,348 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 14b10yf
[2023-07-02 19:09:07,165 - bdfr.archiver - DEBUG] - Writing entry 14b10yf to file in JSON format at /home/kasia/clonereddit/RedditAlternatives/ardi62_Here’s the note Reddit sent to moderators threatening them if they don’t reopen_14b10yf.json
[2023-07-02 19:09:07,165 - bdfr.archiver - INFO] - Record for entry item 14b10yf written to disk
[2023-07-02 19:09:07,165 - bdfr.downloader - DEBUG] - Attempting to download submission 149exg5
[2023-07-02 19:09:07,166 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/149exg5/good_mechanics_to_steal_from_board_games/
[2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.txt
[2023-07-02 19:09:07,431 - bdfr.downloader - DEBUG] - Hash added to master list: 1ce99917461a4053b2e14ffc5dccd727
[2023-07-02 19:09:07,431 - bdfr.downloader - INFO] - Downloaded submission 149exg5 from RPGdesign
[2023-07-02 19:09:07,431 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 149exg5
[2023-07-02 19:09:08,270 - bdfr.archiver - DEBUG] - Writing entry 149exg5 to file in JSON format at /home/kasia/clonereddit/RPGdesign/TigrisCallidus_Good mechanics to "steal" from Board Games?_149exg5.json
[2023-07-02 19:09:08,271 - bdfr.archiver - INFO] - Record for entry item 149exg5 written to disk
[2023-07-02 19:09:08,271 - bdfr.downloader - DEBUG] - Attempting to download submission 147x906
[2023-07-02 19:09:10,185 - bdfr.site_downloaders.youtube - ERROR] - �[0;31mERROR:�[0m Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/
Traceback (most recent call last):
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper
return func(self, *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1594, in __extract_info
ie_result = ie.extract(url)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/common.py", line 694, in extract
ie_result = self._real_extract(url)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/extractor/generic.py", line 2510, in _real_extract
raise UnsupportedError(url)
yt_dlp.utils.UnsupportedError: Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/kasia/.local/lib/python3.10/site-packages/bdfr/site_downloaders/youtube.py", line 73, in get_video_data
result = ydl.extract_info(url, download=False)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info
return self.__extract_info(url, self.get_info_extractor(key), download, extra_info, process)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1518, in wrapper
return func(self, *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1615, in __extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1694, in process_ie_result
return self.extract_info(
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1507, in extract_info
return self.__extract_info(url, self.get_info_extractor(key), download, extra_info, process)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1536, in wrapper
self.report_error(str(e), e.format_traceback())
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1015, in report_error
self.trouble(f'{self._format_err("ERROR:", self.Styles.ERROR)} {message}', *args, **kwargs)
File "/home/kasia/.local/lib/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 955, in trouble
raise DownloadError(message, exc_info)
yt_dlp.utils.DownloadError: �[0;31mERROR:�[0m Unsupported URL: https://news.stanford.edu/2023/06/01/mangroves-value/
[2023-07-02 19:09:10,190 - bdfr.downloader - ERROR] - Could not download submission 147x906: No downloader module exists for url https://news.stanford.edu/2023/06/01/mangroves-value/
[2023-07-02 19:09:10,190 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147x906
[2023-07-02 19:09:10,578 - bdfr.archiver - DEBUG] - Writing entry 147x906 to file in JSON format at /home/kasia/clonereddit/environment/Sariel007_A new approach quantifies the value of mangrove forests in Belize for carbon sequestration, tourism, fisheries, and coastal protection, then uses the values to target conservation and restoration._147x906.json
[2023-07-02 19:09:10,578 - bdfr.archiver - INFO] - Record for entry item 147x906 written to disk
[2023-07-02 19:09:10,579 - bdfr.downloader - DEBUG] - Attempting to download submission 147urul
[2023-07-02 19:09:10,580 - bdfr.downloader - DEBUG] - Using Direct with url https://i.redd.it/07dj4y1cxm5b1.jpg
[2023-07-02 19:09:10,952 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.jpg
[2023-07-02 19:09:10,953 - bdfr.downloader - DEBUG] - Hash added to master list: f3569fc9c8b99b002f65f448e7fa0777
[2023-07-02 19:09:10,953 - bdfr.downloader - INFO] - Downloaded submission 147urul from AlternateHistory
[2023-07-02 19:09:10,953 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 147urul
[2023-07-02 19:09:13,387 - bdfr.archiver - DEBUG] - Writing entry 147urul to file in JSON format at /home/kasia/clonereddit/AlternateHistory/Secsidar_What if?: President Hillary R. Clinton._147urul.json
[2023-07-02 19:09:13,387 - bdfr.archiver - INFO] - Record for entry item 147urul written to disk
[2023-07-02 19:09:13,387 - bdfr.downloader - WARNING] - jfzpldz is not a submission
[2023-07-02 19:09:14,072 - bdfr.archiver - DEBUG] - Writing entry jfzpldz to file in JSON format at /home/kasia/clonereddit/RPGdesign/Environmental_Fee_64_How does a D100 roll-between mechanic sound for a Fast and Furious style street racing game?jfzpldz.json
[2023-07-02 19:09:14,073 - bdfr.archiver - INFO] - Record for entry item jfzpldz written to disk
[2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Attempting to download submission 115ylc8
[2023-07-02 19:09:14,073 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/115ylc8/rolling_inbetween_two_numbers/
[2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.txt
[2023-07-02 19:09:14,325 - bdfr.downloader - DEBUG] - Hash added to master list: 2dd096b2e76075a6fa21f443ee534dc7
[2023-07-02 19:09:14,325 - bdfr.downloader - INFO] - Downloaded submission 115ylc8 from RPGdesign
[2023-07-02 19:09:14,325 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 115ylc8
[2023-07-02 19:09:14,825 - bdfr.archiver - DEBUG] - Writing entry 115ylc8 to file in JSON format at /home/kasia/clonereddit/RPGdesign/Winterstorm262_Rolling In-Between Two Numbers_115ylc8.json
[2023-07-02 19:09:14,828 - bdfr.archiver - INFO] - Record for entry item 115ylc8 written to disk
[2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Attempting to download submission 145yhhs
[2023-07-02 19:09:14,828 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/145yhhs/project_v_the_first_draft_of_my_core_resolution/
[2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/willneders[Project V] The First Draft of My Core Resolution System. Any thoughts on this?145yhhs.txt
[2023-07-02 19:09:15,079 - bdfr.downloader - DEBUG] - Hash added to master list: 5066948ac8bc6cbfa8ef261c4817adbb
[2023-07-02 19:09:15,079 - bdfr.downloader - INFO] - Downloaded submission 145yhhs from RPGdesign
[2023-07-02 19:09:15,080 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 145yhhs
[2023-07-02 19:09:15,514 - bdfr.archiver - DEBUG] - Writing entry 145yhhs to file in JSON format at /home/kasia/clonereddit/RPGdesign/willneders[Project V] The First Draft of My Core Resolution System. Any thoughts on this?_145yhhs.json
[2023-07-02 19:09:15,515 - bdfr.archiver - INFO] - Record for entry item 145yhhs written to disk
[2023-07-02 19:09:15,515 - bdfr.downloader - DEBUG] - Attempting to download submission 117f1aa
[2023-07-02 19:09:15,516 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/117f1aa
[2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:09:16,119 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_1.jpg
[2023-07-02 19:09:16,318 - bdfr.downloader - DEBUG] - Hash added to master list: 18d66dfcdb3f0a235020f220942f1368
[2023-07-02 19:09:16,683 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa_2.jpg
[2023-07-02 19:09:16,684 - bdfr.downloader - DEBUG] - Hash added to master list: fe2d5fa33ff0cd16ca5a053dec9ef3b6
[2023-07-02 19:09:16,684 - bdfr.downloader - INFO] - Downloaded submission 117f1aa from neography
[2023-07-02 19:09:16,684 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 117f1aa
[2023-07-02 19:09:17,064 - bdfr.archiver - DEBUG] - Writing entry 117f1aa to file in JSON format at /home/kasia/clonereddit/neography/omerhicaanu_Standard Modern Cuneiform for my semasiographic conlang_117f1aa.json
[2023-07-02 19:09:17,065 - bdfr.archiver - INFO] - Record for entry item 117f1aa written to disk
[2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Attempting to download submission 1444yvw
[2023-07-02 19:09:17,065 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/1444yvw/a_mechanic_for_resisting_your_characters_virtues/
[2023-07-02 19:09:17,383 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.txt
[2023-07-02 19:09:17,384 - bdfr.downloader - DEBUG] - Hash added to master list: 38385473870054126a9e62d5f71bfca6
[2023-07-02 19:09:17,384 - bdfr.downloader - INFO] - Downloaded submission 1444yvw from RPGdesign
[2023-07-02 19:09:17,384 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1444yvw
[2023-07-02 19:09:18,026 - bdfr.archiver - DEBUG] - Writing entry 1444yvw to file in JSON format at /home/kasia/clonereddit/RPGdesign/Yumoda_A mechanic for resisting your character’s virtues flaws_1444yvw.json
[2023-07-02 19:09:18,026 - bdfr.archiver - INFO] - Record for entry item 1444yvw written to disk
[2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Attempting to download submission 1437tlo
[2023-07-02 19:09:18,026 - bdfr.downloader - DEBUG] - Using Gallery with url https://www.reddit.com/gallery/1437tlo
[2023-07-02 19:09:19,839 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 1
[2023-07-02 19:09:19,840 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 2
[2023-07-02 19:09:19,841 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 3
[2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 4
[2023-07-02 19:09:19,842 - bdfr.file_name_formatter - Level 9] - Formatting filename with index 5
[2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_1.jpg
[2023-07-02 19:09:20,150 - bdfr.downloader - DEBUG] - Hash added to master list: 1405981b4ff108ecc374555044fdc6c4
[2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_2.jpg
[2023-07-02 19:09:20,454 - bdfr.downloader - DEBUG] - Hash added to master list: 5ec7f7c0ac31a6e442b4c8c16157bde3
[2023-07-02 19:09:20,774 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_3.jpg
[2023-07-02 19:09:20,775 - bdfr.downloader - DEBUG] - Hash added to master list: 702e162ecea19a3ab5c6d5092e015217
[2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_4.jpg
[2023-07-02 19:09:22,358 - bdfr.downloader - DEBUG] - Hash added to master list: f93bc02dbfecb7a9e15d321f1e53748c
[2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo_5.jpg
[2023-07-02 19:09:23,688 - bdfr.downloader - DEBUG] - Hash added to master list: a366c5eeac726cc53967bba5d84c73c0
[2023-07-02 19:09:23,688 - bdfr.downloader - INFO] - Downloaded submission 1437tlo from cyberpunkred
[2023-07-02 19:09:23,689 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 1437tlo
[2023-07-02 19:09:24,082 - bdfr.archiver - DEBUG] - Writing entry 1437tlo to file in JSON format at /home/kasia/clonereddit/cyberpunkred/adayat_Inflitrating the Control Center [1st floor, 2nd floor, roof and floorplan] [10x10]_1437tlo.json
[2023-07-02 19:09:24,083 - bdfr.archiver - INFO] - Record for entry item 1437tlo written to disk
[2023-07-02 19:09:24,083 - bdfr.downloader - DEBUG] - Attempting to download submission 142mn61
[2023-07-02 19:09:24,084 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/142mn61/seeking_assistance_with_crafting_a_crafting_system/
[2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.txt
[2023-07-02 19:09:24,359 - bdfr.downloader - DEBUG] - Hash added to master list: 17cb33a74de77b6b20bfa29dbe36d2ca
[2023-07-02 19:09:24,359 - bdfr.downloader - INFO] - Downloaded submission 142mn61 from RPGdesign
[2023-07-02 19:09:24,360 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142mn61
[2023-07-02 19:09:24,798 - bdfr.archiver - DEBUG] - Writing entry 142mn61 to file in JSON format at /home/kasia/clonereddit/RPGdesign/ShadowRade_Seeking Assistance With Crafting a Crafting System_142mn61.json
[2023-07-02 19:09:24,799 - bdfr.archiver - INFO] - Record for entry item 142mn61 written to disk
[2023-07-02 19:09:24,799 - bdfr.downloader - DEBUG] - Attempting to download submission 143b31x
[2023-07-02 19:09:24,800 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/rpg/comments/143b31x/thoughts_on_dice_pools/
[2023-07-02 19:09:25,062 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.txt
[2023-07-02 19:09:25,063 - bdfr.downloader - DEBUG] - Hash added to master list: 355a684eff60eef948bdf1a75305b61f
[2023-07-02 19:09:25,063 - bdfr.downloader - INFO] - Downloaded submission 143b31x from rpg
[2023-07-02 19:09:25,063 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 143b31x
[2023-07-02 19:09:25,800 - bdfr.archiver - DEBUG] - Writing entry 143b31x to file in JSON format at /home/kasia/clonereddit/rpg/InkBladePublishing_Thoughts on Dice Pools?_143b31x.json
[2023-07-02 19:09:25,800 - bdfr.archiver - INFO] - Record for entry item 143b31x written to disk
[2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Attempting to download submission 142o2vr
[2023-07-02 19:09:25,801 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142o2vr/help_with_making_corpos_hateable/
[2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.txt
[2023-07-02 19:09:26,078 - bdfr.downloader - DEBUG] - Hash added to master list: ef82ba46a9becfc63a301edd1ef89956
[2023-07-02 19:09:26,078 - bdfr.downloader - INFO] - Downloaded submission 142o2vr from cyberpunkred
[2023-07-02 19:09:26,078 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142o2vr
[2023-07-02 19:09:27,053 - bdfr.archiver - DEBUG] - Writing entry 142o2vr to file in JSON format at /home/kasia/clonereddit/cyberpunkred/RU5TR3D_Help with making corpos hateable?_142o2vr.json
[2023-07-02 19:09:27,053 - bdfr.archiver - INFO] - Record for entry item 142o2vr written to disk
[2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Attempting to download submission 142kyu7
[2023-07-02 19:09:27,053 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/cyberpunkred/comments/142kyu7/i_made_a_personality_database_list_for_my_campaign/
[2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.txt
[2023-07-02 19:09:27,299 - bdfr.downloader - DEBUG] - Hash added to master list: 0e373650d291561978546191948fdd03
[2023-07-02 19:09:27,299 - bdfr.downloader - INFO] - Downloaded submission 142kyu7 from cyberpunkred
[2023-07-02 19:09:27,299 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 142kyu7
[2023-07-02 19:09:27,597 - bdfr.archiver - DEBUG] - Writing entry 142kyu7 to file in JSON format at /home/kasia/clonereddit/cyberpunkred/atomicpunk88_I made a personality database list for my campaign!_142kyu7.json
[2023-07-02 19:09:27,597 - bdfr.archiver - INFO] - Record for entry item 142kyu7 written to disk
[2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Attempting to download submission 141vl8i
[2023-07-02 19:09:27,597 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/dndnext/comments/141vl8i/how_have_you_made_mind_flayers_actually_scary_in/
[2023-07-02 19:09:27,856 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.txt
[2023-07-02 19:09:27,857 - bdfr.downloader - DEBUG] - Hash added to master list: 6794e0561425ba52ce502e0967277cad
[2023-07-02 19:09:27,857 - bdfr.downloader - INFO] - Downloaded submission 141vl8i from dndnext
[2023-07-02 19:09:27,857 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 141vl8i
[2023-07-02 19:09:29,080 - bdfr.archiver - DEBUG] - Writing entry 141vl8i to file in JSON format at /home/kasia/clonereddit/dndnext/Neongelion_How have you made mind flayers actually scary in your games?_141vl8i.json
[2023-07-02 19:09:29,080 - bdfr.archiver - INFO] - Record for entry item 141vl8i written to disk
[2023-07-02 19:09:29,080 - bdfr.downloader - DEBUG] - Attempting to download submission 140op9g
[2023-07-02 19:09:29,081 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/gurps/comments/140op9g/is_there_a_narrative_version_of_gurps/
[2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.txt
[2023-07-02 19:09:29,332 - bdfr.downloader - DEBUG] - Hash added to master list: 234e15a04a3ce1ad37148f9ec48b3e2c
[2023-07-02 19:09:29,332 - bdfr.downloader - INFO] - Downloaded submission 140op9g from gurps
[2023-07-02 19:09:29,332 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 140op9g
[2023-07-02 19:09:29,958 - bdfr.archiver - DEBUG] - Writing entry 140op9g to file in JSON format at /home/kasia/clonereddit/gurps/Ananiujitha_Is There a Narrative Version of GURPS?_140op9g.json
[2023-07-02 19:09:29,959 - bdfr.archiver - INFO] - Record for entry item 140op9g written to disk
[2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Attempting to download submission 13zomtd
[2023-07-02 19:09:29,959 - bdfr.downloader - DEBUG] - Using SelfPost with url https://www.reddit.com/r/RPGdesign/comments/13zomtd/can_pendragons_blackjack_style_roll_resolution/
[2023-07-02 19:09:30,244 - bdfr.downloader - DEBUG] - Written file to /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.txt
[2023-07-02 19:09:30,246 - bdfr.downloader - DEBUG] - Hash added to master list: 30a89f22cb820e5ff2a37d708df53c58
[2023-07-02 19:09:30,246 - bdfr.downloader - INFO] - Downloaded submission 13zomtd from RPGdesign
[2023-07-02 19:09:30,246 - bdfr.archive_entry.submission_archive_entry - DEBUG] - Retrieving full comment tree for submission 13zomtd
[2023-07-02 19:09:31,143 - bdfr.archiver - DEBUG] - Writing entry 13zomtd to file in JSON format at /home/kasia/clonereddit/RPGdesign/Kubsterrb17_Can Pendragon's black-jack style roll resolution mechanic be improved in any way?_13zomtd.json
[2023-07-02 19:09:31,144 - bdfr.archiver - INFO] - Record for entry item 13zomtd written to disk
[2023-07-02 19:09:31,144 - root - INFO] - Program complete
Seriously, bdfr executable should say (or have a readme next to executable) where the logs are stored instead of the user having to scroll through a very long readme on the repo to find out
That's why Ctrl+f
was invented. Thank you, I'll see if I can fix this bug.
I can confirm it's definitely from saved comments. I have a lot more and it skips them every time with "is not a submission"