[Bug]: Adding a playlist to the download queue doesn't work if the playlist has been subscribed to before
zombachu opened this issue · comments
I've read the documentation
- I'm running the latest version of Tube Archivist and have read the release notes.
- I have read the how to open an issue guide, particularly the bug report section.
Operating System
Synology
Your Bug Report
Describe the bug
I had a playlist I was subscribed to but was behind in archiving by a couple months, so I wanted to sync it all at once by adding it to the download queue. However, none of the missing videos were added and the playlist unsubscribed itself and marked itself as deactivated too. Logs show TubeArchivist was able to get the playlist from the url I provided but it seemed to only check the videos it already had. Resubscribing to the playlist and doing rescan subscriptions didn't pick up the unarchived videos either. I'm able to add the videos individually manually so I don't think it's an access issue but I really really do not want to need to do this.
Steps To Reproduce
- Have a subscribed playlist in TubeArchivist that is not fully archived
- Add the playlist to the download queue
- sadness
Expected behavior
The unarchived videos to be added to the download queue
Relevant log output
[pid: 3297|app: 0|req: 5593/5593] 172.17.0.1 () {52 vars in 1275 bytes} [Sat Dec 16 01:17:20 2023] POST /api/download/ => generated 104 bytes in 34 msecs (HTTP/1.1 400) 8 headers in 279 bytes (1 switches on core 0)
[2023-12-16 01:18:05,372: INFO/MainProcess] Task extract_download[f8510c88-5047-4262-ad0b-fe3c9ea0c60c] received
�[1;33m[2023-12-16 01:18:05,645: WARNING/ForkPoolWorker-2] extract_download create callback�[0m
�[1;33m[2023-12-16 01:18:19,162: WARNING/ForkPoolWorker-2] PLiasgr1hOV7crPuf1h0AzZOFUQqtOcI5H: get metadata from es�[0m
�[1;33m[2023-12-16 01:18:19,434: WARNING/ForkPoolWorker-2] K7_XGfcytPQ: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,435: WARNING/ForkPoolWorker-2] du0TU1ME6dk: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,436: WARNING/ForkPoolWorker-2] vJAJkaEQDXg: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,436: WARNING/ForkPoolWorker-2] PYNYpkZLhXY: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,436: WARNING/ForkPoolWorker-2] GnZCka4je4M: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,437: WARNING/ForkPoolWorker-2] OCLODPBxXyQ: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,437: WARNING/ForkPoolWorker-2] ccNn0aCu9QI: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,437: WARNING/ForkPoolWorker-2] s0rsOOD3RfQ: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,437: WARNING/ForkPoolWorker-2] OZIWgFgiFTI: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,438: WARNING/ForkPoolWorker-2] 1cXl4rAgGJY: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,438: WARNING/ForkPoolWorker-2] JSBw8twpEgI: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,439: WARNING/ForkPoolWorker-2] 6hb0o7rbMMo: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,439: WARNING/ForkPoolWorker-2] ppygXaXcOY8: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,439: WARNING/ForkPoolWorker-2] hn9LsLYKors: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,440: WARNING/ForkPoolWorker-2] B4GfL5wrjqs: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,440: WARNING/ForkPoolWorker-2] iWQB6SwzuE0: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] ekHm3ncQBlo: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] 0q2hdt4rLIo: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] Dud97ap37BU: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] G2uoPnS1oTE: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] dj7IFtaGZ_8: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,441: WARNING/ForkPoolWorker-2] 33uj9819wRc: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,442: WARNING/ForkPoolWorker-2] gjIi0zVvmP4: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,442: WARNING/ForkPoolWorker-2] iCAxJvWq-Uk: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,442: WARNING/ForkPoolWorker-2] rWKg8a0CEIY: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,442: WARNING/ForkPoolWorker-2] wVZNFz2cbx0: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,442: WARNING/ForkPoolWorker-2] io2hD2gj5mw: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,443: WARNING/ForkPoolWorker-2] rYk11hS_qM4: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,443: WARNING/ForkPoolWorker-2] 9oMx8ayW8UE: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,444: WARNING/ForkPoolWorker-2] 6z5wesZKuiI: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,444: WARNING/ForkPoolWorker-2] VU_Y1il1Cdk: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,444: WARNING/ForkPoolWorker-2] HI1-PJ7Sy1w: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,445: WARNING/ForkPoolWorker-2] CA_bmeTGZgE: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,446: WARNING/ForkPoolWorker-2] W5gXd1FzLK4: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,446: WARNING/ForkPoolWorker-2] 1eCre8nIlJ4: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,446: WARNING/ForkPoolWorker-2] XYH_lu5R3H0: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,447: WARNING/ForkPoolWorker-2] -RqrZrcVCOk: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,449: WARNING/ForkPoolWorker-2] qopdmnl_Riw: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,450: WARNING/ForkPoolWorker-2] EgJMMUgcvIo: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,451: WARNING/ForkPoolWorker-2] yMUz9efa1yE: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,452: WARNING/ForkPoolWorker-2] Vo9vuhsrItc: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,453: WARNING/ForkPoolWorker-2] wUrZNG7v5nA: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,454: WARNING/ForkPoolWorker-2] 8nu2qOdUzxQ: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,454: WARNING/ForkPoolWorker-2] Hw9RsOXyCqA: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,454: WARNING/ForkPoolWorker-2] JlrTu4ee8J0: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,455: WARNING/ForkPoolWorker-2] 2DhPCtjrYWc: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,455: WARNING/ForkPoolWorker-2] HFFgepMA6mg: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,455: WARNING/ForkPoolWorker-2] bm0nLJuRNbw: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,456: WARNING/ForkPoolWorker-2] kXsOynpQ9RM: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,456: WARNING/ForkPoolWorker-2] afc53yDtc64: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,456: WARNING/ForkPoolWorker-2] Mka0oUCh6XI: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,457: WARNING/ForkPoolWorker-2] tuADSGLjLB8: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,458: WARNING/ForkPoolWorker-2] Kpes_5zYy5c: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:19,458: WARNING/ForkPoolWorker-2] AbPgkv9x-dU: skipped adding already indexed video to download.�[0m
�[1;33m[2023-12-16 01:18:21,499: WARNING/ForkPoolWorker-2] PLiasgr1hOV7crPuf1h0AzZOFUQqtOcI5H: get metadata from es�[0m
�[1;33m[2023-12-16 01:18:32,129: WARNING/ForkPoolWorker-2] UCHVijOMzF7t5Ujust6Z65cw: get metadata from es�[0m
�[1;33m[2023-12-16 01:18:47,785: WARNING/ForkPoolWorker-2] f8510c88-5047-4262-ad0b-fe3c9ea0c60c success callback�[0m
[2023-12-16 01:18:47,789: INFO/ForkPoolWorker-2] Task extract_download[f8510c88-5047-4262-ad0b-fe3c9ea0c60c] succeeded in 42.15202007535845s: None
�[1;33m[2023-12-16 01:18:47,789: WARNING/ForkPoolWorker-2] f8510c88-5047-4262-ad0b-fe3c9ea0c60c return callback�[0mAnything else?
Current playlist status, shows "Last refreshed: 2023-10-15" despite my efforts above
Playlist in TubeArchivist
Playlist in YouTube (unarchived videos highlighted)
I'm not exactly sure what the conditions are for it to fail like this so title is probably wrong
Are these videos downloaded and just not in the playlist?
Also check your ignore list, to check you haven't ignored it before.
Checking in with @zombachu to confirm if this is now resolved for you.
Are these videos downloaded and just not in the playlist?
Also check your ignore list, to check you haven't ignored it before.
The videos haven't been downloaded or ignored.
Checking in with @zombachu to confirm if this is now resolved for you.
Haven't tried on 0.4.5 yet but is still an issue on 0.4.4. Will test and report back when I have some time.
@lamusmaser Still present on 0.4.5.
Do you guys want any logs or other info from me before I try deleting and readding the playlist in tubearchivist?
I'm getting the same issue. It'll work the first time if you delete the playlist and re-add to the queue (without subscribing). But later when you add the playlist to the queue again, it'll parse the playlist and say it's adding the new videos to the queue in the docker logs, but the videos never shows up on the actual queue for some reason.
Let's get some complete logs to review.