JVT038 / MetaTube

Python web ui to download videos from YouTube and add metadata on top of it

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

MetaTube

Github top language Github language count Repository size License Github issues Github forks Github stars

Status

βœ”οΈ MetaTube πŸš€ Finished! βœ”οΈ

Disclaimer: This project will most likely not receive any major features. The focus will be on fixing breaking bugs and updating the dependencies.


About   |   Features   |   Technologies   |   Requirements   |   Starting   |   License   |   Disclaimer   |   Author


🎯 About

MetaTube downloads video from YouTube and can add metadata from a specified metadata provider on the downloaded file.

Normal view Dark mode
startpage darkstartpage
2022-01-03.21-40-37.mp4
2022-01-03.21-39-36.mp4

✨ Features

It's finished (for now) and these features are currently supported:

βœ”οΈ Fetch information from a YouTube video based on an URL
βœ”οΈ Query and fetch results from the Musicbrainz API, the Spotify Web API, and the Deezer API
βœ”οΈ Set up templates and options for the YouTube download
βœ”οΈ Download YouTube videos based on a selected template
βœ”οΈ Exclude fragments (such as intros, outros, etc.) from the download
βœ”οΈ Metadata from either the user or the chosen metadata provider can be merged with MP3, Opus, FLAC, WAV, OGG, M4A & MP4 files
βœ”οΈ Hardware encoding using NVENC, Intel Quick Sync
βœ”οΈ Hardware encoding is supported, but not yet tested for Video Toolbox, Video Acceleration API (VAAPI), AMD AMF & OpenMax OMX
βœ”οΈ Manually set height and width, if a video type has been selected
βœ”οΈ Store the information about downloaded releases in the database, to edit the downloaded metadata or the file itself later after the download
βœ”οΈ Dark mode is available
βœ”οΈ Docker is supported

I'm currently not planning on adding any new features; I'll only fix any bugs, but if you have a nice feature, feel free to create an issue, and I'll decide whether I'll actually do it.

πŸš€ Technologies

The following tools were used in this project:

For a complete list, visit the Dependencies overview in the Insights.

βœ… Requirements

Before starting 🏁, you need to have Git and Python 3.8 or higher installed.

🏁 Starting

🐳 Using Docker

CLI docker:

docker run \
  -d \
  --name metatube \
  --restart always \
  -p 5000:5000 \
  -e PORT=5000 \
  -e HOST=0.0.0.0 \
  -v /downloads:/downloads:rw \
  -v /metatube/database:/database:rw \
  -v /metatube/migrations:/config/migrations \
  jvt038/metatube:latest

Docker-compose:

version: '3.3'
services:
    metatube:
        container_name: metatube
        restart: always
        image: jvt038/metatube:latest
        ports:
            - '5000:5000'
        environment:
            - PORT=5000
            - HOST=0.0.0.0
        volumes:
            - '/downloads:/downloads:rw'
            - '/metatube/database:/database:rw'
            - '/metatube/migrations:/config/migrations:rw'      

You need to set the variable DATABASE_URL to a custom mount point (in these examples /database), because otherwise your database file will reset everytime the Docker container updates.

πŸ› οΈ Manually build and start server

# Clone this project
$ git clone https://github.com/JVT038/metatube

# Access
$ cd metatube

# Skip these steps if you don't want to use a virtual environment
# Install virtualenv
$ pip install virtualenv
# Create virtual environment in current directory
$ virtualenv .
# Activate environment
# Windows:
$ cd Scripts
$ activate
# Linux:
$ source bin/activate
 
# Navigate to the root directory
$ cd ../

# Install dependencies
$ pip install -r requirements.txt

# If you're using Windows, you need to install python-magic-bin
$ pip install python-magic-bin
# If you're using Debian / Ubuntu, you'll need to install libmagic1
$ sudo apt-get install libmagic1
# If you're using iOS, you'll need to install libmagic
$ brew install libmagic

# Run the file
$ python metatube.py

# The server will initialize in the <http://localhost:5000>

You can set the following environment variables:

Name Description Default value
PORT Set the port on which the MetaTube server will be available 5000
HOST Set the address on which the MetaTube server will run 127.0.0.1
DEBUG Whether to enable debug mode or not False
DATABASE_URL The URL to your Database. Currently only SQLite3 is supported. sqlite:///app.db
FFMPEG An absolute path to the folder containing ffmpeg. Empty
DOWNLOADS An absolute path to the default download folder /absolute/path/to/MetaTube/downloads; absolute path will be calculated automatically
LOG Whether to keep logs or not False
SOCKET_LOG Whether to log in- and outcoming websocket connections; warning: your console can be spammed with connections False
LOG_LEVEL Numeric value from which MetaTube will keep logs. Info here 10
URL_SUBPATH Set the URL subpath, if you want to run MetaTube on a subpath. Example: /metatube will run the server on host:port/metatube /
INIT_DB Automatically initialize the database and make all migrations. Set to 'False' if you're having issues with migrations True
# On Windows 10, you can set an environment variable like this: 
$ set ENVIRONMENT_VARIABLE = Value

# On Linux and MacOS, you can set an environment variable like this:
$ export ENVIRONMENT_VARIABLE = Value

Additionally you can create a file called .flaskenv and set the environment variables in there. An example is provided in example.flaskenv. You can use that template and rename the file to .flaskenv.

Fix the artist values

So I recently discovered I made a mistake in the process of adding artists to files.
Some songs have tags multiple artists, and I noticed these tags were misinterpreted by my audio player.
Basically, the TPE1 tag contained was like this: ['artist 1; artist 2'], while it should've been ['artist 1', 'artist 2'].
Thanks to #310 I discovered this, corrected it in metadata.py and wrote a small script in fixartists.py to fix the existing audio files that had the tags in the wrong way.
Put all the wrong audio files in one directory, run the file and enter the path to the directory containing the incorrect tags, and it should be fixed.
My apologies for this (annoying) bug.

πŸ“ License

This project is under license from GNUv3. For more details, see the LICENSE file.
I am not responsible for any legal consequences the user may or may not face by using this project.

Made with ❀️ by JVT038

To-Do

Finished

  • Add support for the use of proxies to download YouTube videos
  • Add Docker support
  • Add Docker support for ARM64/v8 devices (such as Raspberry Pi 4)
  • Add Github action / workflow thing, to automatically create Docker image upon a new commit
  • Add support for Spotify as a metadata provider
  • Add support for Deezer as a metadata provider
  • Add support for Genius as a metadata provider
  • Add support for embedded lyrics (if possible)
  • Add support for subpath (such as localhost:5000/metatube)
  • Add a nice progress bar
  • Add a function to allow users to download the song onto their device
  • Add button in settings to download all the downloaded content
  • Add ability to manually set video width & height, if a video type has been selected
  • Add ability to manually set video width & height, if a video type has been selected, AFTER the item has been inserted into the database
  • Add in-built file explorer, making manual paths optional
  • Preview filenames when entering an output template
  • Make the Docker file smaller, because it's huge
  • Build a logger
  • Catch and show errors properly
  • Support looking for YouTube videos and downloading them
  • Store the information of downloaded songs in a SQL database
  • Make it mobile-friendly
  • Use Sponsorblock and yt-dlp to automatically skip fragments
  • Manually edit metadata of file, before the download
  • Manually edit metadata of file, after the download
  • Select output type (coding, extension, etc.)
  • Switch from AJAX to websockets
  • Hardware transcoding with NVENC, Intel Quick Sync, Video Acceleration API (VAAPI) & AMD AMF
  • Improve the automatic creation of the database, the tables and the default rows, because it's horrible right now.
  • Use multiprocessing and websockets to make the overview page faster
  • Dark mode support
  • Fix error Synchronous XMLHttpRequest on the main thread is deprecated because of its detrimental effects to the end user’s experience. For more help http://xhr.spec.whatwg.org/ in overview
  • Make sure the search for downloaded song field works
  • Make sure the progress bar works properly in a Docker container, because it doesn't work properly rn

Not finished (I'll probably never finish this lol)

  • Add it to the PyPi library
  • Add support for sites other than YouTube
  • Add support for YouTube playlists
  • Add custom YouTube-DLP options
  • Add support for H.265 / HEVC
  • Add authentication system with an optional reverse proxy
  • Add support for TheAudioDB
  • Add support for YouTube Music
  • Add support for Last.fm!
  • Add translations
  • Add some nice animations
  • Add a cancel download button when the video is being downloaded
  • Add button in settings to download the entire SQlite3 Database
  • Add support for HTTPS / SSL
  • Give the user the option which level of logs to show / log and whether to save the logs to a file
  • Support querying the Musicbrainz database and matching YouTube videos with them
  • Support MySQL
  • Make a CLI to download and match music
  • Have a proper versioning system, because it's impossible to keep track of versions rn
  • Cache and store the segments and other video data, so next time of loading a video will be faster
  • Send websocket requests to one specific device / client only, to prevent duplicate websocket requests
  • Use proper queues and threading during download instead of the weird ping-pong system between the client and the server.*
  • Add unit tests for the download, metadata logic, template / database stuff, config detection, automatic migrations
  • in progress  

Disclaimer

I made this project to educate myself about Python, and to learn how metadata works in combination with files. Additionally, I want to emphasize I do NOT encourage any pirating, or any other illegal activities. This project's purpose isn't to illegally download content from YouTube; its purpose is to educate and enlighten myself (and others viewing the source code) about Python, how Python interacts with metadata in files, and metadata works, and how yt-dlp works. I am not responsible if the user downloads illegal content, or faces any (legal) consequences.

Back to top

About

Python web ui to download videos from YouTube and add metadata on top of it

License:GNU General Public License v3.0


Languages

Language:Python 39.9%Language:JavaScript 38.8%Language:HTML 21.1%Language:Dockerfile 0.2%