👋 Hello there! Welcome to Multi Cloud Transfer Tool (MCT Tool), a Google Colab based Jupyter Notebook that uses Rclone & other popular engines like yt-dlp, aria, libtorrent and 7Zip etc to manipulate & tranfer data (even simultaneously) between two or more cloud services without utilizing one’s own bandwidth or system resources. Sounds awesome, right? 😎
But wait, there’s more! MCT Tool also saves important user session or configuration files in safe (encrypted) format to make things easier next time when user perform same task requiring same configuration or session files. No need to remember those pesky passwords or settings ever again! 🙌
MCT Tool is powered by Rclone, one of the best command line tool for data transfer & data management. It can transfer any amount of data from/to any cloud service without breaking a sweat 💦. It’s like having your own personal cloud assistant that does all the work for you while you sit back and relax ☕.
We use our own Content Delivery Network to remotely control general code behaviour and Cryptography-API to encrypt user provided strings.
->📃Download links from txt file
->🎥YouTube videos/playlist & other sites
->🗃️Torrent DL: (Specific files support)
->📤Upload Files/Folder to Anonymous Platforms
1.Never use MCT Tool for processing any illegal content (Read official FAQ). Since Colab provides flexibility to connect own runtime or server, developers can add features which may or may not be allowed by Colab on runtimes provided by them.
2.Only execute .sh files from trusted authors and never blindly else can cause serious problems like leakage of credentials or API Tokens. Always prefer using official notebook and features provided by original developers.
3.Damage caused due to any type of unofficial edits or forks should not be reported to official contributors. Any error like temporary runtime errors from Colab's side should be reported to Colab team instead of notebook developers, while any report of errors in notebook's code is welcome.
FORCE_REMOUNT: Forcefully remount Google Drive.
CUSTOM_MOUNT_POINT: Choose different path for mounting Google Drive.
DEBUG_MODE: To enable or disable DEBUG mode.
2.Retrieve your previous saved MCT Tool configuration files from Google Drive->My Drive->MCT Config folder to stop wasting your time by setting them again!
Custom_Import_Path: Scan a custom path (or directory) given by user for usable MCT Tool configuration files.
Custom_Export_Path: Export all your MCT configuration files to a gives path.
4.Use service accounts with MCT Tool to avoid Google Drive's transfer limits, read "Using Service Accounts" section to learn how to.
Upload_Service_Accounts: Upload new service accounts on runtime.
Save_To_MyDrive: Save new service accounts to Google Drive -> My Drive. This will overwrite existing service accounts.
delete: Delete the content of folder or single file.
purge: Delete whole directory and leave nothing behind.
rmdir: Completely delete the given path.
rmdirs: Remove any empty directories under the path.
6.Add-ons are additional features which are not offered by Rclone or any other engine officially but created by MCT Tool developers.
7.MCT Tool supports packing & extraction of files or folders in variety of formats and transfer simultaneously.
MCT Tool uses Rclone, one of the best command line tool for data transfer & data management for performing any task involving transfer of data, that means it can transfer any amount of data from/to any cloud service without utilizing one's own bandwidth or system resources.
1.Before we procced, we recommend to either create/upload or retrieve your Rclone config file (rclone.conf) to Colab using below methods. Creating and retrieving will automatically place the file in correct location.
Custom_Import_Path: Scan a custom path (or directory) given by user for usable MCT Configuration files.
Custom_Export_Path: Export all your MCT Tool configuration files to a gives path.
2.Once you done creating or retrieving the config files, just run the cell named "Connect to Cloud Accounts" and it will automatically detect your config file and will show you the available remotes, follow on-screen instructions to mount them
Custom_Mount_Point: To set custom mount point.
Custom_Cache_Dir: To set custom cache directory.
3.After mounting those remotes, now click on the file icon as shown in the image and then navigate to the folder where you mounted your remote (default folder is drives) and you will see the names of remoteswhich you mounted previously.
4.Now copy the file or folder path which needs to be copied, right click on the file or folder and select Copy Path option from the list.
5.After that! paste the path of file or folder in Source field and again go to File Icon->drives and open the mounted remotes into which you want to transfer files/folders and copy its path. You can either directly copy the path of mounted remotes or of any folder inside them and paste the path in Destination field.
6.Choose the method trough which you want to transfer your data, refer to "🚅Modes of Transfer" below to learn about all of them.
Service accounts are just like normal Google account and thus have same upload or download limits as Google account which is 750GB upload and 10TB download per 24hrs. They are used to act on behalf of a Google account and hence we can use them to prevent hitting Google Drive transfer limits by creating them in a bulk amount.
1.Don't have service accounts? create here
2.After creating, make the zip of accounts folder which have 100 or more json files and keep its name as accounts.zip.
3.Now comeback to Colab screen and select saving options for service accounts to use them without uploading zip file again next time.
Upload_Service_Accounts: Upload new service accounts.
Save_To_MyDrive: Save new service accounts to My Drive->MCT Config folder. This will overwrite existing service accounts file.
4.After it, click the file icon, then open accounts folder and right click on anyone json file and select Copy path.
5.Run "Create/Edit/Delete Rclone Config File" section and paste the path in service_account_file during creating remote for Google Drive.
Add-ons are the special functions not provided by any single engine officially and are offered by MCT Tool developers. Each of these functions (or simply add-ons) are explained below with their steps to use.
Function enables to download files or data from single or multiple direct download links to any cloud. It uses Aria engine to deliver best and fastest performance possible. You can also download two or more links at same time with this.
Just put your direct download links in source field and then enter the destination path to where you want to download data. You can enter multiple Direct Download links in the source field by separating them using , between each link in the following format:
Link1,Link2
Function enables to download all links written in a given txt file. This function is useful when we have too many links and it will take too much time separate each link with ,.
User just need to upload the txt file containing the download links to any cloud or in runtime provided by Colab then have to provide its path in source field and Destination path in destination field to where you want to download the data. Best format to arrange links in txt file:
Link1
Link2
Link3
Function gives the flexibility to download YouTube videos or playlist and videos from other supported sites directly to any cloud or in local runtime storages. It uses yt-dlp which downloads everything is maximum quality be default, you can overwrite by passing flags. You can download two or more videos which are not in same playlist or even two separate playlists at once. Refer to yt-dlp documentation for more information.
Just provide the YouTube link of video or playlist or link to videos located on other website (Non-DRM Protected) in Source field and Destination path in Destination field to where you want to download it. You can separate the link of videos or playlist by providing space between each in following format:
VideoLink1 VideoLink2
PlaylistLink1 PlaylistLink2
VideoLink1 PlaylistLink1
Function gives ability to download torrents from .torrent files or magnet links. This function uses LibTorrent to deliver fast download speed as much possible.
User can download whole torrent content or individual files by specifying their list numbers seperated with a space. Additionally, provide destination to overwrite the download location, by default all downloads goes in local runtime directory /content/.
MCT Tool also accepts range, what if user need to select all files ranging from 5 to 50? mentioning each of file indices manually? nope this is enough to make anyone sick, user will simply define that particular range (x-y where x < y) using - (dash) like in this case it is 5-50, this will tell MCT Tool to automatically detect rest of in-between indices.
LibTorrent have some limitations while downloading individual files, so it may partially download unspecified files or user may need to stop execution manually after reaching 100% of download progress.
📤Upload Files to Anonymous Platforms
Function allow one to upload files or folder to supported anonymous file sharing platforms and harvest all generated links in .txt file, officially none of these platform support "folder upload" & "link harvest" feature which sometimes makes uploading multiple files defficult like but MCT Tool uses "for loop" after detecting a given path as 'folder' to continously upload files availabe in given folder and provides option to export all generated links in .txt file to make things more easier.
For this, user just need to provide the required path (file or folder) in source field and follow on-screen instruction.
Ⓜ️ MEGA Links DL:
Function downloads MEGA Link with or without using user's MEGA account to directly any cloud.
As stated above, user can use MEGA account and MCT Tool will save its credentials in safe format automatically for future use. Enter MEGA link in source field and destination path where MEGA link needs to be downloaded, by default if no destination path is mentioned then link data will be moved to downloads folder in runtime's local storage.
🗑️UUP DUMP:
Function enables to collect files mentioned in uup_download_linux.sh files and upload them to any cloud mentioned as destination. It makes work easier for users making ISO files using .sh file given by UUP DUMP or any other website.
Provide the exact path of uup_download_linux.sh file or folder pathh contaning .sh file in source field and destination path where all files needs to be downloaded using given .sh file.
📦Packing & Extracting Files/Folder
MCT Tool comes with the ability to pack or extract any files or folder in variety of formats with or without password protection while moving the data from one cloud to another cloud.
First mount remotes between which you need to transfer the packed or extracted data. Read STEP 2 of "🪝Multi Cloud Transfer" section to learn how to do that.
Now Get both source path & destination path.
After it, choose the action which needs to be done with the source path and then enter following Details:
.txt file, officially none of these platform support "folder upload" & "link harvest" feature which sometimes makes uploading multiple files defficult like but MCT Tool uses "for loop" after detecting a given path as 'folder' to continously upload files availabe in given folder and provides option to export all generated links in .txt file to make things more easier.uup_download_linux.sh files and upload them to any cloud mentioned as destination. It makes work easier for users making ISO files using .sh file given by UUP DUMP or any other website.uup_download_linux.sh file or folder pathh contaning .sh file in source field and destination path where all files needs to be downloaded using given .sh file.
Packed_File_Name: Name of output zipped file. If no name is passed then MCT Tool will use original name.
Source_Path: The path of data which needs to be processed.
Destination_Path: The path on which you want the final output.
User can also encrypt filename & other important file attributes by enabling ENCRYPT_FILENAME option, filename encryption is only supported by .rar and .7z formats and using given option with unsupported formats or conditions will only add standard password protection.
📂GoFile Integration
GoFile is a free file sharing & unlimited storage platform, MCT Tool provides special integration through which users can upload files/folders to GoFile from any cloud service with recursive upload support.
MCT Tool supports both, anonymous upload or upload using specific account in specific folder using user's API Token provided by GoFile. Additionally, MCT Tool saves API Tokens (in json format) provided by user in encrypted format to make work easier next time.
Methods:
Manage Tokens - Save/Remove your GoFile tokens.
Upload Files - Upload files or folder.
Server Details - Show GoFile's server information.
Account Details - Request GoFile for user's account details & make it human readable, also generates login URL.
Fields:
SOURCE - File or Folder path to upload.
DESTINATION - Parent Folder ID in which data needs to be uploaded, provided by GoFile. If not provided, files or folder will be automatically uploaded to root folder.
Options:
RECURSIVE - Upload folder data recursively.
RAW - Show API Response as raw.
🚅Modes of Transfer
MCT Tool supports all transfer methods provided by Rclone as follows:
Copy: Copy files from source to dest, skipping identical files.
Copyto: This can be used to upload single files to other than their current name.
CopyURL: Download a URL's content and copy it to the destination without saving it in temporary storage.
Move: Moves the contents of the source directory to the destination directory.
Moveto: If source:path is a file or directory then it moves it to a file or directory named dest:path.
Check: Checks the files in the source and destination match. It compares sizes and hashes (MD5 or SHA1) and logs a report of files that don't match. It doesn't alter the source or destination.
Sync: Sync the source to the destination, changing the destination only. Doesn't transfer files that are identical on source and destination, testing by size and modification time or MD5SUM. Destination is updated to match source, including deleting files if necessary (except duplicate objects, see below).
Bisync: Bisync provides a bidirectional cloud sync solution in rclone. It retains the Path1 and Path2 filesystem listings from the prior run. On each successive run it will:
Cat: Rclone cat sends any files to standard output.
CleanUp: Clean up the remote if possible. Empty the trash or delete old file versions. Not supported by all remotes.
ls: List all the objects in the path with size and path.
lsd: List all directories/containers/buckets in the path.
lsl: List all the objects in the path with size, modification time and path.
test makefile: Make files with random contents and of any size.
md5sum: Produce an md5sum file for all the objects in the path.
sha1sum: Produce a sha1sum file for all the objects in the path.
size: Return the total size and number of objects in path.
genautocomplete: Output shell completion scripts for rclone.
gendocs: Output markdown docs for rclone to the directory supplied.
obscure: Obscure password for use in the rclone.conf.
tree: List the contents of the remote in a tree like fashion.
Following Modes can easily cause Data Loss:
Delete: Remove the files in path.
Purge: Will delete whole Directory and leaving nothing behind.
rmdir: Completely Delete the given path.
rmdirs: Remove any empty directories under the path.
⛑Need help!
Subscribe Telegram channel.
Send personal message on Telegram here.
❤️Credits & Thanks
Dr.Caduceus: Owner of MCT Tool & maintainer.
Rclone: The backbone of this powerful project.