Installing Transcribe

Root node

First install CryoCore and CryoCloud (Might need develop branch)

Install nginx with ssl sertificates (certbot is good)

sudo apt install nginx certbot python3-certbot-nginx
sudo certbot -d <yourdomain> --nginx

Create your web directory (set it up properly too, the default is /var/www/html).

Set config for the transcode:


# Default model, webroot is place on the worker node's disk to place the
# result, weburl is the root of that directory on the web

ccconfig add Cryonite.NetTranscriber.model large-v2
ccconfig add Cryonite.NetTranscriber.webroot /var/www/html/transcribe
ccconfig add Cryonite.NetTranscriber.weburl https://<yourdomain>/transcribe/

Model can also be a local file, as long as whisper-timestamped can use it.

In order to use automatic starting, ensure that this command succeeds from the root node, and ensure that the name of the node is correct in nettranscribe.json (it must be on the machine that can run gcloud, default is ccroot), and that the instance name of your processing machine is set (default is instance-1).

# If not logged in
gcloud auth login 

gcloud compute instances list

The instance mentioned in the "start" clause in the gcloud module in nettranscribe.json must be listed by the gcloud list command.

Open for remote connections on the root node for remote mysql connections, change the listen port to the local IP above, add user and grant access to cryocore.* to the user.

# Something like this

CREATE USER 'cc'@'workernodenameorIP' identified by 'yourpassword for mysql';
GRANT ALL ON cryocore.* to 'cc'@'workernodenameorIP';
FLUSH PRIVILEGES;

You should now be able to connect with mysql -u cc -p cryocore from the worker node.

On the worker node, install cryocore and cryocloud as mentioned earlier. Edit ~/.cryoconfig and make it look something like this, using the IP on your root node.

{
  "db_host": "10.128.2.12"
}

Set up shared filesystem: Make the mount point /data and set cryocore as owner.

Export it via nfs (install nfs server first), ensure that the IP range is good for you.

# In /etc/exports
/data 10.186.0.0/16(rw,sync,no_subtree_check)

Worker node

Mount the shared data drive, by adding somethig like this to your fstab:

# In /etc/fstab
<ipofrootnode>:/data /data nfs defaults 0 0

Now you might need dockers and GPU support for that, so just hammer on Google and try all the black magic you can find to make that work. When

docker run --rm  --gpus all nvidia/cuda:11.6.2-base-ubuntu20.04 nvidia-smi

runs without errors as the cryocore user, you are good!

Automatic shutdown

Ensure that your user can run "sudo halt -p" with no password prompt. This can be done by running:

visudo

# Then add this bit at the end
cryocore ALL=(ALL) NOPASSWD: /sbin/halt -p

We then need to start stuff on boot

sudo crontab -e

# Add this line
@reboot /home/cryocore/git/transcribe/workernode/onstart.sh

Dependencies

We also need ffmpeg to run, install as you wish.

Alternative processing chains

The "whisper.json" workflow contains a more advanced processing, generating "FancySubs" after identifying users and dynamic aspect ratio based on mediapipes.

Snarkdoof / transcribe