cdknorow / mega-pipeline

The Mega Pipeline

Mega Pipeline App

🎙️ → 📝 → 🗒️ → 🇮🇳 → 🔊

In this tutorial app is to build a Mega Pipeline App which does the following:

• Allows a user to Record audio using a mic

• The audio file is then transcribed using Google Cloud Speech to Text API

• The text is used as a prompt to a pre-trained GPT2 model to Generate Text (100 words)

• The generated text is synthesized to audio using Google Cloud Text-to-Speech API

• The generated text is also translated to Hindi using googletrans

• The translated text is then synthesized to audio using Google Cloud Text-to-Speech API

Resulting CLI options for each container

Transcribe Audio

python cli.py -d
python cli.py -t
python cli.py -u

Generate Text

python cli.py -d
python cli.py -g
python cli.py -u

Synthesis Audio English

python cli.py -d
python cli.py -s
python cli.py -u

Translate Text

python cli.py -d
python cli.py -t
python cli.py -u

Synthesis Audio

python cli.py -d
python cli.py -s
python cli.py -u

Sample Code to Read/Write to GCS Bucket

• Download from bucket

from google.cloud import storage

# Initiate Storage client
storage_client = storage.Client(project=gcp_project)

# Get reference to bucket
bucket = storage_client.bucket(bucket_name)

# Find all content in a bucket
blobs = bucket.list_blobs(prefix="input_audios/")
for blob in blobs:
    print(blob.name)
    if not blob.name.endswith("/"):
        blob.download_to_filename(blob.name)

• Upload to bucket

from google.cloud import storage

# Initiate Storage client
storage_client = storage.Client(project=gcp_project)

# Get reference to bucket
bucket = storage_client.bucket(bucket_name)

# Destination path in GCS 
destination_blob_name = "input_audios/test.mp3"
blob = bucket.blob(destination_blob_name)

blob.upload_from_filename("Path to test.mp3 on local computer")

• Sample Dockerfile

# Use the official Debian-hosted Python image
FROM python:3.8-slim-buster

# Tell pipenv where the shell is. 
# This allows us to use "pipenv shell" as a container entry point.
ENV PYENV_SHELL=/bin/bash

ENV GOOGLE_APPLICATION_CREDENTIALS=secrets/mega-pipeline.json

# Ensure we have an up to date baseline, install dependencies 
RUN set -ex; \
    apt-get update && \
    apt-get upgrade -y && \
    apt-get install -y --no-install-recommends build-essential git ffmpeg && \
    pip install --no-cache-dir --upgrade pip && \
    pip install pipenv && \
    mkdir -p /app

WORKDIR /app

# Add Pipfile, Pipfile.lock
ADD Pipfile Pipfile.lock /app/

RUN pipenv sync

# Source code
ADD . /app

# Entry point
ENTRYPOINT ["/bin/bash"]

# Get into the pipenv shell
CMD ["-c", "pipenv shell"]

Some notes for running on Windows

• Docker Win10 installation - needs WSL2 or Hyper-V enabled: https://docs.docker.com/desktop/windows/install/
• Use Git BASH to run (which is like a smaller Cygwin)
• Needed to add pwd in quotes in order to escape the spaces that common in windows directory structures
• Need to prefix docker run with winpty otherwise I get a "the input device is not a TTY." error
• winpty docker run --rm -ti --mount type=bind,source="$(pwd)",target=/app generate_text