cloud-pubsub

Provides methods to consume messages from Google PubSub using Futures and Hyper.

Authentication

Authentication is provided by rust-goauth. The BaseClient expects to receive the path to the file containing your Google Cloud service account JSON key.

Token Renewal

The JWT token has a short life time and needs to be renewed periodically for long lived processes.

There is a provided helper which will renew the token every 15 mins:

let pubsub = match BaseClient::create(config.google_application_credentials) {
    Err(e) => panic!("Failed to initialize pubsub: {}", e),
        Ok(p) => p,
};

tokio::run(lazy(move || {
    pubsub.spawn_token_renew();
}))

Env Config

Envy is an excellent way to load your config.

#[derive(Deserialize)]
struct Config {
    pubsub_subscription: String,
    google_application_credentials: String,
}


fn main() {
    let parsed_env = envy::from_env::<Config>();
    if let Err(e) = parsed_env {
        eprintln!("ENV is not valid: {}", e);
        std::process::exit(1);
    }
    let config = parsed_env.unwrap();

    let pubsub = match BaseClient::create(config.google_application_credentials) {
        Err(e) => panic!("Failed to initialize pubsub: {}", e),
        Ok(p) => p,
    };
}

Subscribing

Connecting to existing subscription

let sub = my_client.subscribe("subscription-name")

Subscribing to a topic

When subscribing to a topic, a random subscription name will be generated. To prevent dangling subscriptions, you need to explicitly call subscription.destroy().

let topic = Arc::new(pubsub.topic("update-topic".to_owned()));
tokio::run(lazy(move || {
    topic
        .subscribe()
        .map(|subscription| {
            println!("Subscribed to topic with: {}", subscription.name);
            let sub = Arc::new(subscription);
            let get = sub
                .clone()
                .get_messages::<UpdatePacket>()
                .map(move |(packets, acks)| {
                    for packet in packets {
                        println!("Received: {:?}", packet);
                    }

                    if !acks.is_empty() {
                        tokio::spawn(sub.acknowledge_messages(acks));
                    } else {
                        println!("Cleaning up");
                        if let Ok(s) = Arc::try_unwrap(sub) {
                            let destroy = s
                                .destroy()
                                .map(|_r| println!("Successfully deleted subscription"))
                                .map_err(|e| eprintln!("Failed deleting subscription: {}", e))
                                .then(move |_| {
                                    drop(pubsub);
                                    Ok(())
                                });
                            tokio::spawn(destroy);
                        } else {
                            eprintln!("Subscription is still owned");
                        }
                    }
                })
                .map_err(|e| println!("Error Checking PubSub: {}", e));
            tokio::spawn(get);
        })
        .map_err(|e| eprintln!("Failed to subscribe: {}", e))
}));

Known Caveats

A Hyper Client is retained by each PubSub client for reuse. This can cause the tokio runtime to not exit until the Hyper Client keep-alive terminates. To shutdown the runtime immediately on complete, the PubSub client needs to be explicitly dropped.

drop(my_client);

nuxlli / cloud-pubsub