elms / sample-googleassistant

Google Assistant API sample for Android Things

Google Assistant API Sample for Android Things

This sample shows how to call the Google Assistant API from Android Things.

It records a spoken request from the connected microphones, sends it to the Google Assistant API and plays back the Assistant's spoken response on the connected speaker.

Pre-requisites

• Android Studio 2.2+.
• Android Things compatible board.
• If using AIY Projects Voice Kit:
  • Android Things Raspberry Pi Dev Preview 3.1 image with I2S enabled.

    • mount the sdcard image

      # replace sdb1 with the sdcard reader device.
      mount -t msdos /dev/sdb1 /mnt/disk
      

    • edit config.txt

      # comment or remove this line:
      # dtoverlay=pwm-2chan-with-clk,pin=18,func=2,pin2=13,func2=4
      #
      # uncomment or add this line:
      dtoverlay=generic-i2s
      

    • umount the sdcard image

      sync
      umount /mnt/disk
      

• If using Android Things: supported microphone and speaker.
  • set AUDIO_USE_I2S_VOICEHAT_IF_AVAILABLE = false in AssistantActivity.java
• Google API Console Project.

Run the sample

• Configure the Google API Console Project to use the Google Assistant API.
• Download the client_secret_NNNN.json file from the credentials section of the Console.
• Use the google-oauthlib-tool to generate credentials:

pip install google-auth-oauthlib[tool]
google-oauthlib-tool --client-secrets client_secret_NNNN.json \
                     --credentials app/src/main/res/raw/credentials.json \
                     --scope https://www.googleapis.com/auth/assistant-sdk-prototype \
                     --save

• Make sure to set the Activity Controls for the Google Account using the application.
• On the first install, grant the sample required permissions for audio and internet access:

./gradlew assembleDebug
adb install -g app/build/outputs/apk/app-debug.apk

• On Android Studio, click on the "Run" button or on the command line, type:

./gradlew installDebug
adb shell am start com.example.androidthings.assistant/.AssistantActivity

• Try the assistant demo:

  • Press the button: recording starts.
  • Ask a question in the microphone.
  • Release the button: recording stops.
  • The Google Assistant answer should playback on the speaker.

License

Copyright 2017 The Android Open Source Project, Inc.

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.