wizered67 / VoiceControlledShip

An Android game developed with LibGDX during CalHacks 2016. The game is controlled entirely with voice commands and simulates the experience of the captain of a spaceship.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Starship Captain (Fall 2016)

Overview

Made during the 2016 CalHacks Hackathon at UC Berkeley, "Starship Captain" was an attempt to make a game with a unique control scheme. The game, developed with LibGDX, runs on Android phones and tablets and is controlled entirely through voice commands. The idea behind the game is to recreate the experience that the captain of a starship has in sci-fi movies like Star Wars and Star Trek. While the captain does not have direct control over any part of the ship, it is their job to issue commands to the people in charge of various systems on board.

We began by brainstorming a list of systems the player should be able to command, like weapons, shields, and engines. From there we implemented the commands, created graphics, and added enemy ships with a simple AI to fight back. Due to the short time period we had to work on the game, just 36 hours, it's mostly a prototype with minimal gameplay. The speech recognition can be finicky, but when it works it's very satisfying.

Speech Recognition

On the bottom of the screen is a microphone button. While the player holds that button, they can state a command. The Android Speech Recognizer API is used to recognize speech and it suggests a list of strings, which are possibilities ordered by confidence. From there, each suggestion is compared to command patterns until a match is found. Regular expressions are used for the matching and are also able to extract any parameters. Ultimately the string given by the Speech Recognizer is converted to a Command object and then executed. The speech recognition can unfortunately still be somewhat unreliable since it is dependent entirely on the Android Speech Recognizer API correctly recognizing speech and suggesting a command as a possibility. If we had more than 36 hours to work on the game, improving speech recognition would have been one of our priorities.

Gameplay

By using voice commands, the player can move and control a ship. Two meters are shown to the player - health and energy. When health reaches 0, the ship is destroyed and it's game over. Energy is a measure of how much the player can do. Many of the commands available take energy, with some taking more than others. Energy regenerates over time, so it can be used as a resource by the player. The energy system was designed to allow for a lot of versatility and different styles of gameplay. The player can choose to use their energy for many different tasks or use it all at once to focus on one specific area, like firing several shots in a row or saving it all for the shields, which prevent damage at the expense of energy. The repair command even allows the player to directly convert energy to health, although it takes a lot of energy to restore a small amount of health.

There are also two different types of enemies, which the player must defeat. The first type is small and fast, but with little health. It fires three times with pauses in between before attempting to ram the player, destroying itself but dealing significant damage. The large enemy never moves directly towards the player and instead tries to keep a distance. After a while it will fire three simultaneous shots towards the player, making it difficult to dodge. It also has shields up its own which prevent some damage to it.

The player can choose the best strategy to take on these enemies, such as taking them on directly or using the ship's engines to speed away and evade attacks. If enemies get too far away the player can still use the Scan command to try to track them down again.

screenshot

Commands

There are a number of different commands that have been implemented in the game. Here is the full list and their uses:

  • Turn X - Turns the ship X degrees. A compass is on screen at all times so the player knows what degree corresponds to which direction.
  • Fire - Fires several lasers forward, uses some energy.
  • Engines - Provides a temporary speed boost, at the expense of some energy.
  • Shields Up/Down - Changes the current shield status. Shields take some energy to put up initially and the ship loses energy whenever it is hit while the shields are up. However, they prevent damage to the ship's health. If energy gets too low the shields automatically deactivate.
  • Scan - Uses some energy and draws a line to where the nearest enemy is at the moment. The line does not change if the enemy moves and automatically goes away after a short time, so the player may need to use the command several times to successfully track down an enemy.
  • Repair - Uses a large amount of energy and restores some health.
  • Missile X - Fires a missile towards X degrees. Missiles are stronger than regular lasers but more difficult to hit enemies with.

The commands were designed to be as user friendly as possible, so every command have alternative names that can be used. For example, instead of "Fire", the player can also say "Shoot" or "Attack". The commands that take a degree also can instead take a direction, such as right, left, ahead, and behind. The regular expressions used to parse commands were carefully designed and tested to allow as much freedom as possible and to reduce possible error. Any words can be inserted before, between, and after commands and their parameters. For example, "technicians, repair the ship!" would be considered a Repair command and "Fire all lasers towards 25 degrees" would be interpreted the same as "Fire 25".

Credits

  • Adam Victor - design and programming
  • Christine Nguyen - design and graphics

About

An Android game developed with LibGDX during CalHacks 2016. The game is controlled entirely with voice commands and simulates the experience of the captain of a spaceship.


Languages

Language:Java 98.9%Language:GLSL 1.1%