Modjular / yaw

napari + deviceorientation

Yaw + Napari

Goal: Use a phone's built-in orientation (via the deviceorientation HTML API) to manipulate a Napari 3D transform

Status

6/12/24

Signal comes through end to end. Using the Vispy Quaternion class did the trick.

However, something weird still seems to be happening between the Flask redis-set and the reading on the other end. I thought smoothing was going to fix things but in the end, it only helped minorly. There's still a large amount of 'jank' when I rotate my phone.

I suspect its something to do with the sample rate.

6/13/24

Upstream bug. POST is not guarenteed sequential. Switching to a Websocket solved the 'jank', which was actually just out-of-order orientations.

6/25/24

Rotations are still weird. According to device rotation docs and this stack exchange post

𝛼: An angle can range between 0 and 360 degrees
𝛽: An Angle between −180 and 180 degrees
𝛾: An Angle between −90 to 90 degrees

For sanity sake:

alpha = z = yaw
beta  = x = pitch
gamma = y = roll

Setup

1. Generate the certificates (first time)

   openssl req -x509 -newkey rsa:4096 -keyout key.pem -out cert.pem -days 365 -nodes
   

2. Install dependencies

   poetry install
   

3. Run Flask app

   poetry run python yaw/app.py
   

4. Run Redis server (installation)

   redis-server
   

5. Open napari

   poetry run python nap.py