LericDax / vision-utilsX

utilities for vision pro

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

 __   _(_)___(_) ___  _ __    _   _| |_(_) |___
 \ \ / / / __| |/ _ \| '_ \  | | | | __| | / __|
  \ V /| \__ \ | (_) | | | | | |_| | |_| | \__ \
   \_/ |_|___/_|\___/|_| |_|  \__,_|\__|_|_|___/

vision-utils

This repo contains various projects related to the Vision Pro & visionOS.

Contents

2D to Spatial Photo

Convert any jpgs/pngs to spatial photos viewable in the Apple Vision Pro! There is a mini swift cli executable that works on M1 apple computers to attach png files together.

See Blog Post for more info.

Dependencies

We borrow the executable and iphone args from Mike Swanson for converting over under videos to spatial videos.

We also assume that you have poetry globally installed for python packaging.

cd spatialconverter
poetry install
poetry shell
# Poetry breaks when trying to install transformers from source, so run this installation the first time
pip install -q git+https://github.com/huggingface/transformers.git

Subsequent runs

cd spatialconverter/spatialconverter
poetry shell
python main.py --photo /Users/herk/Downloads/photo.png
# python main.py --video /Users/herk/Downloads/skydive.mp4

About

utilities for vision pro

License:MIT License


Languages

Language:Jupyter Notebook 48.9%Language:Python 41.5%Language:Swift 9.6%