specklesystems / SpeckleHackathon-ImgToPointCloud

Home Page:https://speckle.systems/blog/retreat-hackathon-ml-pointcloud/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Speckle ML demo app (image to pointcloud)

WARNING: This repo is the result of a 1day hackathon and is very unstructured.

Description of directories:

  • python-connect: quick proof of concept way of sending pointclouds to a speckle server
  • web-app: The frontend Vue app
  • server: The final backend (includes a copy of the built frontend, for serving)

The server directory started with a clone of the ML model repository that can be found at https://github.com/ialhashim/DenseDepth

In there, there are some extra files that were added/modified:

  • cherry.py - the startup script for this app
  • run.py - edited from a previous script - the pre-processing and post-processing logic
  • sp.py - utility to send pointclouds to a speckle server
  • Dockerfile - for building a docker image with this app
  • Makefile - build and run commands for easily build and run the docker image

To build the app:

  • go into the server directory
  • follow the instructions in the original README.md to download the NYU pretrained model.
  • run make build
  • edit Makefile to include your config
  • run make run

About

https://speckle.systems/blog/retreat-hackathon-ml-pointcloud/


Languages

Language:Jupyter Notebook 81.3%Language:Python 16.8%Language:Vue 0.9%Language:HTML 0.3%Language:Shell 0.3%Language:JavaScript 0.3%Language:Dockerfile 0.1%Language:Makefile 0.0%