pkmital

Real-Time-Object-Detection

real time object detection using opencv and simple UI to select the object to track

pkmFFT

pkmFFT provide simple interfaces to the Accelerate.framework for performing vectorized FFT. pkmSTFT builds on pkmFFT to perform Short Time Fourier Transform efficiently using vectorized ops. Also handles options for windowing. pkmDCT provides a simple discrete cosine transform using Accelerate and pkmMatrix.

ofxCaffe

openFrameworks addon for visualizing and interfacing with pre-trained models in Caffe: Convolutional Architectures for Fast Feature Embedding. Requires Caffe, openFrameworks 64-bit, glog, hdf5, OpenCV, CUDA, pkmMatrix, and pkmHeatmap. Pre-trained models not included but can be found linked in Caffe's "Model Zoo" and placed in the bin/data directory of the example project.

autoEncoderSynthesis

Performs interactive audio synthesis using a previously trained auto encoder. VIsualizes hidden layer and allows for interaction with hidden units. W/ Andy Sarroff. See Andy's github (woodshop) for more interesting projects using Deep Learning and audio synthesis.

pkmOpticalFlow

Interface for OpenCV's TV-L1 Duality Based Approach to Optical Flow. Does some additional tricks to speed up processing, allow for analysis of the spatio-temporal changes in flow, and visualize the results.

phdThesis

Ph.D. Thesis from Goldsmiths, University of London entitled, "Audiovisual Scene Synthesis". Hosts all images and latex files.

NSCARPE

CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. CARPE using NSWindow, Multiple Heatmaps, XML file settings, Difference of Heatmaps, GPU optimizations

CEMA

openFrameworks projects from my course at Srishti's School of Art, Design and Technology's Center for Experimental Media: http://pkmital.com/home/teaching/cema-workshop/

ofxiTunesLibraryStream

simple way to stream 32-bit float data from itunes in real-time

pkmBinaural

For performing GPS based concatenative sound synthesis, ANN retrieval based on GPS locations, HRTF based binauralization (mono->stereo using HRTF FFT-based Overlap-Add Convolution) using the IRCAM HRTF Database

pkmKalman

Kalman filter optimized for iOS/OSX

pkmProjectionMapper

openFrameworks based projection mapping for distorting or mapping a collection of drawing commands/videos/images etc... needed a lightweight and robust projection mapping utility though lpmt was too heavy. homography code stolen from lpmt.

eegGaborAnimations

testing eeg encoding/decoding. this produces some gabor wavelets and co-registers the visualization and recording of eeg.

eegLogger

For streaming/logging emotiv eeg headset data

eegShapeAnimations

testing some encoding/decoding using EEG. this produces various animations that are co-registered with the recording of eeg.

ofxOpenCV2461

ofxOpenCV linking against OpenCV 2.4.6.1, including libraries for OSX

pkmDPGMM

Interfacing libcluster for doing Variational Dirichlet Process Gaussian Mixture Models. Depends on Eigen3 and pkmMatrix. Libcluster included.

CARPE-unstable

CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. See http://thediemproject.wordpress.com for more details. Initial release of CARPE hosted for historical purposes. Includes many experimental addons for CARPE including dROIs, GMM, GPU-Flow, and others. See also CARPE and NSCARPE for more recent, stable versions not including the experimental addons.

freesoundDownloader

Uses cURL to download from Freesound.org

lumin-order

LuminOrder: An OS X app to reorder a video in order of its frames' brightness levels.

pkmEXTAudioFile

pkmEXTAudioFileReader and pkmEXTAudioFileWriter provides simple interfaces to reading and writing audio files.

pkmHeatmap

GPU Shader implementation of common heatmap/colormaps for mapping grayscale->colormap such as JET, COOL, HOT, difference heatmaps which map to similar ranges, and support for sending point list for creating a Gaussian Mixture Model which can be visualized as a heatmap or readback for your own purposes..

pkmLSH

Locality Sensitive Hashing

pkmRecorder

For streaming/recording audio files, circular buffers (see pkmMatrix and pkmEXTAudioFile as well)

convertToLevelDB

(unfinished) storing data in leveldb

devart-template

MSVTK

Multiscale Visualization ToolKit

pkmQuadTree

quadtree

vlfeat

An open library of computer vision algorithms

VTK

Visualization Toolkit