voidit / Face-It

A repository of Processing examples for ITP fall workshop about face detection, recognition, and miscellaneous tracking methods.

Face It Syllabus

A "syllabus" and repository of Processing examples for ITP fall workshop about face detection, recognition, and miscellaneous tracking methods.

Day 1, Saturday, September 28, 10-5

10:00 AM - Overview of day

• Detection vs. Recognition vs. Tracking

10:15 AM - Reference Projects

• Face Detection
  • Drawing faces as instructed by facial detection
  • Portrait – Discovering centric figure(s) of movies using facial recognition
  • Cloud Faces
  • Google Earth Faces
  • CVDazzle
• Face Recognition
  • Spurious Memories
• Face Tracking
  • Dance with your face
  • Face Substitution, Source
  • Kamio IOS app
  • All the Universe is Full of the Lives of Perfect Creatures
  • Typface
• Other
  • Split Faces by http://www.ulriccollette.com/
  • Blind self-portrait and Self-Portrait Machine
  • The Human Face Documentary: Part 1, Part 2, Part 3, Part 4

11:00 AM - OpenCV Face Detection

• How it works
  • Download Release,Processing OpenCV library
  • Face Detection visualized by Adam Harvey
  • Interview with Adam Harvey re: Face Detection
  • Haarcascade Visualizer -- Note this requires Processing 1.5.1
• Examples
  • Detect face in image
  • Detect face in live video
    • scale down resolution for performance
    • save face as JPG
    • track faces over time
    • save faces as images
  • Face Detection in JavaScript!

12:00 PM - Lunch

1:00 PM - Face Recognition

• How it works
  • Eigenfaces
    • Processing example from Greg Borenstein using Processing-Eigenfaces
  • More algorithms and stuff
• But let's just use an API!
  • Rekognition, Sign up for API key
    • Rekognition for Processing Library
    • also requires HTTProcessing
    • Examples
      • Detect a Face
      • Train a Face
      • Recognize a Face
      • Look at raw JSON
      • Threaded request
      • Putting it all together with Live OpenCV
  • Lambda Labs
    • Processing library in progress -- talk to me if you want to use this.

2:30 PM - Face Tracking

• FaceTracker by Jason Saragih.
  • Interview with Kyle McDonald about FaceTracker
  • Original "Deformable Model Fitting by Regularized Landmark Mean-Shift" paper.
  • ofxFaceTracker for direct use in OF.
    • FaceOSC Downloads for use with Processing and other applications
    • FaceOSC + Syphon to get image into Processing
    • Blink detection OSC
    • OSC
      • oscp5 (install through Processing library manager)
      • Osculator for help with debugging OSC
  • Examples
    • Simple Tracker Data Demo
    • All Points
    • Triangle Mesh
    • Puppet Face, Requires: FaceOSC-Img
    • Blink Particles - requies: BlinkExample
    • More Processing Examples
    • All OF Examples
• FaceShift
  • download free trial - 30 days only, noncommercial license avaialble for $150 and there will be a faceshift laptop in ER for checkout with academic license.
  • ofxFaceShift for direct use in OF
  • FaceShiftOSC tutorial from Kyle (note the tutorial uses an older version of FaceShift but concepts still apply).
  • FaceShiftOSC download
  • Simple OSC Processing Example
• Face Morphing
  • How it works
  • Michael Jackson Black or White video
  • Examples
    • Triangle Interpolation with Textures
    • Face Morphing

4:00 PM - Wrap-Up / Project Idea Discussion

Homework

• Post a link to your work here

Day 2, Friday, October 4th, 3:30-6

Project Presentations