ep-426 Interactive video – Spring 2015 week 1

Interactive video programming and performance

Syllabus: https://reactivemusic.net/?p=18208

Notes

Information between words: “Palin Biden Silences” David Tinapple, 2008: http://vimeo.com/38876967

“We used to be Friends” By Benjamin Roberts: https://www.youtube.com/watch?
v=6MbJi0xtnEA

Reverse engineering example: Naoto Fushimi https://reactivemusic.net/?p=18228

frame sub
vizzie –
case study
attributes : attrui

Assignment

Read Jitter tutorials 1-3
  • Playing a quicktime movie
  • Create a Matrix
  • Math Operations on a Matrix

Also, be familiar with the difference between messages, attributes, and arguments with Max objects

Do the lessons in Max 7 that use video and computer graphics
  • fantastic sounds
  • RGB music
  • geometric dreams
Reverse engineer a prototype of one of the examples shown in class

“Palin Biden Silences” or “We used to be Friends”

Either sketch out the design, or make an example using Vizzie that demonstrates some aspect of the process.

ep-426 syllabus – Spring 2015

Interactive video programming and performance

Spring 2015

teacher: Tom Zicarelli – http://tomzicarelli.com

You can reach me at:  [email protected]

Office hours: Tuesday 1-2 PM, or Tuesday 4-5PM, at the EPD office #401 at 161 Mass Ave. Please email or call ahead.

Assignments and class notes will be posted to this blog: https://reactivemusic.net before or after the class. Search for: ep-426 to find the notes

Examples, software, links, and references demonstrated in class are available for you to use. If there is something missing from the notes,  please ask about it. This is your textbook.

Syllabus:

Everybody calls this course “The Jitter class” – referring to Max/MSP jitter from Cycling 74. You will learn to use Jitter. But the object is to create interactive visual art. Jitter is one tool of many available.

The field of interactive visual art is constantly evolving.

After you take the course, you will have designed projects. You might design a new tool for other artists. You will have opportunities to solve problems.  You will become familiar with how others make interactive art. You will explore the connection between sound, video, graphics, sensors, and data. You will be exposed to to a world of possibilities – which you may embrace or reject.

We will explore a range of methods and have opportunities to use them in projects. We’ll look at examples by artists – asking the question: How does that work?

Topics: (subject to change)

  1. Jitter
  2. Matrixes
  3. Reverse engineering
  4. Visualization of audio
  5. Visualization of live data, API’s
  6. Video analysis (realtime)
  7. Video hardware and controllers
  8. Prototyping
  9. Video signal processing
  10. OpenGL
  11. Other tools: Processing, WebGL, Canvas, 2d graphics
  12. Portfolios
  13. Live performance

Grading and projects:

Grades are based on two projects that you will design – and class participation. Please see Neil Leonard’s EP-426 syllabus for details. I encourage and will give credit for: collaboration with other students, outside projects, performances, independent projects, and anything else that will foster your growth and success.

I am open to alternative projects. For example, if you want to use this course as an opportunity to develop a larger project or continue a work in progress.

Reference material

https://cycling74.com/wiki/index.php?title=Max_Documentation_and_Resources

 

cv.jit motion analysis

By Jean-Marc Pelletier

http://jmpelletier.com/cvjit/

Motion Analysis

cv.jit.opticalflow Estimates the optical flow using various algorithms.
cv.jit.LKflow Estimates the optical flow using the Lucas-Kanade technique.
cv.jit.HSflow Estimates the optical flow using the Horn-Schunk technique.
cv.jit.track Track the position of up to 255 individual pixels.
cv.jit.features2track Initialize cv.jit.track to easiest pixels to track.
cv.jit.framesub Difference between consecutive frames.
cv.jit.shift Region tracking using the MeanShift and CAMShift algorithms.
cv.jit.touches Track multiple regions at a time. (Optimized for multi-touch interfaces.)

 

Project examples:

http://www.yourepeat.com/g/cv.jit

 

Cycle-delic

Video feedback generator

By Adam Schabtach at cycling74.com 

in Max/MSP examples: examples/jitter-examples/3rd-party/Cycle-delic.maxpat