Motion-sound Interaction
Sonification based on Motiongrams
By Alexander Refsum Jensenius
(Clicking this link will download a pdf file of the research paper)
cv.jit motion analysis
By Jean-Marc Pelletier
Motion Analysis |
|
cv.jit.opticalflow | Estimates the optical flow using various algorithms. |
cv.jit.LKflow | Estimates the optical flow using the Lucas-Kanade technique. |
cv.jit.HSflow | Estimates the optical flow using the Horn-Schunk technique. |
cv.jit.track | Track the position of up to 255 individual pixels. |
cv.jit.features2track | Initialize cv.jit.track to easiest pixels to track. |
cv.jit.framesub | Difference between consecutive frames. |
cv.jit.shift | Region tracking using the MeanShift and CAMShift algorithms. |
cv.jit.touches | Track multiple regions at a time. (Optimized for multi-touch interfaces.) |
Project examples:
http://www.yourepeat.com/g/cv.jit
Make yourself transparent
Cycle-delic
Jitter video analysis
Antarctic surface velocity
By gibberishword at reddit.com
Video from Audio
Audio from Video
Using video to generate audio.
jit.peek~ outputs an audio signal from video matrix data.
(jit.peek~ help)
from cycling74.com
At any point in the the process, matrix data can be tapped to produce an audio signal. Analyzing video is very much like analyzing audio. For example, using envelope following and spectral analysis. Here are examples.
examples
1. jit.peek~-additivesynth.maxpat (in Max/MSP examples/jitter-examples/audio)
Draw a song
By Adam Florin and Joshua Kit Clayton
2. Frame subtraction
By Adam Rokshar
https://reactivemusic.net/?p=7005
3. Sound Emotion2 – using Macbook built-in camera
By Andreas Wittich
https://reactivemusic.net/?p=9225
4. jit.peek~-osctrack.maxpat (in Max/MSP examples/jitter-examples/audio)
Derives rhythmic audio data from video. (Using bball.mov)
By cycling74.com
5. Whispering Heights (in Max/MSP examples/jitter-examples/3rd-party/image-to-spectral-filter/whispering_heights.maxpat)
Similar to above but uses video to create a moving spectral filter.
6. Wolframatic.maxpat (in Max/MSP examples/jitter-examples/other/Wolframatic/)
Fractal generator also generates audio.
By R. Luke Dubois
Ten-Tec Rebel Model 506
Open Source QRP CW Transceiver
http://www.tentec.com/rebel-model-506-open-source-qrp-cw-transceiver/