Max/MSP, Jitter, Processing, and OSC
By Peter Wiessenthaner
GLSL optical flow
With high quality texture displacement.
By Andrew Benson
A self portrait made with the Max patch below.
Download patch: hsflowdistort.zip
More from Andrew Benson:
- https://cycling74.com/forums/topic/sharing-new-distortions/
- https://cycling74.com/forums/topic/fluid-with-jit-repos-and-cv-jit-opticalflow/
An example by Axiom Cruz:
Portrait series
Optical flow, a depth camera, and edge detection.
By Matt Romein
https://cycling74.com/project/gif-portraits/
Portrait of Margo Cramer from http://mattromein.squarespace.com/#/portrait-series/
The programming uses the following external code:
jit.gl.hap – Rob Ramirez
ab.hsflow.jxs – Andrew Benson
jit.openni – DiabloDale
cv.jit – Jean-Marc Pelletier
Ableton Push as a low resolution video display
Is 8 x 8 enough?
Adapted from a tutorial by Darwin Grosse
This Max tutorial, from Cycling 74, connects the builtin-camera to a Push display matrix, using Midi sysex codes. https://cycling74.com/wiki/index.php?title=Push_Programming_Oct13_03
If you set the frame rate high enough, you can clearly see motion.
I thought it would be interesting to display icons at this resolution, but its not very impressive. Here’s an example.
The 8 x 8 version is on the left. The original, on the right, is 57 x 57. Another problem is that the RGB quality of the Push is not very accurate for anything beyond primary colors. Here is the modified version of the patch.
Download
https://github.com/tkzic/max-projects
folder: push
patches:
- pushpix-tz.maxpat
Boids sonification in Max
“Boids is a bird flight and animal flock simulator. It is based on the same algorithm which was used in “Jurassic Park” for herding dinosaurs.”
Max external by Singer, Jasch, Sier and Smith. Tutorial by dude837
download
https://github.com/tkzic/max-projects
folder: boids
project: boids23
patch: main-tz.maxpat (slight modification to enable existing presets to work)
externals
- Download version 1.1 from http://s373.net/code/ (in the section called “boids for max”)
- Then add the path to the downloaded folder to Max objects | file preferences
Abstraction of noise
jit.gl.volume example from a snippet in the Jitter reference manual.
by Cycling 74
Produces an infinite stream of abstract art
Dancing Sprites
Audio visualization with multiple planes of video sprites in Jitter
By Andrew Benson
Recipe 6 from Jitter Recipes Book 1 https://cycling74.com/2006/02/06/jitter-recipes-book-1/
Example Output:
An increase in audio amplitude causes the video planes to dance out from the center of the display.
Patch:
Video delay with feedback
download
https://github.com/tkzic/max-projects
folder: video-feedback
patches:
- video-delay-fb (adapted from a patch by Andrew Benson)
- rotation-fb (auto rotation, feedback, matrix resizing, inversion)
Fractal drawing in Max
Fractal geometry with Jitter.
By Peter Elsea
“Fractal geometry is the study of objects that have a property known as self- similarity – They are made up of smaller copies of the overall shape. One of the most popular is called the Sierpinski triangle”
The Max patches were developed (stolen) from Elsea’s lecture notes at http://peterelsea.com/Maxtuts_jitter/Fractals_in_Max.pdf. The first patch draws Sierpinski triangles. The second patch is generalized to circular shapes with N corners.
download
https://github.com/tkzic/max-projects
folder: fractals
patches:
- fractal1.maxpat (triangle)
- fractal-n-corners.maxpat (N corners)
external dependencies
You will need to download Elsea’s Lobjects abstractions and add the path to Max in Options | File Preferences: http://peterelsea.com/lobjects.html
ep-426 Interactive video – Spring 2015 week 3
The matrix
(under construction)
Review of Jitter tutorials:
tutorial 1: play a Quicktime movie
- bang sends a matrix (once)
- jit.fpsgui for debugging
- How would you play a movie play backwards?
tutorial 2: build a single plane matrix
- Anything can be transformed into a matrix
- Create a matrix, row by row, using math (p fillmatrix)
- How to get and set individual cells in a matrix
- jit.matrix
- How would you make pixel art? a drawing program? a spectrum display?
- A lot of specialized Jitter objects are abstractions that do what this tutorial demonstrates – i.e.., building or transforming the planes of a matrix
tutorial 3: math operations on entire matrix/plane
- @op (is an attribute) : was it good design in Max to have both messages and attributes?
- scalar, vector
- pass
- integer/float
- What happens in a jit.pwindow with display size smaller than the matrix?
- upsampling/downsampling
tutorial 4: movie playback.
- jit.qt.movie will play back URL’s (audio and images) – but you can’t work with the sound in Max without Soundflower
- scrubbing and looping produces interesting fx
- hardware controllers
tutorial 5: ARGBI
- Rearranging planes
- 8 bit char data type 0-255
- line object (grain size)
tutorial 6 : color
- scalebias: normalized 0.->1. values, not with 0-255 values (look at the subpatcher)
- planemap attribute for jit.matrix
tutorial 7: hue and BRCOSA
- 2 very different ways of transforming (i.e., filtering) color and light
- Why do we seen green with emphasis and detail?
- hue angle is a way of gradually shifting around the color wheel.
tutorial 8: simple mixing
- jit.xfade
- line object
tutorial 9 – more mixing
- Using various operators to transition, with jit.op, and using jit.scalebias to scale the input values to prevent clipping
tutorial 10 – chromakey
- doesn’t need to be green.
- Could you do a performance where you paste yourself into a band video.
- napoleon dynamite
- actual green screen
Experiments
- video feedback, digital and analog, rotation, matrix resizing, inversion https://reactivemusic.net/?p=18366
- Frame subtraction (Adam Rokhsar) https://reactivemusic.net/?p=7005
- Psychedelics https://reactivemusic.net/?p=12606
- Vizzie verses Jitter
Max 7 lessons review
- fantastic sounds
- RGB music
- geometric dreams
State of the art:
Assignment
Design a project that will be due at the mid-term. Send me an email next week describing the project.
Continue working through the Jitter tutorials 4-12
Design a prototype of a synthesizer that generates accompaniment for animated GIF’s
News
There will be no class next week February 10th
References
Andrew Benson’s Jitter recipes: https://cycling74.com/search-results/#gsc.tab=0&gsc.q=jitter%20recipes
