ep-426 Interactive Video – Spring 2015 week 13

More analog video

Screen Shot 2015-04-18 at 1.57.01 PM

A scene from a sea otter video processed using ‘Premium Cable’ by BPMC

Not modular

Two weeks ago Christopher Konopka demonstrated modular analog video. This week we will explore analog video made from found objects and circuit bending. https://reactivemusic.net/?p=18982

Kinect

Kinect is still your friend, especially if you use Windows.

Screen Shot 2015-04-04 at 4.38.25 PM

Kinect – revisited: https://reactivemusic.net/?p=18803

TV and CRT’s

Screen Shot 2015-04-09 at 7.24.11 PM

Jitter and OpenGL

Screen Shot 2015-04-19 at 10.41.42 PM

Claire Steeger wrote a new tutorial (with Max patch) called “Simple Intro to jit.gl.multiple” http://www.clairesteger.com/home/simple-intro-to-jitglmultiple. Its shows several ways to modulate complex 3d shapes using audio and data.

WebGL

Euphony – A webGL Midi file player

by Xueqiao Xu

https://www.chromeexperiments.com/experiment/euphony

Miscellaneous

I’m thinking of something: http://imthinkingofsomething.com

Analog video synthesis

Vintage consumer electronics, adapter cables, converters, and circuit bending.

e_clock2_1

Signal formats

Note: everything here refers to NTSC which is the standard video format in the USA.

Composite

“Composite video (one channel) is an analog video transmission (without audio) that carries standard definition video typically at 480i or 576i resolution.” -from Wikipedia

Composite uses the yellow RCA plugs found on most consumer video devices. It is also the standard for LZX analog modular systems http://www.lzxindustries.net.

Because composite is the most common format, the approach here will be to convert everything else to composite. With a few exceptions.

S-video

S-video uses several channels to convey AV data. The easiest way to convert S-video to composite, or vice-versa is to use a VCR or capture device that has s-video IO.

VHF analog TV

Older video devices use coaxial cables with F connectors to transmit modulated AV signals on channels 3 and 4.

RF modulators and demodulators
RF modulators

To convert from composite to TV use an RF modulator:

7162

You can also use a VCR as an RF modulator.

RF modulators can be used as TV transmitters.  https://reactivemusic.net/?p=12355

RF demodulators

To convert from TV to composite, use an RF demodulator. The demodulator removes the VHF carrier, leaving a baseband composite signal.

Demodulators can be expensive and difficult to find, so if you are not too concerned about image quality its easier to use a VCR. Connect the input signal to the TV coax input. Set the VCR to channel 3 or 4. The signal passes through to the composite output (yellow RCA jack). This method also works as an inexpensive method of TBC (time base correction).

VGA

Use a PC to TV converter to convert VGA signals to composite: https://reactivemusic.net/?p=18716

Screen Shot 2015-03-27 at 5.02.22 PM

Video capture

There are many options for video capture depending on which operating system and applications you are using.

Here are several methods that work with MAC OS

Capture devices
  • Elgato Video Capture – USB (only works through Elgato app)
  • Diamond Video Capture – USB (shows up as a video camera?)
Media converters

Grass Valley ADVC 110 Digital Video Converter – Firewire 400 http://www.grassvalley.com/products/advc110

Analog to digital pass-through

Some camcorders work as digital media converters. It may be difficult to determine which ones do this.   Here’s a list of Sony camcorders that have this capability: http://forum.videohelp.com/threads/355121-Sony-Handycam-Digital8-camcorders-with-analog-digital-passthru

Another list: http://fccug.org/2222-10b%20How%20to%20convert%20an%20analog%20signal%20to%20digital.pdf

Some home-theatre system receivers will convert a variety of formats. I have not used this method.

iOS, Android

To capture video from a mobile device, use a streaming program like Airplay or Airserver http://www.airserver.com/Mac, or an adapter cable like http://store.apple.com/us/product/MD098AM/A/apple-digital-av-adapter.

With MAC OS Yosemite Airplay capability might be built in?

Web cams

Macam supports a variety of web cams. https://reactivemusic.net/?p=19000

Examples

Here are some of my favorite ways to generate and process video.

Videonics Video Equalizer

32166_1_584d4a

Composite and S-video IO.

Camcorders with composite output

DCR-HC62_cw_1_540x435

Many camcorders have composite output. Often they will use a proprietary AV adapter cable. Classic Sony camcorders use an adapter cable with 3.5 mm plug connecting to 2 or 3 RCA plugs for composite video and audio.

Camcorders are the most versatile and interesting devices for synthesis. They are instant feedback machines. Just point the camera at the screen. Zoom for instant hallucinations. Some camcorders have filters that can be applied in real time.

VCR’s

VCR-1200

Older VHS VCR’s and tapes are inexpensive. Sometimes free. They provide an infinite variety of input signals. As well as a variety of signal conversion functions. Look for one that has a remote control.

Ancient analog TV’s

Portable TV

Use an RF modulator (see above) to watch composite video on a very old TV. You may also need an impedance transformer if the TV has screw terminals instead of a coax jack.

Here’s a Max patch running on a portable TV: https://reactivemusic.net/?p=18716

Atari Video Music c-240

atari-video-music-player-c240-c-240

The Atari Video Music generates geometric patterns from audio input. https://reactivemusic.net/?p=19004. It features a TV output, although oddly uses an RCA plug. Use an RF demodulator (see above) or a VCR to convert to composite.

BPMC  circuit bent analog video

premium3-600x398

http://glitchart.com

BPMC produces circuit bent versions of consumer video devices. I have been using the BPMC “Premium Cable” device. It is an amazing effects processor. It has composite IO (and S-video).

My First Sony

img_me-70058

A video version of MS-paint. It has composite output and is fun to draw with. The AC adaptor can be difficult to find. But it also works with D batteries.

alien

ep-426 Interactive Video – Spring 2015 week 12

(under construction)

Various topics

Screen Shot 2015-03-11 at 10.14.38 PM

Artists

Camille Utterback
Luke Dubois

http://www.lukedubois.com

Various examples: https://reactivemusic.net/?p=7769

Brian Eno
Tadej Droljc

Sonographic sound processing in Max https://reactivemusic.net/?p=16887

(Example of 3d speech processing at 4:12 in video)

local file: SSP-dissertation/4 – Max/MSP/Jitter Patch of PV With Spectrogram as a Spectral Data Storage and User Interface/basic_patch.maxpat

Try recording a short passage, then set bound mode to 4, and click autorotate

Blair Neal

Ancient history

Don Slepian 1983

http://en.wikipedia.org/wiki/Video_synthesizer

Chromascope https://reactivemusic.net/?p=18733

Franciszka and Stefan Themerson 1944/45

The Eye and the Ear: https://reactivemusic.net/?p=18707

The Outer Limits (TV) 1963

https://www.youtube.com/watch?v=8CtjhWhw2I8

https://www.youtube.com/watch?v=DY6y0zRCiOY

sound effects: https://www.youtube.com/watch?v=D_Ao7EKTNiA

Video

Sometimes we overlook easy paths:

More Jitter tricks

jit.ameba : https://reactivemusic.net/?p=18934

jit.cornerpin https://reactivemusic.net/?p=11838

jit.scope:

gifsyphon: https://reactivemusic.net/?p=18846

Brushtips: https://reactivemusic.net/?p=18835

Robomoves: https://reactivemusic.net/?p=18694

Silhouettes: https://reactivemusic.net/?p=18828

Analog modular video links:

links to analog video

 

ep-341 Max/MSP – Spring 2015 week 12

(under construction)

Algorithmic composition and generative music – part 1

Screen Shot 2015-04-13 at 11.09.59 PM

  • This week we will explore probability, randomness, and sequencing.
  • Next week we will look at audio reactive music
  • In part 3 We will sonify data and gestures

That’s a lot of buzzwords.

How do people compose music?
  • What is your composition tool/method of choice?
  • Dramatic shape https://reactivemusic.net/?p=17176
  • “How to Write a Song” By Henry Kane, 1962
  • “This is Your Brain on Music” by Daniel Levitin
3 approaches

Chris Dobrian  https://reactivemusic.net/?p=18914

  • systematic
  • intuitive
  • arbitrary
Framing the process of composition
Examples

The earliest examples of algorithmic composition applied mathematics to pitch, rhythym, harmony, and ensemble playing. Midi was an ideal medium for mathematical transformations. The examples we look at today are for the most part Midi based.

Composing with Max
Markov chains
  • Fuji Kureta: MarkovChain 2-fuji-kureta.maxpat (using Midi piano scores) debussy-cc4-format0.mid (The snow is dancing)
  • Mchain external by Richard Dudas – https://reactivemusic.net/?p=18926
    • text
    • interactive midi notes
References

Assignment

Design a generative music machine.

I would encourage you to collaborate. To use the work of other artists as a starting point. And to build a composition/performance tool that you would actually use.

This assignment will be due on the last class day of the semester (May 5th).

jit.ameba

Downsample/upsample with non obvious results.

Screen Shot 2015-04-13 at 2.22.43 PM

 

Mystery surrounds jit.ameba.

From earlier (Max 5)  Cycling 74 documentation https://docs.cycling74.com/max5/refpages/jit-ref/jit.ameba.html:

“The jit.ameba object began life as a completely failed attempt at a linear interpolation object. As the Oblique Strategies say, “Honor thy error as a hidden intention.” If you’re interested in linear interpolation objects, try the jit.plur object. Otherwise, please enjoy the mess.”

Horizontal and vertical quantization

What actually does that mean?

From the Cycling 74 Wiki

https://cycling74.com/wiki/index.php?title=jit.ameba

(There is no information here)

From Peter Elsea

http://peterelsea.com/Maxtuts_jitter/Gallery.pdf

“This is a pixilation (resampling) trick. The help file admits this was supposed to be something else, but didn’t work. Needs a spell check too, but pretty interesting. ”

 

mchain

Build Markov in chains in real-time with Max

By Richard Dudas

http://www.richarddudas.com/software/

Screen Shot 2015-04-13 at 1.03.07 AM

Using the text processing example I built a 4th order Markov chain for “The Cat in The Hat” (by Dr. Seuss). Here is some of the result (it continues to infinity) with indentation added for readability:

The sat the sun is not shine.
It was to Sit! Sit!
And I sat in the house
All that?

How I wish We had something went BUMP! How I wish We did not shine.
It was to us jump! We looked!
The Cat in that cold to go out And wet to play.
So all we sat in the Hat! And he saw him!

Then we sat is wet to Sit! Sit!
And to go out
And the house
All that?

Why do was too wet And there little bit. And wet to go out
And there we saw him step in on that?
How I wish We sat is nothing at all.
So all we could do was too wet day.

So all we sat the house 
All that is fun there we can have Lots of good fun the mat!
We had something at all.
So wet to go out And the sun is wet to Sit! Sit!

And I said too wet to do I know it is not sunny!
Too we can have Lots of good funny!
Too wet And I sat is fun the house. We sat the house. We saw him!
The Cat is wet to us.

The help file patch allows real time Midi improvisation with a step sequencer style of playback:

Screen Shot 2015-04-13 at 1.12.49 AM

 

Algocomp

Short lessons on the topic of algorithmic composition.

By Christopher Dobrian

http://algocomp.blogspot.com

“… A blog of short lessons on the topic of algorithmic composition — the use of formal systems to generate music (and, by extension, other types of time-based art) with computer programs. The examples in these lessons are provided in the form of Max programs.”

From a Cycling 74 forum post: https://cycling74.com/forums/topic/a-blog-on-algorithmic-composition/