EP-4xx13 DSP – week 1

The Future

  • Living In the moment, the past, and the future.
  • Benjamin Zander: “Your future self”
  • Evolution of music.

DSP

  • analyze
  • measure
  • transform

examples

Note: some of the projects are in project examples below

  • Adam Rokhsar’s video frame subtraction
  • Little Tikes piano controller
[wpdm_file id=4]
projects

Conversation with robots

https://reactivemusic.net/?p=4710

Twitter Streaming Radio

https://reactivemusic.net/?p=5786

Plink by Dinahmoe

http://labs.dinahmoe.com/plink/#

Infinite Jukebox by Paul Lamere

http://labs.echonest.com/Uploader/index.html

Max/MSP Echonest player

https://reactivemusic.net/?p=6296

The sound of a new machine

https://reactivemusic.net/?p=5945

“Designing Sound” by Andy Farnell.

  • Max examples: Helicopter, TOS transporter,
  • SynthCar, Jet Engine, Granular Timestretch.

Little Tikes Piano controller

https://reactivemusic.net/?p=6993

Mira by Sam Tarakajian

Ableton Live Template Remixer (with dummy clips)

https://reactivemusic.net/?p=2658

Assignment

Go to the future. Make music. Bring it back to the present.

It should be a very short piece or an excerpt. Less than two minutes. It can be a remix of a song that you believe represents a future direction in music. Near future or distant future – your choice. Use any tools to create the music. The result: an audio file (mp3) or a link to audio or video on the Internet – like Soundcloud or Youtube.

Due: before the 9/23 class. Send an email attachment or link.

Adam Rokhsar’s Max frame subtraction example

Uses video frame subtraction in jitter to control playback of audio clip.

download

https://github.com/tkzic/max-projects

folder: frame-subtraction

patch: frameSubtraction_example.maxpat

You will also need an audio file: aiff, wav, etc., to load into a Max buffer.

dependencies

You will also need the cv.jit library (computer vision): http://jmpelletier.com/cvjit/

Add the location of these files to your path in Max using Options | File Preferences.

Note: When I loaded the patch in Mac OS 10.8 – the computer automatically downloaded and installed Java updates.

instructions

  • Load an audio file for playback
  • Try setting minimum summed pixels to 150,000 or less for greater effect – depending on amount of light in the room

Send Tweets with a Little Tikes piano

This project uses the Max fzero~ object to detect which key of the piano gets pressed and send a pre-written Tweet like “Signs point to yellow” based on the color of the key.

It works with the Internet sensors project that sends Tweets from Max using Ruby. https://reactivemusic.net/?p=7013

download

https://github.com/tkzic/internet-sensors

folder: twitter-ruby

instructions

  1. Follow instructions here to send Tweets using Max and Ruby: https://reactivemusic.net/?p=7013
  2. At this point you will have a Max patch open and a Ruby server running in a terminal window.
  3. Now open little-tikes.maxpat
  4. Carefully play individual tones on the Little Tikes piano. 

notes

fzero~ is probably not the best choice for this. It doesn’t work above 2500hz which means it won’t probably distinguish between the lowest and highest key which are an octave apart. In fact the Little-Tikes piano, for a pitched instrument, is difficult to analyze. Due to relatively equal weight of partials to fundamental, and the quick decay. Other choices, would be pitch~ (Jehan) fiddle~ (Pucket…)

I remember seeing an Arduino project where somebody did this in reverse – actually built a motorized striker to play the piano)

… insert link to video here…

 

Hatsune Miku

A vocaloid character

http://en.wikipedia.org/wiki/Hatsune_Miku

(from Wikipedia)

Hatsune Miku (初音ミク?) is a singing synthesizer application with a humanoid persona, developed by Crypton Future Media. It uses Yamaha Corporation‘s Vocaloid 2 and Vocaloid 3 singing synthesizing technology. She was the second Vocaloid sold using the Vocaloid 2 engine, and the first Japanese Vocaloid to use the Japanese version of the Vocaloid 2 engine. Her voice is sampled from Japanese voice actress, Saki Fujita. Hatsune Miku has performed at her concerts onstage as an animated projection.[1] Hatsune Miku is portrayed to be a 16-year-old girl with long teal pigtails.

http://www.youtube.com/watch?v=rL5YKZ9ecpg

An example in Max

by FitanyCereal