It’s also good to note that it may help if after you run the uninstaller and/or manually delete the file that you do a secure trash empty with can be done from the desktop if you click Finder at the top there should be an “Empty Trash” and a “Secure Empty Trash” BE WARNED THOUGH this will permanently delete the files in your trash bin!
Pair a Wiimote with Osculator (by pressing the red button)
Set Wiimote Osc output port to 9000
Other helpful tips:
Use a real Wii remote, not the Nyko. If you do get the Nyko, get the one with motion-plus.
update Osculator to the latest version
Under parameters (in osculator) press + to add the little pacman symbol labeled “same address”, and set the the OSC URL to whatever you’ll be using like 9000 for Max
remember to add the Event type (OSC routing) and value (pacman thing) for every wiimote event you’ll be using
remember to enter checkbox on the wiimote window for every type of data you want to send
Wiimote read patch
The patch: wiimote_read.maxpat is a common patch for reading data from Osculator into Max.
Load this patch and keep it running in the background for all of the other patches. You will know if the wiimote is working, if the data in the number boxes responds to movement of the Wiimote.
vizzie rotation effect
Rotates the video input from built in camera.
infra-red (IR) musical light painting
Paint using an IR transmitter.
Make sure wii is transmitting raw IR data in Osculator
Turn on audio and turn up volume
Turn on [qmetro] for jitter
IR xy synth
A synthesizer that responds to IR xy data
turn on audio
turn up volume
make an audible adsr envelope by turning up the adsr dials
increase lfo rate
check the wii-mode updreceive port (should match Osculator output)
experiment with the ‘gate’ toggle in the middle of the patch
Pitch, roll, yaw (PRY) synth
A synth that responds to pitch, roll, and yaw data
bicycle engine simulation
synthesizes engine sounds based on RPM of bicycle wheel with Wiimote in the spokes
5/2014 : under construction – note – this patch not compatible with wiimote_read
need to be running Osculator and tracking PRY stuff from Wii – need to adjust scale in engine patch. Also, select 3rd preset for engine sound.
So basically this setup needs to get standardized – use metro to send a steady stream of wheel data. Use the up to date car engine patch, etc., etc.,
A few problems with this concept – for example when the wheel is stopped the signal rate revs up to over 300 – I think because it rotates backwards for a second. Also when the wheel gets really fast, the pulses just stop! – its like the wii-mote is overloaded or something? 4/3/2013 – I have it running so it tracks speed when the bicycle is upside down, as long as you don’t crank it too fast. but as mentioned above – the patch could be cleaned up and simplified.
Yesterday I managed to get two instances of this program, running on two computers, using two chatbots, to talk with each other, through the air. Technical issues remain (see below). But there were moments of real interaction.
In the original project, a human pressed button in Max to start and stop recording speech. This has been automated. The program detects and records speech, using audio level sensing. The auto-recording sensor turns on a switch when the level hits a threshold, and turns off after a period of silence. Threshold level and duration of silence can be adjusted by the user. There is also a feedback gate that shuts off auto-record while the computer is converting speech to text, and ‘speaking’ a reply.
The Google speech API has difficulty with some of the voices used by the Mac OS speech synthesizer. We’ll need to experiment to find which voices produce accurate results.
The overall levels produced by the builtin Macbook speakers is not quite enough to achieve clear communication. The auto-recorder missed the onset of speech sometimes. One solution would be to insert a click to trigger the recorder, just before the speech synthesizer begins the actual speech. Or to use external speakers, or a secondary “wired” connection.
It would be nice to have menus of chatbots and voices. Also to automate the start of a new conversation thread.
The button to start the audio detector had to be operated by key-press because pushing the trackpad on a MacBook makes too much noise and always triggers the audio level detector.
Occasionally a chat bot would deliver a long response, or one containing a web address. These were problematic for recognition and synthesis.
Actually in this context, the word ‘piano’ is way too generous. This is a prototype from October, that uses screen mapping to separate left and right hands. It decodes gestures by looking for high velocity downward hand movements. The gestures are mapped to notes and chords based on X position. There is much de-bouncing and tweaking to get results.
Here’s a demonstration which is somewhat painful to listen to, but gets the point across.