Category: internet-sensors

Posted on

Twitter streaming API in Max

World map and radio simulation

note August 3, 2022 –

This program is broken on Mac OS Monterey. The PHP code is throwing errors in the OSC library.  I’m not certain there is a reasonable workaround at this point and will be looking at replacing the php code with node.js or another more reliable platform. Also, as noted below – php is no longer installed in Mac os – so it requires homebrew or macports

features

  • Twitter streaming v1.1 API and Twitter Apps (using http requests and Oauth in php)
  • lat/lon conversion and map plotting in Max
  • sending data to Max using OSC in php
  • ‘speaking’ tweets using several voices (text to speech)
  • Using geo-coordinates to control an FM synthesizer
  • Converting Tweet text to Morse code
  • Using a data recorder to replay/save data streams (Max lists)

Compare to satellite photo of earth – note the pattern of lights.

download

https://github.com/tkzic/internet-sensors

folder: twitter-stream

files

Max
  • world3.maxpat (main patch)
  • data_recorder_list-tz.maxpat (abstraction for recording data)
  • data-recorder-wrapper.maxpat (abstraction for recording data)
  • worldMap.jpg
  • twitter-morning.txt (sample data – not required)
php
  • ctwitter_max3.php (main program)
  • ctwitter_stream_max3.php (twitter engine)
  • udp.php (Osc client)

3 August, 2022

(note: starting with mac os monterey, php is no longer included in mac os. You can install it with homebrew. See this post: https://www.ergonis.com/products/tips/install-php-on-macos.php

externals

[note]  The project displays Tweets without these externals, but you won’t hear any speech

authorization

In addition to having a Twitter account, you will need to set up a Twitter application from the developer site here:

https://dev.twitter.com/apps

Good instructions on how to do this can be found in this stackoverflow.com post under this heading: So you want to use the Twitter v1.1 API?

http://stackoverflow.com/questions/12916539/simplest-php-example-for-retrieving-user-timeline-with-twitter-api-version-1-1

When you get to step 5 – in the instructions – instead of writing your own code, just use a text editor to copy your access tokens into this php program which is provided:

  • ctwitter_max3.php

Replace the strings in this line of code by copying and pasting the appropriate ones from your Twitter application:

$t->login('consumer_key', 'consumer secret', 'access token', 'access secret');

 

So it will end up looking something like this:

$t->login('ZdzfNaeflihFydfOHeOA', 'eXzUOfhif4riifgRbCTnnSN0T7neYtg8dIWDC7j3bs', '205589709-5kRI1fllJvU94jjffeerSn9LrTajtxSrvO8', 'u5MuSxPseBemUIBWlMxEFaw899feedXA0eHlReCnQ');


Yeah – its cryptic…


instructions


1. open the Max Patch: world3.maxpat




2. in a terminal window run the php program: ctwitter_max3.php. [note] it runs forever. Press <ctrl-c> when you want to stop streaming Tweets.










php ./ctwitter_max3.php






3. Switch back to world3.maxpat to see dots populating the map


4. In Max, press the speaker icon (lower left) to turn on audio.


5. Activate  voice synth/morse code using the blue toggle (lower left)


6. Clear the map by pressing the blue message box: “clear, drawpict a 0 0”


7. Stop the Tweet stream by pressing <ctrl-c> in the terminal window




special voice fx


If you have Soundflower installed, the Mac OS speech synth output can be routed back to Max for audio processing. This is somewhat complicated, but shows how to process audio in Max from other sources.


    

  • In MacOS System Preferences, set audio output device to Soundflower 2ch
    • 

  • Turn up hardware volume control on your computer
    • 

  • In Max, Options | Audio Status, set input device to Soundflower 2ch
    • 

  • In world3.maxpat double click on [p audio engine] (lower left). Then in the audio-engine sub-patch activate the toggle, (lower right) for voice-fx
    • 



data recording


The built-in data recorder/playback is on the left side of world3.maxpat:




    

  • toggle ‘record’ (red toggle)  to start or stop data recording
    • 

  • Note that data will only be recorded when the php program is streaming Tweets in the terminal window (see above)
    • 

  • Press /play message or other transport controls to replay data
    • 





<span style="font-family: 'Helvetica Neue', Helvetica, Helvetica, Arial, sans-serif; font-size: 23px; font-weight: bold; line-height: 1.1;">
</span>


<span style="font-family: 'Helvetica Neue', Helvetica, Helvetica, Arial, sans-serif; font-size: 23px; font-weight: bold; line-height: 1.1;">revision history</span>


<span style="font-family: 'Helvetica Neue', Helvetica, Helvetica, Arial, sans-serif; font-size: 23px; font-weight: bold; line-height: 1.1;">
</span>






revision history


1/19/2021


Updates for Max8 and Catalina:


Replaced [aka.speech] external with Jeremy Bernstein’s [shell] external and the Mac OS command line ‘say’ command.


Reinstalled Java Development Kit for [mxj] object


I revised the php code for the Twitter streaming project, to use the coordinates of a corner of the city polygon bounding box. That seems to be more reliable than the geo coordinates which are absent from most Tweets.


    

  • updated 3/26/2014 – fixed runtime error in php server
    • 

  • updated 2/2/2014 – simplified user interface and updated audio engine
    • 

  • updated 9/2/2013 for Twitter v1.1 API with Oauth – note that older versions of this project are broken due to discontinued Twitter v1.0 API as of June 2013
    • 




	


	





		

		
Posted on 
sending Tweets with curl in Max,
	


	
	

		
Using xively.com and zapier.com




Note: To get this project to work you’ll need a Twitter account. And you’ll need to set up a device (feed) at xively.com and a ‘zap’ at zapier.com as directed in this post. It explains how to send tweets using triggers.


 https://reactivemusic.net/?p=6903


Also, you may notice delays due to the number of steps involved.


Looking for an easier way? Send Tweets using ruby: https://reactivemusic.net/?p=7013


download


https://github.com/tkzic/internet-sensors


folder: twitter-curl


files


Max


    

  • tweetCurl5a.maxpat
    • 



externals


[aka.shell] download from here: http://www.iamas.ac.jp/~aka/max/ – and add the path to the folder to Options | File Preferences in Max


authorization


    

  • xively.com feed id and api-key is embedded in max patch
    • 

  • you need a Twitter account
    • 

  • you need to set up a xively.com feed with twitter trigger, (as described here  https://reactivemusic.net/?p=6903) to get your own feed id, API-key, and authorize access to your Twitter account
    • 



instructions


    

  • Open the Max patch: tweetcurl5a.maxpat
    • 

  • enter your xively feed number and API-key into the fields (then press enter)
    • 

  • Type your Tweet text.
    • 

  • Press the big green button.
    • 





notes on curl


You can use curl for http: requests in Max by formatting the command line with [sprintf] and running it in [aka.shell]. There are a few idiosyncrasies – for example with escape sequences.


In tweetCurl5a.maxpat, the curl command is built in two sections:


    

  1. The request data is written to a data file /tmp/abc.json
    2. 

  2.  the actual curl command is formatted and run from the command line. 
    3. 



Here is the part of the patch which formats request data:






Using ‘quotes’ with [sprintf]


You’ll notice a lot of backslashes used in [sprintf]. This is done to preserve quotes. Normally a quote in [sprintf] indicates a string. Use 3 backslashes to escape a quote:


\\\"


Passing arguments into [sprintf]


The [sprintf] code is obtuse because we are formatting JSON data. The resulting data looks like this:


{ "id":95586, "datastreams":[{ "current_value":"this is a tweet", "id": "tweet"}]}


 


Note that you can pass arguments into [sprintf] using %s – but if you are using a [textedit] to collect data from the user, you’ll need to use [tosymbol] to consolidate the text into a single symbol before passing into [sprintf]


Here’s the code which writes the formatted JSON data to a file:




The next step is to format the curl command, which will read the JSON data file and send an http: request to cosm.com. Here you can see the [sprintf] for this command.




Redirecting aka.shell output to the Max window


At the very end of the [sprintf] you will see


>2&1




This is the linux method to redirect error messages and standard output from [aka.shell] to the same place, which in this case will be the Max window.


command line curl


By the way, here is what the curl command will look like on the command line


curl -v --request PUT --data-binary @/tmp/abc.json --header "X-ApiKey: abcdefg1234567" http://api.cosm.com/v2/feeds/95586.json 2>&1


 


Note: The actual ApiKey above has been replaced with: abcdefg1234567 – so that you don’t accidentally send embarrassing Tweets from my account.





	


	





		

		
Posted on 
Soundcloud API in Max
	


	
	

		


In this patch, Max uses the Soundcloud API to find available tracks for a user and then stream or download one of the tracks.


Features:


    

  • Resolve the user-id for a given Soundcloud user name – in this case “dannyzic”
    • 

  • Process the JSON response to get a track list
    • 

  • Request the first track as either a download or streaming file
    • 

  • Play the track in Max using [jit.qt.movie]
    • 



The Soundcloud API reference provides examples using curl. 


http://developers.soundcloud.com/docs/api/reference


download


https://github.com/tkzic/internet-sensors


folder: soundcloud


files


main Max patch




    

  • soundcloud2.maxpat
    • 



abstractions and other files


    

  • sc-process-user-data.js
    • 

  • sc-process-track-data.js
    • 



authorization






    

  • The Soundcloud client-id is embedded in the Max patch. To get a client ID you will first need a Soundcloud account. Then register an app at: http://soundcloud.com/you/apps
    • 





instructions




    

  • Open the Max patch: soundcloud2
    • 

  • Unlock the patch and enter your client-id in the yellow [message] object in the upper right corner. Lock and save the patch.
    • 

  • Click the green button to resolve the Username: ‘dannyzic’
    • 

  • Click the blue button retrieve ‘tracks’ for this user
    • 

  • Click the yellow button to begin streaming the first available track
    • 

  • Optional: click the red button to download the track.
    • 






	


	





		

		
Posted on 
Speech to text in Max
	


	
	

		


Using the Google speech API


(updated locally 1/21/2024 – changed binary path to sox for homebrew /opt/homebrew/bin/sox in [p call-google-speech]


Also changed some of the UI and logic for manual writing and sending.


(updated 1/21/2021)






This project demonstrates the Google speech-API. It records speech in Max, process it using the Google API, and displays the result in a Max [message] object.


download


https://github.com/tkzic/internet-sensors


folder: google-speech


files


main patch


    

  • speech-to-google-text-api6.maxpat
    • 



abstractions and other files


    

  • JSON-google-speech.js (parses JSON response from Google API)
    • 

  • ms-counter.maxpat (manages audio recording buffer)
    • 



external Max objects



external programs


sox: sox audio conversion program must be in the computer’s executable file path, ie., /usr/bin – or you can rewrite the [sprintf] input to [aka.shell] with the actual path. In our case we installed sox using Macports. The executable path is /opt/local/bin/sox – which is built into a message object in the subpatcher [call-google-speech]


get sox from: http://sox.sourceforge.net


note: this conversion may not be necessary with recent updates to Max and the Google speech API


authorization


    

  • none required – so far
    • 



This may be changing.




Insert here: how to get a speech-api key from Google 


instructions


    

  • Open Max patch: speech-to-google-text-api6
    • 

  • Turn on audio
    • 

  • Press the spacebar. Start talking. Press the spacebar again when you are finished. The translation will begin automatically
    • 



Note: If you have a slow internet connection you may need to tweak the various delay times in  the [call google-speech] sub patch.


send Tweets using speech


Max [send] and [receive] objects pass data from this project to other projects that send Tweets from Max. Just run the patches at the same time.



Also, check out how this project is integrated into the Pandorabots chatbot API project


https://reactivemusic.net/?p=9834


Or anything else. The Google translation is amazingly accurate.




revision history




    

  • 4/24/2016: need to have explicit path to sox, in the call-google-speech subpatch. In my Macports version the path is /usr/local/opt/bin/sox.
    • 

  • 5/11/2014: The newest version requires Max 6.1.7 (for JSON parsing). Also have updated to Google Speech API v2.
    • 

  • update 3/26/2014 to use auto-record features developed for chatbot conversations
    • 








	


	





		

		
Posted on 
Playing bird calls in Max
	


	
	

		
Using the xeno-canto API


Note: 2024/01/21 – patch not working in repository, but has been fixed locally with updates to birdcall4.maxpat.


(updated 1/25/2021)


This Max patch retrieves bird call data from the xeno-canto API, then plays an mp3 file of the bird call using the URL from the query.




If you’d like to modify this patch to play the sounds of other birds, you can get the species names from: http://www.xeno-canto.org


Click to hear the bird call from the patch:

	



download:


https://github.com/tkzic/internet-sensors


folder: bird-calls


files


Max


    

  • bird-call4.maxpat
    • 

  • nothing-detector.maxpat (for tracking progress of html request)
    • 



authorization


    

  • none required
    • 



instructions


    

  • Open the Max patch: bird-call4.maxpat
    • 

  • Select a bird from the menu. Wait a few seconds. If the hit-counter increases above zero then the search was successful.
    • 

  • Click the button to start audio.
    • 

  • Click the button to play a random recording from the query
    • 



notes


There are two html queries. The first query retrieves an array of recording records for a selected bird. The second query downloads the .mp3 file with the actual recording.


The patch uses [dict] and [maxurl] to format execute the first query. Then it uses [jit.uldl] to download the .mp3 file.