{"id":12570,"date":"2014-06-06T03:53:46","date_gmt":"2014-06-06T07:53:46","guid":{"rendered":"http:\/\/zerokidz.com\/ideas\/?p=12570"},"modified":"2014-11-01T01:58:29","modified_gmt":"2014-11-01T05:58:29","slug":"audio-from-video","status":"publish","type":"post","link":"https:\/\/reactivemusic.net\/?p=12570","title":{"rendered":"Audio from Video"},"content":{"rendered":"

Using video to generate audio.<\/p>\n

jit.peek~ outputs an audio signal from video matrix data.<\/p>\n

(jit.peek~ help)<\/p>\n

from cycling74.com<\/cite><\/p>\n

\"\"<\/a><\/p>\n

At any point in the the process, matrix data can be tapped to produce an audio signal. Analyzing video is very much like analyzing audio. For example, using envelope following and spectral analysis. Here are examples.<\/p>\n

examples<\/h4>\n

1. jit.peek~-additivesynth.maxpat (in Max\/MSP examples\/jitter-examples\/audio)<\/p>\n

Draw a song<\/p>\n

By Adam Florin and Joshua Kit Clayton<\/cite><\/p>\n

\"\"<\/a><\/p>\n

2. Frame subtraction<\/p>\n

By\u00a0Adam Rokshar<\/cite><\/p>\n

https:\/\/reactivemusic.net\/?p=7005<\/a><\/p>\n

3. Sound Emotion2 – using Macbook built-in camera<\/p>\n

By\u00a0Andreas Wittich<\/span><\/cite><\/p>\n

https:\/\/reactivemusic.net\/?p=9225<\/a><\/p>\n

4. jit.peek~-osctrack.maxpat\u00a0(in Max\/MSP examples\/jitter-examples\/audio)<\/p>\n

Derives rhythmic audio data from video. (Using bball.mov)<\/p>\n

By cycling74.com<\/cite><\/p>\n

\"\"<\/a><\/p>\n

5. Whispering Heights\u00a0(in Max\/MSP examples\/jitter-examples\/3rd-party\/image-to-spectral-filter\/whispering_heights.maxpat)<\/p>\n

Similar to above but uses video to create a moving spectral filter.<\/p>\n

\"\"<\/a><\/p>\n

6. Wolframatic.maxpat \u00a0(in Max\/MSP examples\/jitter-examples\/other\/Wolframatic\/)<\/p>\n

Fractal generator also generates audio.<\/p>\n

By R. Luke Duboi<\/cite>s<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

Using video to generate audio. jit.peek~ outputs an audio signal from video matrix data. (jit.peek~ help) from cycling74.com At any point in the the process, matrix data can be tapped to produce an audio signal. Analyzing video is very much like analyzing audio. For example, using envelope following and spectral analysis. Here are examples. examples … <\/p>\n

Continue reading “Audio from Video”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","footnotes":""},"categories":[21,143,28],"tags":[58,51],"class_list":["post-12570","post","type-post","status-publish","format-standard","hentry","category-dsp","category-interactive-media-art","category-maxmsp","tag-audio","tag-jitter"],"yoast_head":"\nAudio from Video - reactive music<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/reactivemusic.net\/?p=12570\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Audio from Video - reactive music\" \/>\n<meta property=\"og:description\" content=\"Using video to generate audio. jit.peek~ outputs an audio signal from video matrix data. (jit.peek~ help) from cycling74.com At any point in the the process, matrix data can be tapped to produce an audio signal. Analyzing video is very much like analyzing audio. For example, using envelope following and spectral analysis. Here are examples. examples … Continue reading "Audio from Video"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/reactivemusic.net\/?p=12570\" \/>\n<meta property=\"og:site_name\" content=\"reactive music\" \/>\n<meta property=\"article:published_time\" content=\"2014-06-06T07:53:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-11-01T05:58:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png\" \/>\n<meta name=\"author\" content=\"Tom Zicarelli\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tom Zicarelli\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570\"},\"author\":{\"name\":\"Tom Zicarelli\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\"},\"headline\":\"Audio from Video\",\"datePublished\":\"2014-06-06T07:53:46+00:00\",\"dateModified\":\"2014-11-01T05:58:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570\"},\"wordCount\":169,\"image\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/reactivemusic.net\\\/wp-content\\\/uploads\\\/2014\\\/06\\\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png\",\"keywords\":[\"audio\",\"jitter\"],\"articleSection\":[\"DSP\",\"interactive media art\",\"Max\\\/MSP\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570\",\"url\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570\",\"name\":\"Audio from Video - reactive music\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/reactivemusic.net\\\/wp-content\\\/uploads\\\/2014\\\/06\\\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png\",\"datePublished\":\"2014-06-06T07:53:46+00:00\",\"dateModified\":\"2014-11-01T05:58:29+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/reactivemusic.net\\\/?p=12570\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#primaryimage\",\"url\":\"https:\\\/\\\/reactivemusic.net\\\/wp-content\\\/uploads\\\/2014\\\/06\\\/Screen-Shot-2014-06-07-at-1.36.00-PM.png\",\"contentUrl\":\"https:\\\/\\\/reactivemusic.net\\\/wp-content\\\/uploads\\\/2014\\\/06\\\/Screen-Shot-2014-06-07-at-1.36.00-PM.png\",\"width\":\"1404\",\"height\":\"1054\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=12570#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/reactivemusic.net\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Audio from Video\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#website\",\"url\":\"https:\\\/\\\/reactivemusic.net\\\/\",\"name\":\"reactive music\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/reactivemusic.net\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\",\"name\":\"Tom Zicarelli\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"caption\":\"Tom Zicarelli\"},\"sameAs\":[\"http:\\\/\\\/tomzicarelli.com\"],\"url\":\"https:\\\/\\\/reactivemusic.net\\\/?author=2\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Audio from Video - reactive music","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/reactivemusic.net\/?p=12570","og_locale":"en_US","og_type":"article","og_title":"Audio from Video - reactive music","og_description":"Using video to generate audio. jit.peek~ outputs an audio signal from video matrix data. (jit.peek~ help) from cycling74.com At any point in the the process, matrix data can be tapped to produce an audio signal. Analyzing video is very much like analyzing audio. For example, using envelope following and spectral analysis. Here are examples. examples … Continue reading \"Audio from Video\"","og_url":"https:\/\/reactivemusic.net\/?p=12570","og_site_name":"reactive music","article_published_time":"2014-06-06T07:53:46+00:00","article_modified_time":"2014-11-01T05:58:29+00:00","og_image":[{"url":"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png","type":"","width":"","height":""}],"author":"Tom Zicarelli","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tom Zicarelli","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/reactivemusic.net\/?p=12570#article","isPartOf":{"@id":"https:\/\/reactivemusic.net\/?p=12570"},"author":{"name":"Tom Zicarelli","@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571"},"headline":"Audio from Video","datePublished":"2014-06-06T07:53:46+00:00","dateModified":"2014-11-01T05:58:29+00:00","mainEntityOfPage":{"@id":"https:\/\/reactivemusic.net\/?p=12570"},"wordCount":169,"image":{"@id":"https:\/\/reactivemusic.net\/?p=12570#primaryimage"},"thumbnailUrl":"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png","keywords":["audio","jitter"],"articleSection":["DSP","interactive media art","Max\/MSP"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/reactivemusic.net\/?p=12570","url":"https:\/\/reactivemusic.net\/?p=12570","name":"Audio from Video - reactive music","isPartOf":{"@id":"https:\/\/reactivemusic.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/reactivemusic.net\/?p=12570#primaryimage"},"image":{"@id":"https:\/\/reactivemusic.net\/?p=12570#primaryimage"},"thumbnailUrl":"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM-300x225.png","datePublished":"2014-06-06T07:53:46+00:00","dateModified":"2014-11-01T05:58:29+00:00","author":{"@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571"},"breadcrumb":{"@id":"https:\/\/reactivemusic.net\/?p=12570#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/reactivemusic.net\/?p=12570"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/reactivemusic.net\/?p=12570#primaryimage","url":"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM.png","contentUrl":"https:\/\/reactivemusic.net\/wp-content\/uploads\/2014\/06\/Screen-Shot-2014-06-07-at-1.36.00-PM.png","width":"1404","height":"1054"},{"@type":"BreadcrumbList","@id":"https:\/\/reactivemusic.net\/?p=12570#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/reactivemusic.net\/"},{"@type":"ListItem","position":2,"name":"Audio from Video"}]},{"@type":"WebSite","@id":"https:\/\/reactivemusic.net\/#website","url":"https:\/\/reactivemusic.net\/","name":"reactive music","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/reactivemusic.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571","name":"Tom Zicarelli","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","caption":"Tom Zicarelli"},"sameAs":["http:\/\/tomzicarelli.com"],"url":"https:\/\/reactivemusic.net\/?author=2"}]}},"_links":{"self":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/12570","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12570"}],"version-history":[{"count":20,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/12570\/revisions"}],"predecessor-version":[{"id":17423,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/12570\/revisions\/17423"}],"wp:attachment":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12570"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12570"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12570"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}