{"id":9790,"date":"2014-02-04T17:27:06","date_gmt":"2014-02-04T17:27:06","guid":{"rendered":"http:\/\/zerokidz.com\/ideas\/?p=9790"},"modified":"2014-06-25T00:07:36","modified_gmt":"2014-06-25T04:07:36","slug":"notes-chatbots-in-conversation","status":"publish","type":"post","link":"https:\/\/reactivemusic.net\/?p=9790","title":{"rendered":"Notes: Chatbots in Conversation"},"content":{"rendered":"<p>update 6\/2014 &#8211; Now part of the Internet sensors projects:\u00a0<a href=\"https:\/\/reactivemusic.net\/?p=5859\">https:\/\/reactivemusic.net\/?p=5859<\/a><\/p>\n<div class=\"panel\">\n<p>original post<\/p>\n<\/div>\n<p class=\"lead\">They can talk with each other\u2026 sort of.<\/p>\n<p>Last spring I made a project that lets you talk with chatbots using speech recognition and synthesis.\u00a0<a href=\"https:\/\/reactivemusic.net\/?p=4710\">https:\/\/reactivemusic.net\/?p=4710<\/a>.<\/p>\n<p>Yesterday I managed to get two instances of this program, running on two computers, using two chatbots, \u00a0to talk with each other, through the air. Technical issues remain (see below). But there were moments of real interaction.<\/p>\n<p>In the original project, a human pressed button in Max to start and stop recording speech. This has been automated. The program detects and records speech, using audio level sensing. The auto-recording sensor turns on a switch when the level hits a threshold, and turns off after a period of silence. Threshold level and duration of silence can be adjusted by the user. \u00a0There is also a feedback gate that shuts off auto-record while the computer is converting speech to text, and &#8216;speaking&#8217; a reply.<\/p>\n<h3>technical issues<\/h3>\n<ul>\n<li>The Google speech API has difficulty with some of the <strong>voices<\/strong> used by the Mac OS speech synthesizer. We&#8217;ll need to experiment to find which voices produce accurate results.<\/li>\n<li>The overall <strong>levels<\/strong> produced by the builtin Macbook speakers is not quite enough to achieve clear communication. The auto-recorder missed the <strong>onset<\/strong> of speech sometimes. One solution would be to insert a click to trigger the recorder, just before the speech synthesizer begins the actual speech. Or to use external speakers, or a secondary &#8220;wired&#8221; connection.<\/li>\n<li>It would be nice to have <strong>menus of chatbots\u00a0and voices<\/strong>. Also to automate the start of a new conversation <strong>thread<\/strong>.<\/li>\n<li>The button to start the audio detector had to be operated by key-press because pushing the <strong>trackpad<\/strong> on a MacBook makes too much noise and always triggers the audio level detector.<\/li>\n<li><span style=\"line-height: 1.6;\">Occasionally a chat bot would\u00a0<\/span>deliver<span style=\"line-height: 1.6;\">\u00a0a <strong>long response<\/strong>, or one containing a <strong>web address<\/strong>. These were problematic for recognition and synthesis.<\/span><\/li>\n<\/ul>\n<h4><span style=\"line-height: 22px;\">local files<\/span><\/h4>\n<ul>\n<li><span style=\"line-height: 1.6;\">tkzic\/internetsensors\/speech-to-google-text-api3.maxpat<\/span><\/li>\n<li><span style=\"line-height: 1.6;\">tkzic\/internetsensors\/pandorabots-api2.maxpat<\/span><\/li>\n<li><span style=\"line-height: 1.6;\">tkzic\/internetsensors\/text-to-speech3.maxpat<\/span><\/li>\n<\/ul>\n<div><span style=\"line-height: 22px;\"><br \/>\n<\/span><\/div>\n<p>&nbsp;<\/p>\n<div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>update 6\/2014 &#8211; Now part of the Internet sensors projects:\u00a0https:\/\/reactivemusic.net\/?p=5859 original post They can talk with each other\u2026 sort of. Last spring I made a project that lets you talk with chatbots using speech recognition and synthesis.\u00a0https:\/\/reactivemusic.net\/?p=4710. Yesterday I managed to get two instances of this program, running on two computers, using two chatbots, \u00a0to &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/reactivemusic.net\/?p=9790\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Notes: Chatbots in Conversation&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","footnotes":""},"categories":[142,143,28],"tags":[161,345,296,190,26,138,137],"class_list":["post-9790","post","type-post","status-publish","format-standard","hentry","category-ideas","category-interactive-media-art","category-maxmsp","tag-api","tag-maxmsp","tag-notebook","tag-portfolio","tag-sensors","tag-speech-to-text","tag-text-to-speech"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Notes: Chatbots in Conversation - reactive music<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/reactivemusic.net\/?p=9790\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Notes: Chatbots in Conversation - reactive music\" \/>\n<meta property=\"og:description\" content=\"update 6\/2014 &#8211; Now part of the Internet sensors projects:\u00a0https:\/\/reactivemusic.net\/?p=5859 original post They can talk with each other\u2026 sort of. Last spring I made a project that lets you talk with chatbots using speech recognition and synthesis.\u00a0https:\/\/reactivemusic.net\/?p=4710. Yesterday I managed to get two instances of this program, running on two computers, using two chatbots, \u00a0to &hellip; Continue reading &quot;Notes: Chatbots in Conversation&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/reactivemusic.net\/?p=9790\" \/>\n<meta property=\"og:site_name\" content=\"reactive music\" \/>\n<meta property=\"article:published_time\" content=\"2014-02-04T17:27:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-06-25T04:07:36+00:00\" \/>\n<meta name=\"author\" content=\"Tom Zicarelli\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tom Zicarelli\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790\"},\"author\":{\"name\":\"Tom Zicarelli\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\"},\"headline\":\"Notes: Chatbots in Conversation\",\"datePublished\":\"2014-02-04T17:27:06+00:00\",\"dateModified\":\"2014-06-25T04:07:36+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790\"},\"wordCount\":347,\"keywords\":[\"API\",\"Max\\\/MSP\",\"notebook\",\"portfolio\",\"sensors\",\"speech to text\",\"text to speech\"],\"articleSection\":[\"ideas\",\"interactive media art\",\"Max\\\/MSP\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790\",\"url\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790\",\"name\":\"Notes: Chatbots in Conversation - reactive music\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#website\"},\"datePublished\":\"2014-02-04T17:27:06+00:00\",\"dateModified\":\"2014-06-25T04:07:36+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/reactivemusic.net\\\/?p=9790\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/?p=9790#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/reactivemusic.net\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Notes: Chatbots in Conversation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#website\",\"url\":\"https:\\\/\\\/reactivemusic.net\\\/\",\"name\":\"reactive music\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/reactivemusic.net\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/reactivemusic.net\\\/#\\\/schema\\\/person\\\/56224d281582df7e5518e037ca63e571\",\"name\":\"Tom Zicarelli\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g\",\"caption\":\"Tom Zicarelli\"},\"sameAs\":[\"http:\\\/\\\/tomzicarelli.com\"],\"url\":\"https:\\\/\\\/reactivemusic.net\\\/?author=2\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Notes: Chatbots in Conversation - reactive music","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/reactivemusic.net\/?p=9790","og_locale":"en_US","og_type":"article","og_title":"Notes: Chatbots in Conversation - reactive music","og_description":"update 6\/2014 &#8211; Now part of the Internet sensors projects:\u00a0https:\/\/reactivemusic.net\/?p=5859 original post They can talk with each other\u2026 sort of. Last spring I made a project that lets you talk with chatbots using speech recognition and synthesis.\u00a0https:\/\/reactivemusic.net\/?p=4710. Yesterday I managed to get two instances of this program, running on two computers, using two chatbots, \u00a0to &hellip; Continue reading \"Notes: Chatbots in Conversation\"","og_url":"https:\/\/reactivemusic.net\/?p=9790","og_site_name":"reactive music","article_published_time":"2014-02-04T17:27:06+00:00","article_modified_time":"2014-06-25T04:07:36+00:00","author":"Tom Zicarelli","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tom Zicarelli","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/reactivemusic.net\/?p=9790#article","isPartOf":{"@id":"https:\/\/reactivemusic.net\/?p=9790"},"author":{"name":"Tom Zicarelli","@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571"},"headline":"Notes: Chatbots in Conversation","datePublished":"2014-02-04T17:27:06+00:00","dateModified":"2014-06-25T04:07:36+00:00","mainEntityOfPage":{"@id":"https:\/\/reactivemusic.net\/?p=9790"},"wordCount":347,"keywords":["API","Max\/MSP","notebook","portfolio","sensors","speech to text","text to speech"],"articleSection":["ideas","interactive media art","Max\/MSP"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/reactivemusic.net\/?p=9790","url":"https:\/\/reactivemusic.net\/?p=9790","name":"Notes: Chatbots in Conversation - reactive music","isPartOf":{"@id":"https:\/\/reactivemusic.net\/#website"},"datePublished":"2014-02-04T17:27:06+00:00","dateModified":"2014-06-25T04:07:36+00:00","author":{"@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571"},"breadcrumb":{"@id":"https:\/\/reactivemusic.net\/?p=9790#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/reactivemusic.net\/?p=9790"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/reactivemusic.net\/?p=9790#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/reactivemusic.net\/"},{"@type":"ListItem","position":2,"name":"Notes: Chatbots in Conversation"}]},{"@type":"WebSite","@id":"https:\/\/reactivemusic.net\/#website","url":"https:\/\/reactivemusic.net\/","name":"reactive music","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/reactivemusic.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/reactivemusic.net\/#\/schema\/person\/56224d281582df7e5518e037ca63e571","name":"Tom Zicarelli","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0da58cf21a2707dd335b204b8ed3cd9194dcbf9d9814ac5d71195a65c76c8a72?s=96&d=mm&r=g","caption":"Tom Zicarelli"},"sameAs":["http:\/\/tomzicarelli.com"],"url":"https:\/\/reactivemusic.net\/?author=2"}]}},"_links":{"self":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/9790","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9790"}],"version-history":[{"count":11,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/9790\/revisions"}],"predecessor-version":[{"id":14026,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=\/wp\/v2\/posts\/9790\/revisions\/14026"}],"wp:attachment":[{"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9790"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9790"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/reactivemusic.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9790"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}