{"id":2313,"date":"2021-04-14T11:31:02","date_gmt":"2021-04-14T16:31:02","guid":{"rendered":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/?page_id=2313"},"modified":"2021-04-14T12:14:20","modified_gmt":"2021-04-14T17:14:20","slug":"some-ml-tools","status":"publish","type":"page","link":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/daily-notes\/04-14-ml-part-2\/some-ml-tools\/","title":{"rendered":"Some ML Tools"},"content":{"rendered":"<h2>Tools<\/h2>\n<p>An overview of some new creative tools that use ML.<\/p>\n<ul>\n<li><em><strong>Teachable Machine<\/strong><\/em><\/li>\n<li><em><strong>RunwayML<\/strong><\/em><\/li>\n<li><strong><em>EbSynth<\/em><\/strong><\/li>\n<li><strong><em>Photoshop Neural Filters<\/em><\/strong><\/li>\n<\/ul>\n<hr \/>\n<h2>Teachable Machine<\/h2>\n<p>Google\u2019s\u00a0<strong><a href=\"https:\/\/teachablemachine.withgoogle.com\/\">Teachable Machine<\/a><\/strong> tool allows you to train a (neural-network-based) image recognition system, in the browser, without code. Note that its models can also be used with p5.js.<\/p>\n<p><iframe loading=\"lazy\" title=\"Teachable Machine 2.0: Making AI easier for everyone\" src=\"https:\/\/www.youtube.com\/embed\/T2qQGqZxkD0?feature=oembed\" width=\"840\" height=\"473\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" data-mce-fragment=\"1\"><\/iframe><\/p>\n<blockquote class=\"twitter-tweet\">\n<p dir=\"ltr\" lang=\"en\">I recently learned that as a chronic face toucher, I might be more likely to get Coronavirus.?So I made the ANTI-FACE-TOUCHING MACHINE\u2122 to train myself to touch my face less. (sound on) Made with <a href=\"https:\/\/t.co\/KGM4yT8eXP\">https:\/\/t.co\/KGM4yT8eXP<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/CoronaOutbreak?src=hash&amp;ref_src=twsrc%5Etfw\">#CoronaOutbreak<\/a> <a href=\"https:\/\/t.co\/yS8l0Zxqrl\">pic.twitter.com\/yS8l0Zxqrl<\/a><\/p>\n<p>\u2014 Isaac Blankensmith (@Blankensmith) <a href=\"https:\/\/twitter.com\/Blankensmith\/status\/1234603129443962880?ref_src=twsrc%5Etfw\">March 2, 2020<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<p>Live demo! I show a <a href=\"https:\/\/editor.p5js.org\/golan\/sketches\/zFm_Z-2Tw\"><strong>version I got working with p5.js here<\/strong><\/a>. It was easy!<\/p>\n<p>Some of the people contributing to the project include recent CMU architecture alumna Irene Alvarado, and undergrad Design alums, Lucas Ochoa and Gautam Bose. Gautam and and Lucas have made an absurd cereal sorter:<\/p>\n<p><iframe loading=\"lazy\" title=\"Sorting Marshmallows with AI: Using Coral + Teachable Machine\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/ydzJPeeMiMI?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>Here&#8217;s <a href=\"https:\/\/medium.com\/google-design\/teaching-a-bell-to-ring-when-your-pancakes-are-ready-d65db43fffe5\">another project breakdown<\/a> by Gautham and Lucas, on making a system that tells you when your pancakes are ready to flip:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2334\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/1_bYUaKc5xMQAbCe14upgVrQ.gif\" alt=\"\" width=\"960\" height=\"540\" \/><\/p>\n<p>Shiffman has made a Coding Train tutorial:<\/p>\n<p><iframe loading=\"lazy\" title=\"Teachable Machine 1: Image Classification\" src=\"https:\/\/www.youtube.com\/embed\/kwcillcWOg0?feature=oembed\" width=\"840\" height=\"473\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" data-mce-fragment=\"1\"><\/iframe><\/p>\n<p>Need more? Here&#8217;s a <a href=\"https:\/\/medium.com\/@warronbebster\/teachable-machine-tutorial-head-tilt-f4f6116f491\">tutorial<\/a> for a <a href=\"https:\/\/tm-pose-demo.glitch.me\/\">Head Tilting Detector<\/a>.<\/p>\n<hr \/>\n<h2>RunwayML<\/h2>\n<p><strong><a href=\"https:\/\/runwayml.com\/\">RunwayML<\/a><\/strong> is a startup that packages recent ML research into automatable workflows that artists can use with no coding. It has dozens of offerings, including the following:<\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/runway\/MaskRCNN\">RunwayML&#8217;s MaskRCNN<\/a><\/strong> &#8211; Detects objects in an image while simultaneously generating a high-quality segmentation mask:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2315\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/mask-rcnn.jpg\" alt=\"\" width=\"643\" height=\"351\" srcset=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/mask-rcnn.jpg 643w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/mask-rcnn-640x349.jpg 640w\" sizes=\"auto, (max-width: 643px) 85vw, 643px\" \/><\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/runway\/AttnGAN\">RunwayML&#8217;s AttnGAN<\/a><\/strong> &#8211; Turn text descriptions of scenes into synthesized images:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2323\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN.jpg\" alt=\"\" width=\"1280\" height=\"368\" srcset=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN.jpg 1280w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN-640x184.jpg 640w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN-1024x294.jpg 1024w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN-768x221.jpg 768w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/AttnGAN-1200x345.jpg 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/genekogan\/SPADE-Landscapes\">RunwayML&#8217;s SPADE-landscapes<\/a><\/strong> &#8211; Generate realistic images of landscapes from sketches and doodles:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2320\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape.jpg\" alt=\"\" width=\"1280\" height=\"368\" srcset=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape.jpg 1280w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape-640x184.jpg 640w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape-1024x294.jpg 1024w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape-768x221.jpg 768w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/spade-landscape-1200x345.jpg 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/sree_harsha\/BigBiGAN\">RunwayML&#8217;s BigBiGAN<\/a><\/strong> &#8211; Generate similar images based on the input image:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2322\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan.jpg\" alt=\"\" width=\"1600\" height=\"447\" srcset=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan.jpg 1600w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan-640x179.jpg 640w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan-1024x286.jpg 1024w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan-768x215.jpg 768w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan-1536x429.jpg 1536w, http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/bigbigan-1200x335.jpg 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/akhaliq\/Background-Matting\">RunwayML&#8217;s Background Matting<\/a><\/strong> &#8211; Real-Time High-Resolution Background Matting:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2324\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/1bedc984-4522-47ed-8fb4-4b04439ceb09.gif\" alt=\"\" width=\"301\" height=\"188\" \/><\/p>\n<p><strong><a href=\"https:\/\/app.runwayml.com\/models\/anastasis\/HiFill\">RunwayML&#8217;s HiFill<\/a><\/strong> &#8211; High resolution image inpainting with HiFill:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2319\" src=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-content\/uploads\/2021\/04\/HiFill.gif\" alt=\"\" width=\"634\" height=\"634\" \/><\/p>\n<p>Lots of Runway help information <a href=\"https:\/\/learn.runwayml.com\/#\/\">here<\/a>.<\/p>\n<p><iframe loading=\"lazy\" title=\"Green Screen Tutorial\" width=\"840\" height=\"630\" src=\"https:\/\/www.youtube.com\/embed\/-2UBoklCtjk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<hr \/>\n<h2>EbSynth<\/h2>\n<p>Easy style transfer for video. &#8220;Teach&#8221; the system how it should look by painting over one frame, and it carries the texture forward over time.<\/p>\n<p><iframe loading=\"lazy\" title=\"EbSynth | Real Life vs Animation\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/Ki9NVyD3It4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p><iframe loading=\"lazy\" title=\"EbSynth - Tutorial\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/0RLtHuu5jV4?start=217&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<hr \/>\n<h2>Photoshop&#8217;s New (2021) Neural Filters<\/h2>\n<p><iframe loading=\"lazy\" title=\"Photoshop - Neural Filters Test\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/dV1VdvNgcI4?start=405&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tools An overview of some new creative tools that use ML. Teachable Machine RunwayML EbSynth Photoshop Neural Filters Teachable Machine Google\u2019s\u00a0Teachable Machine tool allows you to train a (neural-network-based) image recognition system, in the browser, without code. Note that its models can also be used with p5.js. I recently learned that as a chronic face &hellip; <a href=\"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/daily-notes\/04-14-ml-part-2\/some-ml-tools\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Some ML Tools&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":2225,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2313","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/pages\/2313","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/comments?post=2313"}],"version-history":[{"count":10,"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/pages\/2313\/revisions"}],"predecessor-version":[{"id":2353,"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/pages\/2313\/revisions\/2353"}],"up":[{"embeddable":true,"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/pages\/2225"}],"wp:attachment":[{"href":"http:\/\/www.courses.art.cmu.edu\/2021s\/60210a\/wp-json\/wp\/v2\/media?parent=2313"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}