--- title: Computers Are Watching Videos To Learn The World Around Them description: Computers Are Watching Videos To Learn The World Around Them image: https://blog.uat.edu/hubfs/Imported_Blog_Media/Voice_Transcription-01-f2-760x428.jpg --- [![image-26](https://blog.uat.edu/hs-fs/hubfs/Marketing/Logos/image-26.png?width=99&name=image-26.png "image-26")](https://www.uat.edu/) ** - [Home](https://www.uattech.com) - [Majors](http://www.uat.edu/advancing-technology-degrees) - [About UAT](https://www.uat.edu/about-uat) - [Request More Information](https://www.uat.edu/request-info) [![Take a Virtual, Interactive Tour ](https://no-cache.hubspot.com/cta/default/3455363/92ff0e66-7821-430b-88c3-a32c82c5bda2.png)](https://cta-redirect.hubspot.com/cta/redirect/3455363/92ff0e66-7821-430b-88c3-a32c82c5bda2) # What's happening on UAT's campus- A blog published by UAT Students. ALL CATEGORIES - [all Categories](https://blog.uat.edu) - [ Advancing Computer Science ](https://www.uattech.com/tag/advancing-computer-science) - [ Advertising Art ](https://www.uattech.com/tag/advertising-art) - [ Artificial Intelligence ](https://www.uattech.com/tag/artificial-intelligence) - [ Business Technology ](https://www.uattech.com/tag/business-technology) - [ Cyber Security ](https://www.uattech.com/tag/cyber-security) - [ Data Science ](https://www.uattech.com/tag/data-science) - [ Digital Maker and Fabrication ](https://www.uattech.com/tag/digital-maker-and-fabrication) - [ Digital Marketing ](https://www.uattech.com/tag/digital-marketing) - [ Digital Video ](https://www.uattech.com/tag/digital-video) - [ Game Studies ](https://www.uattech.com/tag/game-studies) - [ Human Computer Interaction ](https://www.uattech.com/tag/human-computer-interaction) - [ Robotics and Embedded Systems ](https://www.uattech.com/tag/robotics-and-embedded-sytems) - [ Software Engineering ](https://www.uattech.com/tag/software-engineering) - [ Virtual Reality ](https://www.uattech.com/tag/virtual-reality) - [ Alumni ](https://www.uattech.com/tag/alumni) - [ Behind the Bits Magazine ](https://www.uattech.com/tag/behind-the-bits) - [ Career and Work ](https://www.uattech.com/tag/career-and-work) - [ Competitions ](https://www.uattech.com/tag/competitions) - [ Events ](https://www.uattech.com/tag/events) - [ Geek411 Magazine ](https://www.uattech.com/tag/geek-411) - [ Graduate Studies ](https://www.uattech.com/tag/graduate-studies) - [ Military ](https://www.uattech.com/tag/military) - [ People, Places and Things ](https://www.uattech.com/tag/people-places-and-things) - [ Perimeter83 ](https://www.uattech.com/tag/Perimeter83) - [ Student Innovation Project (SIP) ](https://www.uattech.com/tag/student-innovation-project) - [ Student Work ](https://www.uattech.com/tag/student-work) - [ Technology News ](https://www.uattech.com/tag/technology-news) - [ UAT Life ](https://www.uattech.com/tag/UAT-life) - [ UAT News ](https://www.uattech.com/tag/UAT-news) [Advancing Computer Science](https://blog.uat.edu/tag/advancing-computer-science), [Blogs](https://blog.uat.edu/tag/blogs), [Geeky Stuff](https://blog.uat.edu/tag/geeky-stuff), [vision](https://blog.uat.edu/tag/vision), [Voice](https://blog.uat.edu/tag/voice), [Human Computer Interaction](https://blog.uat.edu/tag/human-computer-interaction), [Artificial Intelligence](https://blog.uat.edu/tag/artificial-intelligence)   |   4 Min Read ## Computers Are Watching Videos To Learn The World Around Them ![Picture of Gage Roland](https://blog.uat.edu/hubfs/Gage-Roland.jpg) [ Written by Gage Roland ](https://blog.uat.edu/author/gage-roland) ![Source: wired.com](https://blog.uat.edu/hs-fs/hubfs/Imported_Blog_Media/Voice_Transcription-01-f2-760x428.jpg?width=760&height=428&name=Voice_Transcription-01-f2-760x428.jpg) Source: wired.com The Massachusetts Institute of Technology, MIT, let their AI computer watch a year's worth of videos from the web in the name of learning about sounds. It is more common now that computers can identify objects, faces, animals, and landmarks – but the sounds in our world are still foreign to them. A group of computer scientists from MIT have built off an existing project "computer vision" to add the capability of listening to what it is seeing. Humans have a natural, simultaneous relationship between sight and sound, so why don't our computers? After processing a year's worth of online videos, "SoundNet" was created. It is able to determine sounds that we commonly can identify like rain, a baby's babble, human noises, and some animals. Using its vision and hearing, the computers would compare what it saw to the noises it was hearing. It learned things like babies tend to babble a lot. After learning with the help of video, the computer can now identify noises without visual queues. ![googlehome-ed](https://blog.uat.edu/hs-fs/hubfs/Imported_Blog_Media/googlehome-ed-760x470.jpg?width=760&height=470&name=googlehome-ed-760x470.jpg) Google Home In a Turing test, SoundNet scored a 92% in identifying noises with a few mistakes like mistaking footsteps for knocking on the door or humans laughing and the sound of hens. It's nothing that cannot be fixed, though - This is only with one year of media. This type of development will greatly improve the area of computer listening. Voice assistants and sound recognition could use a revamp. Siri is a good example of some of the struggles in voice AI – ambient noise, stuttering of words, and inflections in voices. This may give users the natural communication that our devices lack. Home voice AI could be truly interactive when knowing that a dog is barking or a cat is meowing, or more importantly the sound of a window shatter or smoke alarm. If we want natural communication, we need to give our computers the ability to experience their surrounding the same way we do. It will know to ignore the dog's bark when we're trying to tell it something or it will be the next best baby monitor distinguishing between a happy baby and a crying one. > Rutkin, Aviva. 3 Nov 2016. "Binge-watching videos teaches computers to recognize sounds". Daily News. - [** ](https://www.facebook.com/sharer/sharer.php?u=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&title=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&picture=https://cdn2.hubspot.net/hubfs/3455363/Imported_Blog_Media/Voice_Transcription-01-f2-760x428.jpg&description=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](https://twitter.com/intent/tweet?source=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&text=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](http://www.linkedin.com/shareArticle?mini=true&url=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&title=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&summary=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](mailto:?subject=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&body=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them%20https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them) ### Don't forget to share this post! - [** ](https://www.facebook.com/sharer/sharer.php?u=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&title=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&picture=https://cdn2.hubspot.net/hubfs/3455363/Imported_Blog_Media/Voice_Transcription-01-f2-760x428.jpg&description=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](https://twitter.com/intent/tweet?source=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&text=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](http://www.linkedin.com/shareArticle?mini=true&url=https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them&title=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&summary=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them) - [** ](mailto:?subject=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them&body=Computers%20Are%20Watching%20Videos%20To%20Learn%20The%20World%20Around%20Them%20https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them) ### Comment ## Related Articles [Advancing Computer Science](https://blog.uat.edu/tag/advancing-computer-science) [cool courses](https://blog.uat.edu/tag/cool-courses) ### [Telescopes Are Really Just Time Machines](https://blog.uat.edu/telescopes-are-really-just-time-machines) Did you know telescopes are time machines? Not actually, as cool as that would be, but they DO look at the past. The way a telescope works is that light from a celestial object is gathered and ... [![Picture of Bailey Nielsen](https://blog.uat.edu/hubfs/Screen%20Shot%202019-09-16%20at%205.53.08%20PM.png) Bailey Nielsen ](https://blog.uat.edu/author/bailey-nielsen) 4 Min Read [Advancing Computer Science](https://blog.uat.edu/tag/advancing-computer-science) [online college](https://blog.uat.edu/tag/online-college) ### [Seamless Transition from Person to Computer.](https://blog.uat.edu/seamless-transition-from-person-to-computer) We all know about the recent events in the news. From the start of this year, we have encountered many different events. The current event we're dealing with is the pandemic and many students like ... [![Picture of Marcos Xochihua](https://blog.uat.edu/hubfs/thumbnail_Image.jpg) Marcos Xochihua ](https://blog.uat.edu/author/marcos-xochihua) 4 Min Read [Advancing Computer Science](https://blog.uat.edu/tag/advancing-computer-science) [Events](https://blog.uat.edu/tag/events) ### [2020 Astronomy Events You Can See at UAT](https://blog.uat.edu/2020-astronomy-events-you-can-see-at-uat) While Phoenix is not exactly known for its night skies, Arizona is. On a new moon night, the desert lights up with the cosmos around us. There are quite a few cool astronomical events that will occur ... [![Picture of Bailey Nielsen](https://blog.uat.edu/hubfs/Screen%20Shot%202019-09-16%20at%205.53.08%20PM.png) Bailey Nielsen ](https://blog.uat.edu/author/bailey-nielsen) 4 Min Read [![UAT-Logo-new](https://blog.uat.edu/hs-fs/hubfs/Logos,%20Buttons,%20Icons%20(Non%20UAT)/UAT-Logo-new.jpg?width=151&name=UAT-Logo-new.jpg "UAT-Logo-new")](https://www.uat.edu/) UAT Tech is a blog by the University of Advancing Technology - [** ](https://www.instagram.com/uatedu) - [** ](https://twitter.com/uatedu) - [** ](https://www.linkedin.com/company/uatedu) - [** ](https://www.youtube.com/user/UATProductions) Want More? - [Learn More About UAT](https://www.uat.edu/request-info) - [Apply Now](https://uatfastapp.com/) - [Student Life Blog](https://blog.uat.edu/) Contact Us **Email: [ admissions@uat.edu ](mailto:admissions@uat.edu) **Phone: [ +1 800-658-5744 ](tel:+1%20800-658-5744) **Address: 2625 W Baseline Rd, Tempe, AZ 85283 Copyright @ 2026.The University of Advancing Technology. ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Gage Roland", "url" : "https://blog.uat.edu/author/gage-roland" }, "datePublished" : "2016-11-07T20:47:56.000Z", "headline" : "Computers Are Watching Videos To Learn The World Around Them", "image" : [ "https://blog.uat.edu/hubfs/Imported_Blog_Media/Voice_Transcription-01-f2-760x428.jpg" ], "mainEntityOfPage" : { "@id" : "https://blog.uat.edu/blogs/computers-are-watching-videos-to-learn-the-world-around-them", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://blog.uat.edu/hubfs/front%20no%20shadow-2.png" }, "name" : "University of Advancing Technology" } } ```