This post was archived from a Google Plus post found here
Apple’s director of artificial intelligence, Ruslan Salakhutdinov, says deep learning with the addition of new techniques for memory, attention, and general knowledge, will become far more powerful. “Image captioning systems based on the technology can label images incorrectly because they tend to focus on everything in the image. He then pointed to a solution in the form of so-called ‘attention mechanisms,’ a tweak to deep learning that has been developed in the last few years. The approach can remedy these errors by having a system focus on specific parts of an image when applying different words in a caption.”
“A technique called memory networks, developed by researchers at Facebook, can improve how machines talk with people. As the name suggests, the approach adds a component of long-term memory to neural networks so that they remember the history of a chat.”