In his best-selling 2011 book Thinking, Fast and Slow, Nobel Prize-winning economist Daniel Kahneman hypothesized that thinking could be broken down into two distinct processes aptly named fast and slow thought. The former is all about your gut, the initial automatic responses you have to things, while the later is calculated, reflective and time-consuming. A new algorithm from DeepMind isbeginningto show us that so-called slow thinking may soon be within the reach of machine learning.
In a new paper published in Nature, the Google subsidiary DeepMind explained a newapproach tomachine learningthat uses something calledadifferentiable neural computer. Of course, the new computer isnt a physical piece of hardware, its more of a technique for organizing information and then applyingthat prior knowledge to unique problems.
Neural networksoperate using what essentially amounts to a very sophisticated trial and error process, eventually arriving at an answer. These frameworks are great for some tasks, but haveroom to improve in applying stored connected facts to real-world challenges.
DeepMinds techniquemergesnotions ofmemorywith moretraditional neural networks using a controller. The controller saves information by either storing it in a new location or overwriting a previously occupied location. Throughout this process, an association between the information is formed via the timeline of when new data was written in.
The controlleruses that samechronologyalong with theactual content of what has been saved to retrieve information. The framework created is navigable and proves itself effective for drawing insights from graph data structures.
These graph structures are complex representations of datathatare commonly used to represent things like customer purchasing preferences and GPS navigation information. DeepMind tested itsdifferentiable neural computer on the London Undergroundand was successful at generating routes from the structured data.According to the company, thenext step in development will be trying the new algos on larger data sets.
You can read more about these new tools on DeepMinds sitevia itsblog post on the subject.