News
 

Bookmark and Share

(0) 

Nvidia Corp. has announced that it had collaborated with a research team at Stanford University to create the world's largest artificial neural network built to model how the human brain learns. Computer-based neural networks are capable of "learning" how to model the behavior of the brain – including recognizing objects, characters, voices and audio in the same way that humans do.

GPU-Based Neural Network

Creating large-scale neural networks is extremely computationally expensive. For example, Google used approximately 1000 CPU-based servers, or 16000 CPU cores, to develop its neural network, which taught itself to recognize cats in a series of YouTube videos. The network included 1.7 billion parameters, the virtual representation of connections between neurons. The network created by Nvidia and Stanford is 6.5 times bigger than the previous record-setting network developed by Google in 2012.

In contrast, the Stanford team, led by Andrew Ng, director of the university's artificial intelligence lab, created an equally large network with only three servers using Nvidia GPUs to accelerate the processing of the big data generated by the network. With 16 Nvidia GPU-accelerated servers, the team then created an 11.2 billion-parameter neural network – 6.5 times bigger than a network Google announced in 2012.

The bigger and more powerful the neural network, the more accurate it is likely to be in tasks such as object recognition, enabling computers to model more human-like behavior.

"Delivering significantly higher levels of computational performance than CPUs, GPU accelerators bring large-scale neural network modeling to the masses. Any researcher or company can now use machine learning to solve all kinds of real-life problems with just a few GPU-accelerated servers," said Sumit Gupta, general manager of the Tesla accelerated computing business unit at Nvidia.

GPU Accelerators Power Machine Learning

Machine learning, a fast-growing branch of the artificial intelligence (AI) field, is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, effective web search and a vastly improved understanding of the human genome. Many researchers believe that it is the best way to make progress towards human-level AI.

One of the companies using GPUs in this area is Nuance, a leader in the development of speech recognition and natural language technologies. Nuance trains its neural network models to understand users' speech by using terabytes of audio data. Once the models are trained, they can then recognize the pattern of spoken words by relating them to the patterns that the model learned earlier.

"GPUs significantly accelerate the training of our neural networks on very large amounts of data, allowing us to rapidly explore novel algorithms and training techniques. The resulting models improve accuracy across all of Nuance's core technologies in healthcare, enterprise and mobile-consumer markets," said Vlad Sejnoha, chief technology officer at Nuance.

Tags: Nvidia, Tesla, GPGPU

Discussion

Comments currently: 0

Add your Comment




Related news

Latest News

Monday, April 14, 2014

8:23 am | Microsoft Vows to Release Xbox 360 Emulator for Xbox One. Microsoft Xbox One May Gain Compatibility with Xbox 360 Games

Tuesday, April 1, 2014

10:39 am | Microsoft Reveals Kinect for Windows v2 Hardware. Launch of New Kinect for Windows Approaches

Tuesday, March 25, 2014

1:57 pm | Facebook to Acquire Virtual Reality Pioneer, Oculus VR. Facebook Considers Virtual Reality as Next-Gen Social Platform

1:35 pm | Intel Acquires Maker of Wearable Computing Devices. Basis Science Becomes Fully-Owned Subsidiary of Intel

Monday, March 24, 2014

10:53 pm | Global UHD TV Shipments Total 1.6 Million Units in 2013 – Analysts. China Ahead of the Whole World with 4K TV Adoption

10:40 pm | Crytek to Adopt AMD Mantle Mantle API for CryEngine. Leading Game Developer Adopts AMD Mantle

9:08 pm | Microsoft Unleashes DirectX 12: One API for PCs, Mobile Gadgets and Xbox One. Microsoft Promises Increased Performance, New Features with DirectX 12

3:33 pm | PowerVR Wizard: Imagination Reveals World’s First Ray-Tracing GPU IP for Mobile Devices. Imagination Technologies Brings Ray-Tracing, Hybrid Rendering Modes to Smartphones and Tablets

2:00 pm | Nokia Now Expects to Close Deal with Microsoft in Q2. Sale of Nokia’s Division to Close Next Month