Brings Deep Learning to Self-Driving Cars Brings Deep Learning to Self-Driving Cars

Illustration: iStockphoto is the 13th company to be granted a license to test autonomous vehicles on public roads in California. This is exciting news, especially because we had no idea that even existed until just last week. The company has been in stealth mode for the past year, working on applying deep learning techniques to self-driving cars. We spoke with two of’s co-founders, Sameep Tandon and Carol Reiley, about why their approach to self-driving cars is going to bring us vehicle autonomy that’s more efficient, more adaptable, more reliable, and safer than ever. came straight out of Stanford’s AI Lab about a year ago. Its core team is made up of experts with a wealth of experience developing deep learning systems in all kinds of different domains, including natural language processing, computer vision, and (most recently) autonomous driving. “This team helped pioneer how to scale deep learning, which is one of the reasons why deep learning has been successful as of late,” says Tandon, the company’s CEO.

After working for several years on the problem at Stanford, these researchers felt that a startup would be the best way to commercialize their ideas and technology and turn them into a product. So they decided to put their PhDs on hold and started

“ is a deep learning company,” Reiley says. “We’re solving the problem of a self driving car by using deep learning for the full autonomous integrated driving stack—from perception, to motion planning, to controls—as opposed to just bits and pieces like other companies have been using for autonomy. We’re using an integrated architecture to create a more seamless approach.”

What is deep learning? And why should we care that it’s being applied to autonomous driving? Says Tandon:

When you’re developing a self-driving car, the hard part is handling the edge cases. These include weather conditions like rain or snow, for example. Right now, people program in specific rules to get this to work. The deep learning approach instead learns what to do by fundamentally understanding the data.

“Generally, before deep learning, doing machine learning was all about feature selection,” Reiley adds. “It was a very crude way of doing it, and it was difficult and time consuming to get these algorithms to recognize anything.” Deep learning, she says, is much more analogous to the way humans learn. “You show an algorithm good and bad examples, and it learns to generalize. For a dynamic environment that is extremely complex, we believe this is best way to solve the problem.”

The first step for is to get a vehicle out on the road and start collecting data that can be used to build up the experience of their algorithms. “It’s not about the number of hours or miles of data collected,” says Tandon. “It comes down to having the right type of experiences and data augmentation to train the system—which means having a team that knows what to go after to make the system work in a car. This move, from simulation environments and closed courses onto public roads, is a big step for our company and we take that responsibility very seriously.”

As far as what the actual vehicle is going to look like, isn’t quite ready to comment. (But if you see it cruising around Mountain View at some point, send us a pic!)

Software is certainly going to be the engineers’ focus (as it’s arguably the most difficult and important part of any autonomous driving system). But Tandon and Reiley did tell us that, in their opinion, a lot of the sensing hardware that’s available today is underutilized. “If you’re driving a car with the radio on, the only input sensors that you’re relying on to control your car are your two forward-facing eyes,” Reiley notes.  “It’s kind of scary that we trust ourselves today to drive around like that, controlling the car based only on that information.”

We should also mention that has recently closed US $12 million in Series A funding, and that the team is looking to hire a bunch of people. While isn’t quite ready to talk about what their end goal is, we’re quite curious to see some tangible examples of deep learning’s benefits to autonomous cars over other approaches.


[IEEE Spectrum]

April 27, 2016 / by / in , , , , , , , , , , ,

Leave a Reply

Show Buttons
Hide Buttons

IMPORTANT MESSAGE: is a website owned and operated by Scooblr, Inc. By accessing this website and any pages thereof, you agree to be bound by the Terms of Use and Privacy Policy, as amended from time to time. Scooblr, Inc. does not verify or assure that information provided by any company offering services is accurate or complete or that the valuation is appropriate. Neither Scooblr nor any of its directors, officers, employees, representatives, affiliates or agents shall have any liability whatsoever arising, for any error or incompleteness of fact or opinion in, or lack of care in the preparation or publication, of the materials posted on this website. Scooblr does not give advice, provide analysis or recommendations regarding any offering, service posted on the website. The information on this website does not constitute an offer of, or the solicitation of an offer to buy or subscribe for, any services to any person in any jurisdiction to whom or in which such offer or solicitation is unlawful.