Autonomous cars are going to rule the roads. Why don't we try building a prototype of it.
Autonomous cars are expected to drive from a point to another all by itself. The conventional technologies for self-driving cards are designed to detect roads/lanes and obstacles on it. They use many sensors viz - camera, GPS, IMS etc. From the lane information, another sub module has to calculate the best steering angle and it has to plan its path ahead. Trust me, it is a pretty complicated design.
Researchers in Nvidia developed an end-to-end deep learning system for self-driving cars. Their system reads camera images and outputs steering angle, there by they call it an end-to-end system. They designed a deep CNN network to understand the relation betwen camera images and steering angle.
Since this system takes steering angle decisions by detecting roads and lanes, I would like to call it 'AutoLaneAssist' than 'AutoPilot'. An AutoPilot is supposed to do advanced cruise controll along with lane assist
The system architecture is shown below. Inputs from the camera is processed in the end-to-end system and output steer angles are outputted to the vehicle CANs.
| How it works? |
|---|
 |
See the Nvidia self driving car in action:
| Watch the video |
|---|
 |
The training setup is as follow.
| The system |
|---|
 |
| The layer architecutre of the network |
|---|
 |