Abstract:Equipped with a wide span of sensors, predominant autonomous driving solutions are becoming more modular-oriented for safe system design. Though these sensors have laid a solid foundation, most massive-production solutions up to date still fall into L2 phase. Among these, <a class="link-external link-http" href="http://Comma.ai" rel="external noopener nofollow">this http URL</a> comes to our sight, claiming one $999 aftermarket device mounted with a single camera and board inside owns the ability to handle L2 scenarios. Together with open-sourced software of the entire system released by <a class="link-external link-http" href="http://Comma.ai" rel="external noopener nofollow">this http URL</a>, the project is named Openpilot. Is it possible? If so, how is it made possible? With curiosity in mind, we deep-dive into Openpilot and conclude that its key to success is the end-to-end system design instead of a conventional modular framework. The model is briefed as Supercombo, and it can predict the ego vehicle's future trajectory and other road semantics on the fly from monocular input. Unfortunately, the training process and massive amount of data to make all these work are not publicly available. To achieve an intensive investigation, we try to reimplement the training details and test the pipeline on public benchmarks. The refactored network proposed in this work is referred to as OP-Deepdive. For a fair comparison of our version to the original Supercombo, we introduce a dual-model deployment scheme to test the driving performance in the real world. Experimental results on nuScenes, Comma2k19, CARLA, and in-house realistic scenarios verify that a low-cost device can indeed achieve most L2 functionalities and be on par with the original Supercombo model. In this report, we would like to share our latest findings, shed some light on the new perspective of end-to-end autonomous driving from an industrial product-level side, and potentially inspire the community to continue improving the performance. Our code, benchmarks are at <a class="link-external link-https" href="https://github.com/OpenPerceptionX/Openpilot-Deepdive" rel="external noopener nofollow">this https URL</a>.

Building a "Hello World" for self-driving labs: The Closed-loop Spectroscopy Lab Light-mixing demo

Exploring Benchmarks for Self-Driving Labs using Color Matching

An Arduino-Based Experimental Setup for Teaching Light Color Mixing, Light Intensity Detection, and Ambient Temperature Sensing

Multipurpose DIY Spectrophotometer for Teaching Analytical Chemistry

A Do-it-yourself Spectrograph Kit for Educational Outreach in Optics and Photonics

A simple state-of-the-art spectrometer for student labs: Cost-efficient, instructive, and widely applicable

Open-source remote laboratory experiments for controls engineering education

A low-cost IoT multi-spectral acquisition device

Demonstration of a Robot Controlling and Positioning System Based on Visible Light.

A Gamified Simulator and Physical Platform for Self-Driving Algorithm Training and Validation

Using Old Laboratory Equipment with Modern Web-of-Things Standards: a Smart Laboratory with LabThings Retro

Semi-supervised Learning From Demonstration Through Program Synthesis: An Inspection Robot Case Study

Multifunction fluorescence open source in vivo/in vitro imaging system (openIVIS)

Lessons from a Space Lab -- An Image Acquisition Perspective

Inexpensive LED-based spectrophotometer for analyzing optical coatings

Engineering End-to-End Remote Labs using IoT-based Retrofitting

A Multimodal, Full-Surround Vehicular Testbed for Naturalistic Studies and Benchmarking: Design, Calibration and Deployment

Low cost and open source multi-fluorescence imaging system for teaching and research in biology and bioengineering

A portable Raspberry Pi-based spectrometer for on-site spectral testing

WinterLab: Developing a low-cost, portable experiment platform to encourage engagement in the electronics lab

Level 2 Autonomous Driving on a Single Device: Diving into the Devils of Openpilot