Abstract:This paper focuses on the educational journey of a computer engineering undergraduate student venturing into the domain of computer vision and robotics. It explores how optical flow and its applications can be used to detect moving objects when a camera undergoes translational motion, highlighting the challenges encountered and the strategies used to overcome them. Furthermore, the paper discusses not only the technical skills acquired by the student but also interpersonal skills as related to teamwork and diversity. In this paper, we detail the learning process, including the acquisition of technical and problem-solving skills, as well as out-of-the-box thinking.

What problem does this paper attempt to address?

This paper mainly describes the learning experience of an undergraduate student majoring in computer engineering in the field of computer vision and robotics. The student started with almost no knowledge in this field and gradually mastered the technique of using optical flow to detect the movement of external objects in camera translation. Finally, the student published a conference paper on this method. The goal of the paper is to explore how to guide students in learning high-difficulty topics, especially how to overcome difficulties and challenges during the learning process. The student first learned the basic principles of visual approximation and then conducted practical exercises under the guidance of a mentor, especially in optical flow tracking. Through hands-on practice, the student learned to use Python programming, OpenCV library, and handle video data. In team collaboration, the student also improved communication skills and learned how to effectively ask and solve questions. In the application phase, the student faced the challenge of applying theory to practice, that is, designing a method to determine the motion of objects relative to the moving observer. When encountering difficulties, the student learned how to break down tasks, overcome procrastination, and enhance self-learning and adaptability. The combination of hardware and software, such as Hiwonder JetAuto Pro robot and mobile phone sensors, enabled the student to test and validate theories in a real environment. The paper emphasizes that the educational goals are not only to impart technical knowledge, but also to cultivate students' overall abilities, such as problem solving, communication, and self-learning. In addition, it provides educators with better guidance and support methods to help students overcome obstacles in the learning process and unleash their potential. Finally, the paper discusses the transformation from theory to practice, and how to maintain motivation and progress when facing difficulties, which is crucial for students' lifelong learning.

Research Experience of an Undergraduate Student in Computer Vision and Robotics

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

A Computer Vision for Navigation of Mobile Robots

Computer Vision Meets Educational Robotics

Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Camera

An investigation of camera movements and capture techniques on optical flow for real-time rendering and presentation

A Survey of research in Deep Learning for Robotics for Undergraduate research interns

Visual Navigation Using Sparse Optical Flow and Time-to-Transit

Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering

A Survey of Computer Vision Applied in Aerial Robotic Vehicles

Towards Visual Ego-motion Learning in Robots

Robotics via Experiential Active Learning With Immersive Technology: A Pedagogical Framework Designed for Engineering Curricula

Learning Deep Features for Robotic Inference from Physical Interactions.

Automatic robot Manoeuvres detection using computer vision and deep learning techniques: a perspective of internet of robotics things (IoRT)

An Exploration of Embodied Visual Exploration

GRADE: Generating Realistic And Dynamic Environments for Robotics Research with Isaac Sim

Embedded Computer Vision System Applied to a Four-Legged Line Follower Robot

Tracking and Following a Suspended Moving Object using Camera-Based Vision System

Learning Human-to-Robot Handovers from Point Clouds.

Teaching Computer Vision for Ecology