Deep Robot Sketching: An application of Deep Q-Learning Networks for human-like sketching

Raul Fernandez-Fernandez,Juan G. Victores,Carlos Balaguer

DOI: https://doi.org/10.1016/j.cogsys.2023.05.004

2024-02-01

Abstract:The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science community as rich, natural, multi-sensory, multi-cultural environments. In this work, we propose the introduction of Reinforcement Learning for improving the control of artistic robot applications. Deep Q-learning Neural Networks (DQN) is one of the most successful algorithms for the implementation of Reinforcement Learning in robotics. DQN methods generate complex control policies for the execution of complex robot applications in a wide set of environments. Current art painting robot applications use simple control laws that limits the adaptability of the frameworks to a set of simple environments. In this work, the introduction of DQN within an art painting robot application is proposed. The goal is to study how the introduction of a complex control policy impacts the performance of a basic art painting robot application. The main expected contribution of this work is to serve as a first baseline for future works introducing DQN methods for complex art painting robot frameworks. Experiments consist of real world executions of human drawn sketches using the DQN generated policy and TEO, the humanoid robot. Results are compared in terms of similarity and obtained reward with respect to the reference inputs

Robotics,Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning,Neural and Evolutionary Computing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to introduce complex control strategies in the application of art - painting robots to improve their performance. Specifically, the author proposes to use the Deep Q - Learning Network (DQN) in the application of art - painting robots, aiming to study how the performance of basic art - painting robots can be influenced by introducing complex control strategies. The goal of the paper is to provide a preliminary benchmark for the future introduction of the DQN method in complex art - painting robot frameworks. The background of the paper mentions that most of the current art - painting robot applications adopt simple control laws, which limit the adaptability of these frameworks to simple environments. To overcome this limitation, the author explores the method of using DQN to generate complex control strategies, thereby enhancing the performance of robots when performing complex tasks. The experimental part includes using the strategies generated by DQN and the humanoid robot TEO to execute human - drawn sketches and comparing them with the reference input in terms of similarity and obtained rewards. Overall, this paper aims to improve the control strategies of art - painting robots by introducing deep reinforcement learning techniques, especially DQN, so that they can better adapt to complex art - creation tasks.

Deep Robot Sketching: An application of Deep Q-Learning Networks for human-like sketching

Learning to Sketch with Deep Q Networks and Demonstrated Strokes

PaintBot: A Reinforcement Learning Approach for Natural Media Painting

A Robotic Auto-Focus System based on Deep Reinforcement Learning

Robot path planning using deep reinforcement learning

Deep Q-network for social robotics using emotional social signals

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

SketcherX: AI-Driven Interactive Robotic drawing with Diffusion model and Vectorization Techniques

Deep Reinforcement Learning for the Biologically Inspired Social Behaviour of Autonomous Robots Acting in Dynamic Environments

Sketch-based Creativity Support Tools using Deep Learning

State of the Art Control of Atari Games Using Shallow Reinforcement Learning

Sim-to-Real Brush Manipulation using Behavior Cloning and Reinforcement Learning

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Task-Oriented Deep Reinforcement Learning for Robotic Skill Acquisition and Control

FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environment

Creativity in Robot Manipulation with Deep Reinforcement Learning

Deep learning for studying drawing behavior: A review

Deep reinforcement learning oriented for real world dynamic scenarios

Making Robots Draw A Vivid Portrait in Two Minutes.

Learning to Paint With Model-Based Deep Reinforcement Learning

Deep Reinforcement Learning Enhanced Convolutional Neural Networks for Robotic Grasping