Few-shot learning for defect detection in manufacturing
Patrik Zajec,Jože M. Rožanec,Spyros Theodoropoulos,Mihail Fontul,Erik Koehorst,Blaž Fortuna,Dunja Mladenić,Patrik ZajecJože M. RožanecSpyros TheodoropoulosMihail FontulErik KoehorstBlaž FortunaDunja Mladenića Jožef Stefan International Postgraduate School,Ljubljana,Sloveniab Jožef Stefan Institute,Ljubljana,Sloveniac Qlector d.o.o.,Ljubljana,Sloveniad Department of Digital Systems,University of Piraeus,Piraeus,Greecee Department of Electrical and Computer Engineering,National Technical University of Athens,Athens,Greecef Iber-Oleff S.A.,Coimbra,Portugalg Philips Consumer Lifestyle BV,Drachten,The NetherlandsPatrik Zajec is a Ph.D. candidate at the Jožef Stefan International Postgraduate School. His research is mainly in the field of natural language processing,more specifically,he develops methods for unsupervised and semi-supervised information extraction and retrieval. He is also involved in the European Union Horizon 2020 project STAR,where he works on synthetic data augmentation techniques and a human-machine collaboration system using active learning,XAI,and semantic technologies.Jože M. Rožanec Ph.D. is a post-doc researcher at the Artificial Intelligence Laboratory (Jožef Stefan Institute),and a machine learning engineer at Qlector d.o.o. (developing intelligent solutions for smart factories). He collaborates with the American Slovenian Education Foundation,where he leads multiple activities for Fellows and Alumni. Over more than ten years,he worked for several companies (e.g. Mercado Libre,Navent,Globant) in software engineering and machine learning-related roles. His research interests include machine learning methods for recommendations,fraud detection,demand forecasting,active learning,and explainable artificial intelligence (XAI).Spyros Theodoropoulos is a Ph.D. Candidate at the School of Electrical and Computer Engineering of the National Technical University of Athens. He graduated from the same school and held an MSc in Machine Learning from Imperial College London. He has worked in the industry as a Software and Big Data Engineer and is now a member of the Data & Cloud Research Group at the University of Piraeus. His research is focused on deep learning,reinforcement learning,and the use of simulation for their deployment in real-life dynamic environments.Mihail Fontul has a degree in mechanical engineering from the Faculty of Mechanics of Technical University of Cluj-Napoca,Romania,PhD in mechanical engineering from Instituto Superior Técnico of the Technical University of Lisbon,Portugal,and has a vast and balanced industrial and academic experience. He served as Assistant Professor at the Department of Mechanical Engineering at Instituto Superior Técnico,where taught and developed scientific activities in the areas of Mechanical Vibrations and Noise,Product Development,Design and Materials in Engineering. He is the author or co-author of several articles in journals and conferences and has also been awarded two times for academic achievement. He is currently responsible for the Research,Development and Innovation Department of the company IBER-OLEFF Componentes Técnicos em Plástico SA and managing partner of the company FONTUL LDA dedicated to technical-scientific engineering consultancy activities.Erik Koehorst (Ir.) is a project manager currently working for Philips. He has studied industrial engineering management at the university of Twente and mechanical engineering at HZ university of applied sciences. Over more than 15 years he has been working in several fields of industry like maintenance,logistics and project management and gained a broad experience. His latest projects are focused on shopfloor automation like MES implementation and bringing industry 4.0 developments in practice.Blaz Fortuna is the founder and CEO of extrakt.AI,a startup developing artificial intelligence-based solutions for process automation,and senior researcher at Jozef Stefan Institute. He is the initiator and primary contributor to QMiner,the open-source data analytics platform for processing large-scale real-time streams containing structured and unstructured data,and co-contributor to Event Registry. He did his Ph.D. at Jožef Stefan Institute. He was a research consultant for Bloomberg L.P.,a Marie Curie Fellow at Stanford University,a postdoc at IBCN (Ghent University,Belgium),and the project manager for the XLike project.Prof. Dr. Dunja Mladenić http://ailab.ijs.si/dunja_mladenic/ works as a researcher and a project leader at Jožef Stefan Institute,Slovenia,leading Artificial Intelligence Department and teaching at Jožef Stefan International Postgraduate School,the University of Ljubljana and the University of Zagreb. She has extensive research experience in studying and developing Machine Learning,Big Data/Text Mining,the Internet of Things,Data Science,Semantic Technology techniques,and their application to real-world problems. She has published papers in refereed journals and conferences,co-edited several books,served on program committees of international conferences,and organised international events. She serves as a project evaluator of proposals for the European Commission and USA National Science Foundation. From 2013 to 2017,she served on the Institute's Scientific Council as a vice president (2015-2017). She serves on the Executive Board of Slovenian Artificial Intelligence Society SLAIS (as a president of SLAIS (2010-2014)) and on the Advisory board of ACM Slovenija.
DOI: https://doi.org/10.1080/00207543.2024.2316279
IF: 9.018
2024-02-27
International Journal of Production Research
Abstract:Quality control is being increasingly automatised in the context of Industry 4.0. Its automatisation reduces inspection times and ensures the same criteria are used to evaluate all products. One of the challenges when developing supervised machine learning models is the availability of labelled data. Few-shot learning promises to be able to learn from few samples and, therefore, reduce the labelling effort. In this work, we combine this approach with unsupervised methods that learn anomaly maps on unlabelled data, providing additional information to the model and enhancing the classification models' discriminative capability. Our results show that the few-shot learning models achieve competitive results compared to those trained in a classical supervised classification setting. Furthermore, we develop novel active learning data sampling strategies to label an initial support set. The results show that using sampling strategies to create and label the initial support set yields better results than selecting samples at random. We performed the experiments on four datasets considering real-world data provided by Philips Consumer Lifestyle BV and Iber-Oleff - Componentes Tecnicos Em Plástico, S.A.
engineering, manufacturing, industrial,operations research & management science