Article (Scientific journals)
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training
Ozbulak, Utku; Lee, Hyun Jung; Boga, Beril et al.
2023In Transactions on Machine Learning Research
Peer Reviewed verified by ORBi
 

Files


Full Text
_0029_2023_Ozbulaketal.pdf
Publisher postprint (3.2 MB)
Download

All documents in ORBi are protected by a user license.

Send to



Details



Abstract :
[en] Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a plateau is in sight. Meanwhile, the use of self-supervised learning (SSL) for the purpose of natural language processing (NLP) has seen tremendous successes during the past couple of years, with this new learning paradigm yielding powerful language models. Inspired by the excellent results obtained in the field of NLP, self-supervised methods that rely on clustering, contrastive learning, distillation, and information-maximization, which all fall under the banner of discriminative SSL, have experienced a swift uptake in the area of computer vision. Shortly afterwards, generative SSL frameworks that are mostly based on masked image modeling, complemented and surpassed the results obtained with discriminative SSL. Consequently, within a span of three years, over 100 unique general-purpose frameworks for generative and discriminative SSL, with a focus on imaging, were proposed. In this survey, we review a plethora of research efforts conducted on image-oriented SSL, providing a historic view and paying attention to best practices as well as useful software packages. While doing so, we discuss pretext tasks for image-based SSL, as well as techniques that are commonly used in image-based SSL. Lastly, to aid researchers who aim at contributing to image-focused SSL, we outline a number of promising research directions.
Precision for document type :
Review article
Disciplines :
Computer science
Author, co-author :
Ozbulak, Utku;  Ghent University, Belgium ; Ghent University Global Campus, South Korea
Lee, Hyun Jung;  Ghent University, Belgium ; Ghent University Global Campus, South Korea
Boga, Beril;  BSH Hausgeräte GmbH, Germany
Anzaku, Esla Timothy;  Ghent University, Belgium ; Ghent University Global Campus, South Korea
Park, Homin;  Ghent University, Belgium ; Ghent University Global Campus, South Korea
Van Messem, Arnout  ;  Université de Liège - ULiège > Département de mathématique > Statistique appliquée aux sciences
De Neve, Wesley;  UGent - Universiteit Gent [BE] ; Ghent University Global Campus
Vankerschaver, Joris;  UGent - Ghent University [BE] ; Ghent University Global Campus
Language :
English
Title :
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training
Publication date :
May 2023
Journal title :
Transactions on Machine Learning Research
eISSN :
2835-8856
Peer reviewed :
Peer Reviewed verified by ORBi
Available on ORBi :
since 17 May 2023

Statistics


Number of views
80 (8 by ULiège)
Number of downloads
61 (1 by ULiège)

Bibliography


Similar publications



Contact ORBi