Self-Supervised Learning of Pretext-Invariant Representations

Abstract

The goal of self-supervised learning from images is to construct image representations that are semantically meaningful via pretext tasks that do not require semantic annotations. Many pretext tasks lead to representations that are covariant with image transformations. We argue that, instead, semantic representations ought to be invariant under such transformations. Specifically, we develop PretextInvariant Representation Learning (PIRL, pronounced as “pearl”) that learns invariant representations based on pretext tasks. We use PIRL with a commonly used pretext task that involves solving jigsaw puzzles. We find that PIRL substantially improves the semantic quality of the learned image representations. Our approach sets a new state of-the-art in self-supervised learning from images on several popular benchmarks for self-supervised learning. Despite being unsupervised, PIRL outperforms supervised pre-training in learning image representations for object detection. Altogether, our results demonstrate the potential of self-supervised representations with good invariance properties.

Date
Apr 16, 2024 3:00 PM — 3:40 PM
Event
EMIL Summer'24 Seminars
Location
Health Futures Center, ASU
Shovito Barua Soumma
Shovito Barua Soumma
Graduate Research Associate
PhD Student

Currently I am working on building and optimizing deep learning models for wearable sensors data.