SIFT vs. FREAK: Assessing the usefulness of two keypoint descriptors for 3D face verification

Janez Križaj, Vitomir Štruc, Simon Dobrišek, Darijan Marčetić, Slobodan Ribarić: SIFT vs. FREAK: Assessing the usefulness of two keypoint descriptors for 3D face verification. In: 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) , pp. 1336–1341, Mipro Opatija, Croatia, 2014.

Abstract

Many techniques in the area of 3D face recognition rely on local descriptors to characterize the surface-shape information around points of interest (or keypoints) in the 3D images. Despite the fact that a lot of advancements have been made in the area of keypoint descriptors over the last years, the literature on 3D-face recognition for the most part still focuses on established descriptors, such as SIFT and SURF, and largely neglects more recent descriptors, such as the FREAK descriptor. In this paper we try to bridge this gap and assess the usefulness of the FREAK descriptor for the task for 3D face recognition. Of particular interest to us is a direct comparison of the FREAK and SIFT descriptors within a simple verification framework. To evaluate our framework with the two descriptors, we conduct 3D face recognition experiments on the challenging FRGCv2 and UMBDB databases and show that the FREAK descriptor ensures a very competitive verification performance when compared to the SIFT descriptor, but at a fraction of the computational cost. Our results indicate that the FREAK descriptor is a viable alternative to the SIFT descriptor for the problem of 3D face verification and due to its binary nature is particularly useful for real-time recognition systems and verification techniques for low-resource devices such as mobile phones, tablets and alike.

BibTeX (Download)

@inproceedings{krivzaj2014sift,
title = {SIFT vs. FREAK: Assessing the usefulness of two keypoint descriptors for 3D face verification},
author = { Janez Kri\v{z}aj and Vitomir \v{S}truc and Simon Dobri\v{s}ek and Darijan Mar\v{c}eti\'{c} and Slobodan Ribari\'{c}},
url = {http://luks.fe.uni-lj.si/nluks/wp-content/uploads/2016/09/MIPRO2014a.pdf},
year  = {2014},
date = {2014-01-01},
booktitle = {37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) },
pages = {1336--1341},
address = {Opatija, Croatia},
organization = {Mipro},
abstract = {Many techniques in the area of 3D face recognition rely on local descriptors to characterize the surface-shape information around points of interest (or keypoints) in the 3D images. Despite the fact that a lot of advancements have been made in the area of keypoint descriptors over the last years, the literature on 3D-face recognition for the most part still focuses on established descriptors, such as SIFT and SURF, and largely neglects more recent descriptors, such as the FREAK descriptor. In this paper we try to bridge this gap and assess the usefulness of the FREAK descriptor for the task for 3D face recognition. Of particular interest to us is a direct comparison of the FREAK and SIFT descriptors within a simple verification framework. To evaluate our framework with the two descriptors, we conduct 3D face recognition experiments on the challenging FRGCv2 and UMBDB databases and show that the FREAK descriptor ensures a very competitive verification performance when compared to the SIFT descriptor, but at a fraction of the computational cost. Our results indicate that the FREAK descriptor is a viable alternative to the SIFT descriptor for the problem of 3D face verification and due to its binary nature is particularly useful for real-time recognition systems and verification techniques for low-resource devices such as mobile phones, tablets and alike.},
keywords = {3d face recognition, binary descriptors, face recognition, FREAK, performance comparison, performance evaluation, SIFT},
pubstate = {published},
tppubtype = {inproceedings}
}