Resources of Salient Patch Features

Image Patch Detectors

• C Harris, M Stephens, A combined corner and edge detector , Alvey Vision Conference, 1988 (high resolution file )
• Edward Rosten and Tom Drummond's FAST corner detection. [ICCV 05 and Talk ] [ECCV 06 ] [Code ]
• J. Shi and C. Tomasi . Good Features to Track, CVPR 1994.
  • a better measure than traditional M_c
• CS Kenney, M Zuliani , BS Manjunath , An axiomatic approach to corner detection , CVPR 2006.
• H. Wang and M. Brady. "Real-time corner detection algorithm for motion estimation. ". Image and Vision Computing, 1995
• Wiki's Corner Detection List : SUSAN, DoG , Harris-Laplacian , FAST
• David G. Lowe, Distinctive image features from scale-invariant keypoints , IJCV, 2004. [ICCV 99 version ] [Demo software]
  • DoG is approximation of Laplacian of Gaussian
• ================================MSER======================================
• J. Matas , O. Chum, M. Urban, and T. Pajdla . Robust wide baseline stereo from maximally stable extremal regions , BMVC, 2002. [a longer version at IVC 2004]
  • MSER
• Per-Erik Forssén , Maximally Stable Colour Regions for Recognition and Matching , CVPR, 2007 [video ] [codes ]
  • extending MSER to color
• ===========================================================================
• K. Mikolajczyk and C. Schmid , Scale and Affine invariant interest point detectors . IJCV, 2004. [ECCV 02 version ] [ICCV 01 paper ]
  • Hessian /Harris + LoG : said to be good affine detector
• F. Jurie and C. Schmid , Scale-invariant shape features for recognition of object categories, CVPR, 2004. [IEEE Link ]
• T. Kadir , and M. Brady, Scale, Saliency and Image Description . IJCV 2001  [source code ] [Affine version : ECCV, 2004 and its binary ]
  • said to obtain better results in general object recognition
• Herbert Bay, Tinne Tuytelaars , Luc Van Gool , "SURF: Speeded Up Robust Features ", ECCV, 2006 [Binary Code ]
  • fast SURF detector: approximate Hessian
• ===========================================================================

·         T Lindeberg , Edge detection and ridge detection with automatic scale selection , CVPR, 1996 [IEEE link ] [IJCV98 version ]

Patch Descriptors for Image

• David G. Lowe, Distinctive image features from scale-invariant keypoints , IJCV, 2004. [ICCV 99 version ] [Demo software]
• Per-Erik Forssén and David G. Lowe, Shape descriptors for maximally stable extremal regions , ICCV 2007.
• A. Hadid , M. Pietikainen , T. Ahonen , A discriminative feature space for detecting and recognizing faces, CVPR, 2004 [LBP Code ]
• ====================================HoG ======================================
• N Dalai, B Triggs , Histograms of oriented gradients for human detection , CVPR, 2005 [Talk ] [Wiki ] [Code ]
• N Dalai, B Triggs , and C. Schmid , Human detection using oriented histograms of flow and appearance , ECCV 2006

·         Q Zhu, S Avidan , MC Yeh , KT Cheng, Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , CVPR, 2006

·         S. Bileschi and L. Wolf, Image representations beyond histograms of gradients: The role of Gestalt descriptors . CVPR, 2007.

·         Bosch, A. , Zisserman , A. and Munoz, X. , Representing shape with a spatial pyramid kernel , CIVR, 2007

·         ============================= Shape Context ==============================

·         S Belongie , J Malik , J Puzicha , Shape context: A new descriptor for shape matching and object recognition , NIPS 2000. [ICCV01 Version ] [PAMI02 Version ] [webpage with code ]

·         G Mori, S Belongie , J Malik , Shape contexts enable efficient retrieval of similar shapes, CVPR, 2001

·         G Mori, J Malik , Estimating human body configurations using shape context matching, ECCV 2002

·         H Zhang, J Malik , Learning a discriminative classifier using shape context distances, CVPR 2003

·         A Thayananthan , B Stenger , PHS Torr , R Cipolla , Shape context and chamfer matching in cluttered scenes, CVPR 2003

·         =============================Angular Radial Histogram==============================

• A Chalechale , A Mertins , G Naghdy , Edge image description using angular radial partitioning , IEE Proc. Vision, Image and Signal, 2004
• Lei Qin, Wen Gao . Image Matching Based on A Local Invariant Descriptor , ICIP, 2005
  • Angular Radial Histogram
• ===========================================================================
• K. Mikolajczyk , C. Schmid . A performance evaluation of local descriptors .  PAMI 2005
  • GLOH is said to be superior to SIFT than structure image. but more computational expensive
• Herbert Bay, Tinne Tuytelaars , Luc Van Gool , "SURF: Speeded Up Robust Features ", ECCV, 2006 [Binary Code ]
  • fast SURF descriptors: Haar -wavelet response using integral image
• ==============================Poggio's cortex based ==============================
• T. Serre , L. Wolf, and T. Poggio . Object recognition with features inspired by visual cortex . CVPR, 2005. [Source Code ] [Another Code ]
• J. Mutch and D. Lowe, Multiclass object recognition with sparse, localized features , CVPR 2006. [Source code]
• L. Wolf and S. Bileschi , A critical view of context , IJCV, 2006.

·         T. Serre , L. Wolf, S. Bileschi , M. Riesenhuber , and T. Poggio Robust Object Recognition with Cortex-like Mechanisms , PAMI, 2007.

·         Ethan. Meyers and Lior Wolf , Using Biologically Inspired Features for Face Processing , IJCV, 2008.

·         Ankur Agarwal , Bill Triggs , Multilevel Image Coding with Hyperfeatures , IJCV 2007. [ECCV 06 version ]

·         D. Song and D. Tao, Biologically Inspired Feature Manifold for Scene Classification, IEEE Transactions on Image Processing, accepted.

·         Y. Huang et al, Enhanced Biologically Inspired Model, CVPR 2008.

·         D. Song and D. Tao, C1 Units for Scene Classification, ICPR 2008.

·         ==============================Gabor, LBP ======================================

• Gabor filter on Wiki ,  Detecting bars and lines on CVonline [code ]

·         J-K Kämäräinen et al, Object Localisation Using Generative Probability Model for Spatial Constellation and Local Image Features, ICCV-NRTL 2007 . [Webpage with code ]

·         Chengjun  Liu , Gabor-based Kernel PCA with Fractional Power Polynomial Models for Face Recognition , PAMI, 2004.

• YingNian Wu, Zhangzhang Si, Chuck Fleming, and SongChun Zhu, Deformable template as active basis , ICCV 2007. [Talk ] [Code ]

·         Marko Heikkilä , Matti Pietikäinen , Cordelia Schmid : Description of Interest Regions with Center-Symmetric Local Binary Patterns. ICVGIP 2006. [LBP web ] [LBP code ]

·         ============================== Dense Sampled Shape Descriptor =================================

·         H. Zhang, A. Berg, , M. Maire , and J. Malik . SVM-KNN: Discriminative nearest neighbor classication for visual category recognition. In CVPR, pages 2126–2136, 2006.

•  
  • shape + texture;     NN + SVM
• A. Bosch , A. Zisserman , and X. Munoz. Representing shape with a spatial pyramid kernel . In Proc. CIVR, 2007. [Anna Bosch's thesis 07 ]
  • grid sampling + all three scale -> SIFT descriptor
  • Canny + sobel filter -> HoG descriptor
• M. Varma and D. Ray. Learning the discriminative power-invariance trade-off . ICCV 2007 [web ]
  • SVM-based, Invariance trade-off
  • combine 6 features mentioned above
  • caltech 101: 78.4%(1-vs-1) and 87.8% (1-vs-all)

Evaluations

• K Mikolajczyk , T Tuytelaars , C Schmid , A  Zisserman , J Matas , F Schaffalitzky , T Kadir , LV Gool . A comparison of affine region detectors . IJCV, 2005
• K. Mikolajczyk , C. Schmid . A performance evaluation of local descriptors .  PAMI 2005

·         C Schmid , R Mohr, C Bauckhage , Evaluation of Interest Point Detectors . IJCV 2000

• Michael Stark , Bernt Schiele , How Good are Local Features for Classes of Geometric Objects , ICCV 2007

Matching and Indexing Algorithms

• J. Matas and O. Chum. Randomized RANSAC with Tdd test . BMVC, 2002. (later appeared in Image and Vision Computing, 2005)
• S. Obdrzálek and J. Matas . Sub-linear indexing for large scale object recognition , BMVC, 2005 best paper.
• O. Chum and J. Matas . Matching with PROSAC - progressive sample consensus . CVPR 2005.
• K. Mikolajczyk and J. Matas . Improving sift for fast tree matching by optimal linear projection . ICCV, 2007
• Dusan Omercevic , Ondrej Drbohlav , Ales Leonardis , High-dimensional feature matching: Employing the concept of meaningful nearest neighbors , ICCV 2007
• Richard Szeliski , Image Alignment and Stitching: A Tutorial , Chapter 3-4, 2006   

Dimension Reduction, Vocabulary

• J. Winn, A. Criminisi and T. Minka . Object Categorization by Learned Universal Visual Dictionary , ICCV 2005
• S. Savarese , J. Winn and A. Criminisi ,  Discriminative Object Class Models of Appearance and Shape by Correlatons , CVPR 2006
• F. Jurie and B. Triggs , Creating efficient codebooks for visual recognition , ICCV 2005
• E. Nowak, F. Jurie , and B. Triggs . Sampling strategies for bag-of-features image classication . ECCV, 2006
• F. Moosmann , B. Triggs , and F. Jurie . Randomized clustering forests for building fast and discriminative visual vocabularies . NIPS 2006.
• Eric Nowak and Frédéric Jurie , Learning Visual Similarity Measures for Comparing Never Seen Objects , CVPR 2007

Applications

• J. Sivic , and A. Zisserman , Video Google: A Text Retrieval Approach to Object Matching in Videos , ICCV 03 [Also refer to CVPR04, ECCV04]
• Matthew Brown and David G. Lowe, Automatic panoramic image stitching using invariant features , IJCV, 2007.[ICCV 03 version ] [Project page] ; [Autostitch ] ;
• Edward Rosten and Tom Drummond, Fusing points and lines for high performance tracking , ICCV 2005 [Presentation ]
• Donoser Michael, Bischof Horst, Efficient Maximally Stable Extremal Region (MSER) Tracking , CVPR,2006
• A. M. Buchanan and A. W. Fitzgibbon, Interactive Feature Tracking using K-D Trees and Dynamic Programming , CVPR, 2006
• M. Ozuysal , P. Fua , and V. Lepetit , Fast Keypoint Recognition in Ten Lines of Code . CVPR, 2007. [ppt , related movies ]
• Roger Grosse, Rajat Raina , Helen Kwong and Andrew Y. Ng. Shift-Invariant Sparse Coding for Audio Classification ,  UAI, 2007. [code ]

Software and Other Resources

Peter Kovesi' s Spatitial feature detection: canny , harris , fast radial , Garbor

Edward Rosten FAST corner detector

Vincent Garcia's keypoint extraction at Matlab Central

SURF: ETH binary and an openCV implementation

SIFT on GPU . (with source code ): http://cs.unc.edu/~ccwu/siftgpu/

Optical Flow on GPU : http://openvidia.sourceforge.net/

HOG:  Dalal’s toolkit .                   windows version using OpenCV & boost .               

Sebastian Nowozin @TU-Berlin's SIFT implementation in C#

Andrea Vedaldi @UCLA's SIFT, MSER, and VL Feature Library

[irresponsible note ]: SIFT for two 800x600 im :  Gaussian (4sec) + detector (<3sec) + descriptor (40sec) + siftmatch (24sec) + plotss (17sec). MSER: several second: but not clear  feature descriptor

Gyuri  Dorkó @INRIA's scale and affine Linux binary

Vgg's affine region detectors and descriptors   (binary) and Krystian Mikolajczyk's   matching , indexing

Course and Tutorial

Cordelia Schmid and David Lowe's CVPR 03 tutorial

 

From: http://www.ifp.illinois.edu/~cao4/reading/patchbib.htm