An effective World Wide Web image search engine

Abstract

Effective World Wide Web image retrieval systems are required to locate relevant images as more and more images are used in HTML documents. There are two general approaches to image retrieval: one is based on text descriptions and the other on image contents (low-level features, such as colour and texture). They have their respective strengths and weaknesses. In this paper, we describe how to improve text-based and content-based image retrieval techniques and to integrate these two types of techniques in one system to take advantage of their complementing strengths. Our experimental results show that the integrated approach has higher retrieval performance than either the text-based or the content-based techniques used by themselves.

References

[1] M.J. Swain and D.H. Ballard , Color indexing , International Journal of Computing Vision 7 (1991) 11-32 .

[2] G.D. Finlayson, Colour Object Recognition (MSc Thesis) (Simon Fraser University, 1992).

[3] W. Niblack et al. , QBIC Project: querying images by content, using colour, texture, and shape . In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases, 1-3 February 1993, San Jose, California: SPIE 1908 (1993) 173-187 .

[4] M. Stricker and M. Orengo , Similarity of color images . In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases III, 9-10 February 1995, San Jose, California: SPIE 2420 (1995) 381-392 .

[5] G. Salton , Introduction to Modern Information Retrieval ( McGraw-Hill , 1993).

[6] T.S Chua et al. , A concept-based image retrieval system . In: Proceedings of the 27th Annual Hawaii International Conference on Systems Science, Maui, Hawaii, January 4-7 1994 3 (1994) 590-598 .

[7] S.K. Chan, Content-Based Image Retrieval (MSc Thesis) (Department of Information Systems and Computer Science, National University of Singapore, 1994).

[8] G. Lu and J. Phillips , Using perceptually weighted histograms for colour-based image retrieval . In: Proceedings of the Fourth International Conference on Signal Processing, 12-16 October 1998, Beijing, China, pp. 1150-1153 .

[9] S. Brin and L. Page , The anatomy of a large-scale hyper-textual web search engine . In: Proceedings of the Seventh International World Wide Web Conference, 14-18 April 1998, Brisbane, Australia. Available at: http://www7.conf.au/programme/fullprog.html

10.

[10] H. Levkowitz , Color Theory and Modeling for Computer Graphics, Visualization, and Multimedia Applications ( Kluwer Academic , 1997).

11.

[11] J.R. Smith and S-F. Chang , Searching for Images and Video on the World Wide Web (Technical Report No. 459-96-25) ( Center for Telecommunications Research, Columbia University , 1996).

12.

[12] J.R. Smith and S-F. Chang , Visually searching the web for content , IEEE Multimedia Magazine (July-September 1997) 12-20 .

13.

[13] S-F. Chang et al. , Finding images/video in large archives , D-Lib Magazine (February 1997). Available at: http://www.dlib/org/dlib/february97/columbia/02chang.html

14.

[14] J.M. Corridoni et al. , Image retrieval by color semantics , Multimedia Systems 7 (1999) 175-183 .

15.

[15] M. La Cascia et al. , Combining textual and visual cues for content-based image retrieval on the World Wide Web . In: Proceedings of IEEE Workshop on Content-Based Access of Image and Video Libraries, June 1998.

16.

[16] L.M. Taycher , M. La Cascia and S. Sclaroff , Image digestion and relevance feedback in the ImageRover WWW search engines . In: Proceedings of the Second International Conference on Visual Information Systems, San Diego, December 15-17, 1997, pp. 85-91 .

17.

[17] J.R. Smith and S-F. Chang , Tools and techniques for color image retrieval . In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases IV, February 1-2, 1996, San Jose, California: SPIE 2670 (1996) 426-437 .

18.

[18] M. Stricker and A. Dimai , Color indexing with weak spatial constraints . In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases IV, February 1-2, 1996, San Jose, California: SPIE 2670 (1996) 29-40 .

19.

[19] X. Wan and C.J. Kuo , Color distribution analysis and quantization for image retrieval . In: Proceedings of the Conference on Storage and Retrieval for Image and Video Databases IV, February 1-2, 1996, San Jose, California: SPIE 2670 (1996) 8-16 .

20.

[20] G. Lu , Multimedia Database System Management Systems ( Artech House , 1999).

21.

[21] J. Eakins and M. Graham , Content-Based Image Retrieval: A Report to the JISC Technology Applications Programme ( Institute for Image Data Research, University of Nothumbria , 1999).

22.

[22] Y. Rui et al. , Image retrieval: current techniques, promising directions and open issues , Journal of Visual Communication and Image Representation 10 (1999) 39-62 .

23.

[23] MPEG home page at: http://drogo.cselt.stet.it/mpeg/

24.

[24] S. Jeannin (ed.), MPEG-7 Visual Part of Experimentation Model Version 5.0 (March 2000). Available at: http://drogo.cselt.stet.it/mpeg/

25.

[25] Available at: http://www-mugc.cc.monash.edu.au/%7Eguojunl/chooneng/