Keyword-based image retrieval systems havebecome popular for many image databaseapplications. To improve the performance ofkeyword-based web image queries, combination ofkeyword and visual feature based image retrievalsystem is presented in this paper. Firstly, DOM(Document Object Model) trees are constructed fromcollected web pages. And several text blocks aresegmented based on text cohesion. Then, visualfeatures are extracted from color images in RGB(Red, Green and Blue) color space by using colorhistogram. When user query is entered, text blockswhich contain web images are taken as theassociated texts of corresponding images andTF*IDF values are used to index web images.Finally, keyword and visual features are combinedby using Gaussian Mixture Model to produce therelevance images