Abstract:
Hashing methods have proven to be useful for a variety of tasks and have attracted extensive attention in recent years. Various hashing approaches have been proposed to c...Show MoreMetadata
Abstract:
Hashing methods have proven to be useful for a variety of tasks and have attracted extensive attention in recent years. Various hashing approaches have been proposed to capture similarities between textual, visual, and cross-media information. However, most of the existing works use a bag-of-words methods to represent textual information. Since words with different forms may have similar meaning, semantic level text similarities can not be well processed in these methods. To address these challenges, in this paper, we propose a novel method called semantic cross-media hashing (SCMH), which uses continuous word representations to capture the textual similarity at the semantic level and use a deep belief network (DBN) to construct the correlation between different modalities. To demonstrate the effectiveness of the proposed method, we evaluate the proposed method on three commonly used cross-media data sets are used in this work. Experimental results show that the proposed method achieves significantly better performance than state-of-the-art approaches. Moreover, the efficiency of the proposed method is comparable to or better than that of some other hashing methods.
Published in: IEEE Transactions on Knowledge and Data Engineering ( Volume: 28, Issue: 4, 01 April 2016)
Funding Agency:
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Hashing Methods ,
- Deep Network ,
- Visual Information ,
- Attention In Recent Years ,
- Similar Mean ,
- Variety Of Tasks ,
- Semantic Similarity ,
- Textual Information ,
- Word Representations ,
- Deep Belief Network ,
- Semantic Level ,
- Text Similarity ,
- Neural Network ,
- Deep Neural Network ,
- Multiple Modalities ,
- Hash Function ,
- Gaussian Mixture Model ,
- Text Words ,
- Word Embedding ,
- Image Texture ,
- Mean Average Precision ,
- Restricted Boltzmann Machine ,
- LabelMe ,
- Fisher Information Matrix ,
- Multimodal Representation ,
- Boltzmann Machine ,
- Current Word ,
- Text Query ,
- Fixed-length Vector ,
- Neural Language Models
- Author Keywords
- Author Free Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Hashing Methods ,
- Deep Network ,
- Visual Information ,
- Attention In Recent Years ,
- Similar Mean ,
- Variety Of Tasks ,
- Semantic Similarity ,
- Textual Information ,
- Word Representations ,
- Deep Belief Network ,
- Semantic Level ,
- Text Similarity ,
- Neural Network ,
- Deep Neural Network ,
- Multiple Modalities ,
- Hash Function ,
- Gaussian Mixture Model ,
- Text Words ,
- Word Embedding ,
- Image Texture ,
- Mean Average Precision ,
- Restricted Boltzmann Machine ,
- LabelMe ,
- Fisher Information Matrix ,
- Multimodal Representation ,
- Boltzmann Machine ,
- Current Word ,
- Text Query ,
- Fixed-length Vector ,
- Neural Language Models
- Author Keywords
- Author Free Keywords