Academic
Publications
Video Annotation Through Search and Graph Reinforcement Mining

Video Annotation Through Search and Graph Reinforcement Mining,10.1109/TMM.2010.2041101,IEEE Transactions on Multimedia,Emily Moxley,Tao Mei,Bangalore

Video Annotation Through Search and Graph Reinforcement Mining   (Citations: 8)
BibTex | RIS | RefWorks Download
Unlimited vocabulary annotation of multimedia documents remains elusive despite progress solving the problem in the case of a small, fixed lexicon. Taking advantage of the repetitive nature of modern information and online media databases with independent annotation instances, we present an approach to automatically annotate multimedia documents that uses mining techniques to discover new annotations from similar documents and to filter existing incorrect annotations. The annotation set is not limited to words that have training data or for which models have been created. It is limited only by the words in the collective annotation vocabulary of all the database documents. A graph reinforcement method driven by a particular modality (e.g., visual) is used to determine the contribution of a similar document to the annotation target. The graph supplies possible annotations of a different modality (e.g., text) that can be mined for annotations of the target. Experiments are performed using videos crawled from YouTube. A customized precision-recall metric shows that the annotations obtained using the proposed method are superior to those originally existing for the document. These extended, filtered tags are also superior to a state-of-the-art semi-supervised technique for graph reinforcement learning on the initial user-supplied annotations.
Journal: IEEE Transactions on Multimedia - TMM , vol. 12, no. 3, pp. 184-193, 2010
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
    • ...In recent decades, image annotation [19, 20, 22, 30, 44] has been attracting significant research attention in multimedia and computer vision area...
    • ...Moxley et al. [20] first searched visually similar videos based on multiple modalities and then proposed a graph reinforcement mining approach to filter out meaningful tags for test video...

    Yang Yanget al. Mining multi-tag association for image tagging

    • ...Recently, noticing that web video sharing sites (e.g., YouTube) often have certain amount of content redundancy, video annotation by tag propagation along overlapping or near-duplicate videos are shown to be effective [22, 29, 42]...

    Zhineng Chenet al. Web video retagging

    • ...Such techniques have recently been evident in [15], [19], [24], and [26], which are also referred to as “annotation by search”...
    • ...In [19], tag propagation technique is developed by crawling tags of similar videos for annotation by using text and global visual features...
    • ...Compared to similarity-based labeling on images and videos as in [15], [19], [24], and [26], near-duplicates searched by local keypoints provide more reliable and accurate information for video annotation...
    • ...In [19], variants of graph reinforcement algorithm are proposed for propagating tags from similar documents to query videos...
    • ...These works [15], [19], [26] consider only global visual features for search...
    • ...In [19] and [26], initial textual keywords or labels are further assumed to be available to guarantee efficient search and effective propagation...
    • ...Similarly, the work in [19] aims for effective propagation of tags from similar videos but scalability is not considered...

    Wan-Lei Zhaoet al. On the Annotation of Web Videos by Efficient Near-Duplicate Search

    • ...Moxley et al. [28] use a multiple graph reinforcement to tag the test video...
    • ...Our algorithm is compared with other video tagging algorithms, i.e., video tagging based on Graph Reinforcement Mining (Graph-Tag) [28], neighbor-based tagging (NTag) and tag propagation based tagging (TagRank) [39]...
    • ...We compare ICTag with other algorithms, i.e., GraphTag [28], NTag and TagRank [32]...

    Xiaoming Zhanget al. Automatic tagging by exploring tag information capability and correlat...

    • ...Recently, such data-driven techniques have been evident by various purposes, for instance, word similarity measure [8], object recognition [22], and image/video annotation [13, 21, 24]...
    • ...Such techniques, also referred to as “annotation by search”, have also been demonstrated in [13, 21] for video annotation...
    • ...Similar videos are ranked in a multimodal search, and graph reinforcement mining is proposed for propagating tags from similar documents to query videos [13]...

    Xiao Wuet al. Boosting web video categorization with contextual information from soc...

Sort by: