A framework for fuzzy video content extraction, storage and retrieval

Abstract

This study presents a new comprehensive framework for semantic content extraction from raw video, storage of the extracted data and retrieval of the stored data. Objects, spatial relations between objects, events and temporal relations between events, which are considered as semantic contents of the video, are extracted automatically to a certain extend with the developed approach. Extraction process is supported by manual annotation when automatic extraction is not satisfactory. The extracted information is stored in an intelligent fuzzy object-oriented database in which the database is enhanced with a fuzzy knowledge-based system. Domain specific deduction rules can be defined to derive new information about semantic contents of the video. The database is also supported by an access structure to increase retrieval efficiency. The proposed framework is capable of handling uncertain data arising from annotation process or video nature. © 2010 IEEE.