Home . Projects . Research . Publications . Members . Demos
BilVideo provides an integrated support for queries on spatio-temporal, semantic and low-level features (color, shape, and texture) on video data (see ref.1). A spatio-temporal query may contain any combination of directional, topological, object-appearance, 3D-relation, trajectory-projection and similarity-based object-trajectory conditions. BilVideo handles spatio-temporal queries using a knowledge-base, which consists of a fact-base and a comprehensive set of rules, while the queries on semantic and low-level features are handled by an object-relational database. The query processor interacts with both of the knowledge-base and object-relational database to respond to user queries that contain a combination of spatio-temporal, semantic, and low-level feature query conditions. Intermediate query results returned from these system components are integrated seamlessly by the query processor and sent to Web clients. Moreover, users can browse the video collection before giving complex and specific queries, and a text-based SQL-like query language is also available for users (see ref.2).
BilVideo supports any application with query requirements on spatio-temporal, semantic and low-level features on video data; therefore, it is application-independent. However, it can easily be tailored according to the specific requirements of such applications through the definition of external predicates supported by its query language without much effort and any loss in performance.
Here, we present the Web-based visual query interface of BilVideo and its tools, Fact-Extractor and Video-Annotator, which are used to populate the facts-base and feature database of the system to support spatio-temporal and semantic video queries, respectively. Furthermore, an auxiliary module used to extract salient objects from video keyframes, called Object Extractor, is also presented (see ref.3).
BilVideo can handle multiple requests over the Internet through a graphical query interface developed as a Java applet (see ref.4). The interface is composed of query specification windows for different types of queries: spatial, trajectory, semantic, and low-level features. Since video has a time dimension, these two types of primitive queries can be combined with temporal predicates to query temporal contents of videos. The Web-based Query Interface of BilVideo is available here. A demo of the Web-based Query Interface can be seen here.
This tool is used to extract spatio-temporal relations between video objects and store them in the knowledge-base as facts. These facts representing the extracted relations are used to query video data for spatio-temporal conditions. The tool also extracts object trajectories and 3D-relations between objects of interest. A demo facts-base population via the Fact-Extractor tool is available here.
This tool is used to extract semantic data from video clips to be stored in the feature database to query video data for its semantic content. It provides some facilities for viewing, updating and deleting semantic data that has already been extracted from video clips and stored in the feature database. A demo of video annotation through the Video-Annotator tool is available here.
This tool is used to extract salient objects from video keyframes. It also facilitates the fact-extraction process automating the minimum bounding rectangle (MBR) specification of salient objects. A demo of the Object Extractor module is available here.