From Information Retrieval to Active Media

Trista Chen
Fotolugu Inc.

The paradigm of information service has shifted from passive information retrieval to active media experience. Instead of typing "Green dress in Mission Impossible - Ghost Protocol" at the Google search box, we are seeing a future where rich information actively presents itself to the user, at the right time and at the right place.

The talk first introduces video fingerprinting and rich media experience. Video fingerprinting, like human fingerprinting, uniquely identifies a queried video. The timestamp, or elapsed time from the start of the video is also identified. The video ID together with the timestamp info, can be linked to a wealth of scene-level information that greatly enrich user's media experience. For example, actor bio and trivia are automatically presented to the user at the scene where he appears. A Caribbean cruise package is recommended to the user when the set includes a beach scene. All the rich scene-level information is actively presented to the user without requiring her to act.
Challenges and opportunities to enable such a large-scale multimedia service will be outlined.

Back to Large Scale Multimedia Search