Prof Marie-Francine Moens – Katholieke Universiteit Leuven
Cross-media Information Retrieval and Mining
One primordial task for a machine is the understanding and fusion of multiple inputs, for instance, when perceiving the world, listening to speech and other audio sounds, and reading texts. Multimedia archives containing text, video, still images and audio are quickly gaining importance (e.g., on the World Wide Web or privately held by broadcasting companies, publishing houses, libraries, musea, police and intelligence services, courtrooms, hospitals, etc.). Systems that access or mine this multimedia content should have the intellectual capability to relate the different information sources to each other, and to align and integrate the content. Indeed, more often than not the different modalities complement and disambiguate each other. Such technologies form the basis for multimedia and cross-media information retrieval and mining.
In this talk we present research that we have performed in jointly processing textual and visual information. We present algorithms for aligning names and faces in Web and video content, for recognizing and inferring locations and actions in video, and for linking user generated content in the form of text and images to webshops and e-commerce data. We show that such tasks call for expertise from two so far unconnected fields: natural language processing and computer vision.
Prof. Moens heads the Language Intelligence and Information Retrieval research group at the Department of Computer Science of the Katholieke Universiteit Leuven, Belgium, and is a world-renowned authority in the domain of automated content retrieval and extraction from text. Her research expertise includes: content recognition in text, information extraction, discourse understanding, text mining, knowledge acquisition, machine reading of text, processing of noisy text such as user-generated content and speech transcripts, information retrieval, search models, and machine learning for natural language processing.
School of Computing Science & Digital Media, Robert Gordon University, Riverside East, Garthdee, Aberdeen, Conference Room N310, 12:45 – 13:45.