Ralph Ewerth: Using the TIB AV Analytics Platform for Analysing Disinformation Patterns in News Videos

Automatic video analysis enables applications in many disciplines including film and media studies, communication science, and education. In this talk, I will present the web-based video analysis platform entitled TIB AV-Analytics (TIB-AV-A) which integrates state-of-the-art approaches from the fields of computer vision, audio analysis, and natural language processing for relevant video analysis tasks. To facilitate future extensions and to ensure interoperability with existing tools, a plugin structure with appropriate interfaces and import-export functions is utilized. TIB-AV-A leverages modern web technologies to provide users with an interactive web interface that enables manual annotation and provides access to powerful deep learning methods without a requirement for specific hardware. 

As a use case for TIB-AV-A, I will present results from the research project “FakeNarratives” (funded by German Ministry of Education and Research) on the analysis of news videos. Here, we first investigated whether the narrative strategies for broadcast and “alternative” media differ, and second, whether there are typical narrative patterns for conveying disinformation. An example result from this project is our approach for the identification of speaker roles and situations in news, which is a prerequisite for the analysis of narrative patterns.

Archives and museums are placing great hopes in Artificial Intelligence. Time-consuming, labor-intensive tasks — such as the description and analysis of objects — can already be, or may soon be, taken over by machines. Artificial Intelligence (AI) promises not only access to previously unexplored holdings but also new, powerful analytical tools for research, enabling the extraction of new information about cultural objects and the visualization of previously unseen connections. Finally, the hope is that automation will free valuable resources for research and creative work with cultural heritage.
The conference »Archival Intelligence: AI × Archives × Museums« asks where we currently stand with regard to these promises. It seeks to show where and how AI can be used in practice and to open a discussion on the new possibilities and consequences arising from the availability of these technologies — implications that we may not yet have anticipated. The focus lies on concrete applications of AI — from automated text, speech, and handwriting recognition, and the analysis of images and videos, to the cataloguing of archival holdings and scholarly data analysis, the curation of collections, AI-supported provenance research, and restoration.
Experts from museums, archives, and universities offer practice-oriented insights into the use of AI as an analytical tool and as valuable support for semantic indexing and targeted information retrieval. Particular emphasis is placed on learning from applications outside the fields of art and culture, such as research data management, in order to develop pragmatic approaches for museums and cultural archives.
Organized by the ZKM | Center for Art and Media, one of the leading institutions in the field of media art and recognized for its expertise in the preservation of electronic and digital artworks, this conference offers an opportunity to discover innovative approaches and to engage with experts who are actively shaping the future of work with cultural and scholarly objects.

With

Dominik Bönisch Alpári (Düsseldorf University of Applied Sciences), Giovanni Colavizza (University of Copenhagen), Robert G. Erdmann (University of Amsterdam), Ralph Ewerth (TIB Hannover), Jasmijn Van Gorp (Utrecht University), Adelheid Heftberger (Federal Archives), Andreas Kohlbecker (ZKM | Karlsruhe), Bárbara Romero Ferrón (Leuphana University Lüneburg), Heiko Schuldt (University of Basel), Christiane Sibille (ETH, Zurich), and Kim Voss (DRA | German Broadcasting Archive).

The conference is part of the »Artificial Intelligence & Art« funding project of the City of Karlsruhe.

Imprint:

Margit Rosen: Concept
Idis Hartmann: Concept
Andreas Kohlbecker: Research Associate
Felix Mittelberger: Research Associate