A framework for the unsupervised and semi-supervised analysis of visual frames
This article introduces to political science a framework to analyze the content of political visual material through unsupervised and semi-supervised methods. It details the implementation of a tool from the computer vision field, the Bag of Visual Words, for the definition and extraction of ``tokens’‘ that allow researchers to build an Image-Visual Word matrix which emulates the Document-Term matrix in text analysis. This reduction technique is the basis for several tools familiar to social scientists, such as topic models, that permit exploratory, and semi-supervised analysis of images. The framework has gains in transparency, interpretability, and inclusion of domain knowledge with respect to other deep learning techniques. I illustrate the scope of the BoVW by conducting a novel visual structural topic model which focuses substantively on the identification of visual frames from the pictures of the migrant caravan from Central America.
Date: 5 June 2023, 14:00 (Monday, 7th week, Trinity 2023)
Venue: Manor Road Building, Manor Road OX1 3UQ
Venue Details: Seminar Room A
Speaker: Michelle Torres (Rice)
Organising department: Department of Politics and International Relations (DPIR)
Organiser: Spyros Kosmidis (University of Oxford)
Booking required?: Not required
Audience: Members of the University only
Editors: Helen Morley, Rebecca Freeman, Daniel Burton