[gov3009-l] Applied Statistics 3/28

Hi everyone! This week at the Applied Statistics Workshop we will be welcoming *Michelle Torres*, a graduate student in Political Science and Statistics at Washington University in St Louis. She will be presenting work entitled *Understanding visual messages: visual framing and the Bag of Visual Words*. Please find the abstract below and on the Applied Stats website here <https://projects.iq.harvard.edu/applied.stats.workshop-gov3009>. As usual, we will meet at noon in CGIS Knafel Room 354 and lunch will be provided. See you all there! -- Dana Higgins *Title:* * Understanding visual messages: visual framing and the Bag of Visual Words * *Abstract:* How should one perform matching in observational studies when the units are text documents? The lack of randomized assignment of documents into treatment and control groups may lead to systematic differences between groups on high-dimensional and latent features of text such as topical content and sentiment. Standard balance metrics, used to measure the quality of a matching method, fail in this setting. We present a framework for matching documents that decomposes matching methods into two parts: (1) a text representation, and (2) a distance metric. We consider various methods that can be used at each step and conduct a systematic multifactor evaluation experiment using human subjects to identify the methods that dominate. We also show that our framework can be used to produce matches with higher subjective match quality than current state-of-the-art techniques. We then apply our chosen method to a substantive debate in the study of media bias using a novel data set of front page news articles from thirteen news sources. Media bias is composed of topic selection bias and presentation bias; using our matching method to control for topic selection, we find that both components contribute significantly to media bias, though some news sources rely on one component more than the other.