A Caltech Library Service

Dynamic Social Media Monitoring for Fast-Evolving Online Discussions

Srikanth, Maya and Liu, Anqi and Adams-Cohen, Nicholas and Cao, Jian and Alvarez, R. Michael and Anandkumar, Animashree (2021) Dynamic Social Media Monitoring for Fast-Evolving Online Discussions. . (Unpublished)

[img] PDF - Submitted Version
See Usage Policy.


Use this Persistent URL to link to this item:


Tracking and collecting fast-evolving online discussions provides vast data for studying social media usage and its role in people's public lives. However, collecting social media data using a static set of keywords fails to satisfy the growing need to monitor dynamic conversations and to study fast-changing topics. We propose a dynamic keyword search method to maximize the coverage of relevant information in fast-evolving online discussions. The method uses word embedding models to represent the semantic relations between keywords and predictive models to forecast the future time series. We also implement a visual user interface to aid in the decision-making process in each round of keyword updates. This allows for both human-assisted tracking and fully-automated data collection. In simulations using historical #MeToo data in 2017, our human-assisted tracking method outperforms the traditional static baseline method significantly, with 37.1% higher F-1 score than traditional static monitors in tracking the top trending keywords. We conduct a contemporary case study to cover dynamic conversations about the recent Presidential Inauguration and to test the dynamic data collection system. Our case studies reflect the effectiveness of our process and also points to the potential challenges in future deployment.

Item Type:Report or Paper (Discussion Paper)
Related URLs:
URLURL TypeDescription Paper
Alvarez, R. Michael0000-0002-8113-4451
Record Number:CaltechAUTHORS:20210510-121148191
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:109034
Deposited By: Tony Diaz
Deposited On:10 May 2021 19:30
Last Modified:10 May 2021 19:30

Repository Staff Only: item control page