Deployment of outbreak-simulating app on college campuses reveals hidden transmission pathways

Deployment of outbreak-simulating app on college campuses reveals hidden transmission pathways
Representative subgraphs of the BYU contact network. (A–C) Across each of these three subgraphs, the number of secondary contacts (blue) is (A) lower, (B) equal, and (C) higher than the model would predict based on the number of first-degree contacts (green). In (A), the red node has 7 first-degree contacts but only 32 second-degree contacts. In (B), the number of second-degree contacts aligns with what we would predict based on the number of first-degree contacts. In (C), the red node has only 3 first-degree contacts but 126 second-degree contacts. Edges between second-degree contacts are omitted for visual clarity. Credit: Patterns (2022). DOI: 10.1016/j.patter.2022.100572

In 2016, a group of middle school students in Florida took part in an interactive lesson about infectious disease outbreaks, exchanging stickers to simulate viral spread. The exercise, designed by their teacher, Todd Brown, in collaboration with Pardis Sabeti, a computational geneticist and an institute member at the Broad Institute of MIT and Harvard, has since evolved into a fully immersive experience called Operation Outbreak that uses a Bluetooth-based mobile app to simulate pathogen spread across individual participant phones. More than 50 schools across the country have used the app, along with accompanying lesson plans and a textbook, to run campus-wide outbreak simulations and teach students the science of outbreaks.

"Mobile applications have a vast potential in both education and research," said Andrés Colubri, who developed the app as a computational researcher in the Sabeti lab and is now a professor at the University of Massachusetts Medical School. "Simulation games can be highly immersive, interactive, and realistic, as well as able to generate rich datasets to study complex dynamical systems, such as a population during an infectious disease outbreak."

The app has evolved over the years to include many realistic features. Users can scan QR codes to use interventions such as vaccines, diagnostic tests, masks, or hazmat suits. The app then records data, including case numbers and the time, distance, and duration of interactions between participants, which researchers can use to map how a virus spreads. The app also keeps track of the people an infected person interacts with, both the direct contacts (first-degree contacts) and then their contacts (second-degree contacts).

Colubri and the team continue to develop new versions of the app that are more realistic and generate more information for scientists, such as the duration of each contact between users and distance between them, or the evolving genome sequence of the pathogen as it spreads from person to person.

"We can quite realistically simulate so many aspects of pathogen spread and our tools to mitigate it, and we are continually striving to enhance the immersive and realistic nature of the experience," Sabeti said. "Students should not need to wait until a real outbreak to understand how they can unfold."

In a study recently published in Patterns, the team describes the results of Operation Outbreak simulations at Colorado Mesa University (CMU) and Brigham and Young University (BYU). They found that participants on both campuses had significantly more exposure to infected students than their first-degree contacts alone revealed. They also built an from the data and found that increasing testing and vaccination during periods of increased social activity dramatically decreased case counts.

"In these simulations, we strive to comprehensively model key technical and socio-behavioral aspects of real-world outbreaks, and encourage participants to think creatively and strategically about how to allocate resources," said Kian Sani, program manager of Operation Outbreak. "We learn a great deal from watching students wrestle with mitigating and containing these simulated public health emergencies."

We sat down with Bryn Loftness, a visiting graduate student researcher in the Sabeti lab who helped deploy Operation Outbreak as a CMU undergraduate, and Ivan Specht, a Harvard University undergraduate researcher in the Sabeti lab and first author of the study, to learn more about how have used the app and what the team has learned from the campus deployments. The following interview has been edited for length and clarity.

What was the biggest thing you learned from the Operation Outbreak deployments at CMU and BYU?

BL: Something that I and many other students gained is a deeper understanding of the potentially huge amounts of second- or third-degree contacts a person can have. You might expect that you have, say, three first-degree contacts but in actuality, your second-degree contacts can be as many as 50 or 80. That's been something we understood during this pandemic too. A better understanding of those real-life statistics—I think that's a valuable insight anyone can take away from a deployment.

What makes the app a good way to collect data?

BL: The app is accessible and scalable because it can be used by essentially anyone and is anonymous, thus allowing us to recruit participants and track their movements without taking any private data from them, such as their actual location or who they are.

IS: One of the things that really makes this different from other contact tracing apps is that it's educational. I think people are a lot less hesitant to use an app if they're actually getting something out of it, rather than just having something running in the background on their phones all the time.

Credit: Broad Institute of MIT and Harvard

How have students responded to using Operation Outbreak?

BL: Overall it's been very positive. The app is flexible in that a student can interact with it in different ways based on how much they want to get involved. The students that were really motivated were able to utilize more of the program's features, such as interactive quizzes and QR code interventions, while others just downloaded it and had it running in the background.

IS: At BYU, it was inspiring to see the extent to which this simulation encouraged students to get involved with outbreak science projects. Students formed an Operation Outbreak club and set up a website to help facilitate the simulation. After we collected the data from the simulation, some of the people on that team helped us with some of the analyses and I was very excited to see how eager they were to participate in this way of learning.

How can campuses use what they learn from the app?

BL: If you allow students to lead a simulation like this and collect insights such as how many first- and second-degree contacts students have on average, you'll be able to implement policies based on those insights. We're encouraging students to help us understand students, while also helping those students to learn about themselves as well. If a participant knew they had three first-degree contacts but 126 second-degree contacts, as we observed at BYU, they might potentially change their behavior without any protocol changes on campus.

What would you like to include in future iterations of the app?

BL: After each simulation we do with Operation Outbreak, we receive feedback and make changes. For example, between the CMU and BYU simulations, there was a complete iteration that made it a better app. It's been really fascinating to see how many people are dedicating time to the system, which is really what makes Operation Outbreak so dynamic.

IS: Right now, Operation Outbreak assumes that there's one pathogen that doesn't mutate and has a certain level of infectiousness. I'd really like to include a highly detailed mutation model so that Operation Outbreak could produce data that looks identical to real outbreak data. We're working now to include things that could further affect people's behaviors, like a full economic model that determines who has access to things like vaccines and diagnostic tests.

Our ultimate goal is to create a simulation software that anyone can easily use to coordinate a simulation whenever they want. We envision a world where Operation Outbreak is deployed at least once in every school, because we think that children everywhere should get access to at least some level of outbreak science education.

What has it been like to work on Operation Outbreak?

BL: I got involved with the Sabeti lab through this project. Since then, I've worked on a variety of digital epidemiology projects. It's been a really great opportunity to be involved with OO not only from the administrative side, but also in inspiring people to get more involved, helping assess the results of the simulations, watching passionate students form clubs and groups, and doing more research into what transmission of a virus in a congregate setting looks like.

IS: This project is what gets me going. It has very much shaped the trajectory of what I want to do in the lab going forward. It's made me feel intimately connected to the communities that are trying Operation Outbreak and to the communities that are affected by outbreaks.

From a data science perspective, it also showed me firsthand what an outbreak actually looks like on paper, and how one can use that to model outbreaks. There really aren't any platforms that pick up the ground truth of an outbreak in the way that Operation Outbreak does—you actually know who infects whom, and that provides us with this way of understanding outbreaks that you're not going to get by looking at a big dataset of people who tested positive for a real virus at different times. That framework is something that absolutely informs my work with science and epidemiology day-to-day.

Explore further

Operation Outbreak simulation teaches students how pandemics spread

More information: Ivan Specht et al, Analyzing the impact of a real-life outbreak simulator on pandemic mitigation: An epidemiological modeling study, Patterns (2022). DOI: 10.1016/j.patter.2022.100572

Andrés Colubri et al, Preventing Outbreaks through Interactive, Experiential Real-Life Simulations, Cell (2020). DOI: 10.1016/j.cell.2020.08.042

Journal information: Patterns , Cell

Citation: Deployment of outbreak-simulating app on college campuses reveals hidden transmission pathways (2022, August 16) retrieved 1 October 2022 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors