Skip to content
Merged
Show file tree
Hide file tree
Changes from 10 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
41 changes: 41 additions & 0 deletions content/blog/2024-01-01-flash-intro.Rmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
---
title: Introducing the FlaSH Group
author: Ananya Joshi, Nolan Gormley, Richa Gadgil, Tina Townes
date: 2024-01-01
tags:
- flash
authors:
- ananya
- nolan
- richa
- tina
heroImage: flash_long.png
heroImageThumb: flash_logo.png
summary: |
Delphi's FlaSH group works to alert experts about data that suggests quality issues or changes in disease dynamics from the millions of data points they publish daily to improve the efficacy of Delphi's data.
output:
blogdown::html_page:
toc: true
---

Delphi publishes millions of public-health-related data points per day, including the total number of daily influenza cases, hospitalizations, and deaths per county and state in the United States (US). This data helps public health practitioners, data professionals, and members of the public make important, informed decisions relating to health and well-being.

Yet, as data volumes continue to grow quickly (Delphi's data volume expanded 1000x in just 3 years), it is infeasible for data reviewers to inspect every one of these data points for subtle changes in

* quality (like those resulting from data delays) or
* disease dynamics (like an outbreak).

These issues, if undetected, can have critical downstream ramifications on data users (as shown by the example in Fig 1).

![Fig 1. Data quality changes in case counts, shown by the large spikes in March and July 2022, when cases were trending down, resulted in similar spikes for predicted counts (red) from multiple forecasts that were then sent to the US CDC. A weekly forecast per state, for cases, hospitalizations, and deaths, up to 4 weeks in the future means that modeling teams would have to review 600 forecasts per week and may not have been able to catch the upstream data issue.](/blog/2024-01-01-flash-intro/forecast.jpg)


We care about finding data issues like these so that we can alert downstream data users accordingly. That is why our goal in the FlaSH team (Flagging Anomalies in Streams related to public Health) is to quickly identify data points that warrant human inspection and create tools to support data review. Towards this goal, our team of researchers, engineers, and data reviewers iterate on our deployed interdisciplinary approach. In this blog series, we will cover the different methods and perspectives of the FlaSH project.

Members: Ananya Joshi, Nolan Gormley, Richa Gadgil, Tina Townes \

Former Members: Luke Neurieter, Katie Mazaitis \

Advisors: Peter Jhon, Roni Rosenfeld, Bryan Wilder


37 changes: 37 additions & 0 deletions content/blog/2024-01-01-flash-intro.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
---
title: Introducing the FlaSH Group
author: Ananya Joshi, Nolan Gormley, Richa Gadgil, Tina Townes
date: 2024-01-01
tags:
- flash
authors:
- ananya
- nolan
- richa
- tina
heroImage: flash_long.png
heroImageThumb: flash_logo.png
summary: |
Delphi's FlaSH group works to alert experts about data that suggests quality issues or changes in disease dynamics from the millions of data points they publish daily to improve the efficacy of Delphi's data.
output:
blogdown::html_page:
toc: true
---



<p>Delphi publishes millions of public-health-related data points per day, including the total number of daily influenza cases, hospitalizations, and deaths per county and state in the United States (US). This data helps public health practitioners, data professionals, and members of the public make important, informed decisions relating to health and well-being.</p>
<p>Yet, as data volumes continue to grow quickly (Delphi’s data volume expanded 1000x in just 3 years), it is infeasible for data reviewers to inspect every one of these data points for subtle changes in</p>
<ul>
<li>quality (like those resulting from data delays) or</li>
<li>disease dynamics (like an outbreak).</li>
</ul>
<p>These issues, if undetected, can have critical downstream ramifications on data users (as shown by the example in Fig 1).</p>
<div class="float">
<img src="/blog/2024-01-01-flash-intro/forecast.jpg" alt="Fig 1. Data quality changes in case counts, shown by the large spikes in March and July 2022, when cases were trending down, resulted in similar spikes for predicted counts (red) from multiple forecasts that were then sent to the US CDC. A weekly forecast per state, for cases, hospitalizations, and deaths, up to 4 weeks in the future means that modeling teams would have to review 600 forecasts per week and may not have been able to catch the upstream data issue." />
<div class="figcaption">Fig 1. Data quality changes in case counts, shown by the large spikes in March and July 2022, when cases were trending down, resulted in similar spikes for predicted counts (red) from multiple forecasts that were then sent to the US CDC. A weekly forecast per state, for cases, hospitalizations, and deaths, up to 4 weeks in the future means that modeling teams would have to review 600 forecasts per week and may not have been able to catch the upstream data issue.</div>
</div>
<p>We care about finding data issues like these so that we can alert downstream data users accordingly. That is why our goal in the FlaSH team (Flagging Anomalies in Streams related to public Health) is to quickly identify data points that warrant human inspection and create tools to support data review. Towards this goal, our team of researchers, engineers, and data reviewers iterate on our deployed interdisciplinary approach. In this blog series, we will cover the different methods and perspectives of the FlaSH project.</p>
<p>Members: Ananya Joshi, Nolan Gormley, Richa Gadgil, Tina Townes  </p>
<p>Former Members: Luke Neurieter, Katie Mazaitis  </p>
<p>Advisors: Peter Jhon, Roni Rosenfeld, Bryan Wilder</p>
Binary file added content/blog/images/flash_logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/blog/images/flash_long.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/blog/2024-01-01-flash-intro/forecast.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.