Skip to content

Convert print statements to structured logging in covidcast acquisition #610

@krivard

Description

@krivard

Acquisition mostly logs using print(), which is difficult for Elastic to extract patterns from. If we replace more of these print()s with calls to the structured logger, we'll be able to more easily analyze how behavior of the acquisition system changes over time.

Limit this revision to src/acquisition/covidcast.

Things we already track (to serve as examples):

CSV upload:

  • Number of rows added, by source
  • Files imported, by source
  • Running time, by source

Metadata computation:

  • Total running time

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions