Skip to content

Add a backup fastpath to be used as fallback on submission failure #412

@LDiazN

Description

@LDiazN

When a measurement submission fails, we send it straight into S3. This usually happens during incidents, and it's a good worst-case scenario but it requires reprocessing the missing data.

A better best-effort thing for this kind of situation is to fall back to a second fastpath

In this context, the requires tasks are the following:

  • Consolidate the fastpath as a module in terraform, so we can duplicate it
  • Add a second fastpath to the infrastructure, properly set up and ready to accept measurements. Make sure that the collector_id in this fastpath is different to the original one
  • Change the submission logic in the ooniprobe service to fallback to the second fastpath if it fails
  • Change the OTHER_COLLECTORS env variable in oonimeasurements to also include the second fastpath. This is important to support real-time serving of measurements from the spool dir

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions