Skip to content

Add 3W Dataset overview: sensor availability and cleaning impact - #217

Open
GabrielRozo123 wants to merge 2 commits into
petrobras:new_3w_datasets_overviewsfrom
GabrielRozo123:new_3w_datasets_overviews
Open

GabrielRozo123 wants to merge 2 commits into
petrobras:new_3w_datasets_overviewsfrom
GabrielRozo123:new_3w_datasets_overviews

Conversation

@GabrielRozo123

Copy link
Copy Markdown

What this adds

A new dataset overview notebook at dataset/demos/GabrielRozo/main.ipynb that quantifies how often each process sensor is actually available across the 3W Dataset, broken down by event class.

Key findings

  • Several sensors (P-JUS-BS, P-MON-CKGL, P-MON-SDV-P, PT-P, QBS) are effectively never recorded in the sampled events.
  • A small, reliable backbone exists (P-PDG, P-TPT, P-MON-CKP), present in most events of most classes.
  • Sensor availability is class-dependent, for example, P-JUS-CKP and T-MON-CKP appear almost only in classes 5 and 6 which suggests detection models cannot assume a fixed feature set across events.

Method & reproducibility

Availability is measured as the fraction of non-missing readings per sensor, averaged over a fixed random sample of events per class (fixed seed). During the analysis, the toolkit's CleanSignals step produced run-dependent column selections for the same event, so the overview relies on the raw, deterministic missing-data fraction instead.

CLA

I have read and agree to the Contributor License Agreement (ICLA) and the Code of Conduct.

@ricardoevvargas

Copy link
Copy Markdown
Collaborator

Hi, @GabrielRozo123.

Thank you for submitting this overview, which will be reviewed as soon as possible.

@ricardoevvargas ricardoevvargas added documentation Improvements or additions to documentation good first issue Good for newcomers self-contained Changes have no impact on resources outside PR labels Sep 24, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation good first issue Good for newcomers self-contained Changes have no impact on resources outside PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants