In BigQuery: missing derived tables in "mimiciv_2_2/mimiciv_3_1"

[arielhasidim]

Missing tables:

• rrt
• colloid
• sapsii
• sofa
• urine_output_rate
• urine_output
• ventilation
• ventilator_setting
• vitalsigns
• weight_durations
• phenylephrine
• vasopressin

Relevant for:

• mimiciv_2_2_derived
• mimiciv_3_1_derived

But does exist for:

• mimiciv_derived (see _metadata bellow)

[vinhteq]

When I pull the MIMIC-IV dataset into BigQuery, I only see mimiciv_3_1_derived (and the tables that you listed above are missing as noted above). How do I get mimiciv_derived within BigQuery? The instructions on physionet get me only the 3.1 (and the note there says that mimiciv is a mirror of 3.1)

[cloverbunny]

Bumping this post up as we hope to use the previous derived ventilation details for a project, thanks! Or is there an easy way to load in an older version in Bigquery? Tagging @alistairewj :bat-signal:

[cloverbunny]

Sorry I'm inpatient so also tagging @tompollard =D

[tompollard]

I'm ashamed to say that @alistairewj is a far better choice for this, even though he left our team several years ago! MIMIC isn't currently funded, so there is nobody really maintaining resources like the derived content, other than Alistair in his free time. I'll try to take a look but probably not until mid next week.

[cloverbunny]

Thank you guys for your service!~ 🙇‍♀️

[alistairewj]

I just checked and it's fairly simple, the bq pagination stopped the copy from mimiciv_derived to mimiciv_3_1_derived

this means the full data is available on mimiciv_derived, just not copied over

@tompollard pr fix - #1947
we'd need to do a new release for the change to propagate to bq