ctddump: CTD data summary reports
Summary reports produced by the ctddump pipeline, one page per
(region, product) unit. Pick a report from the sidebar.
Observation order: when the converted files are merged
(ctddump concat convert), each profile’s observations are sorted by
increasing pressure and renumbered in that order, and observations without
a pressure value are dropped. Every count on these pages is taken from data
in that order. See
Row order and numbering.
Regions in this build: arctic baltic mediterranean.
Generated on 2026-11-12 from summary.
Arctic Ocean: Near Real Time, regional product (AR)
Regional Near Real Time product. Each source file holds a single platform.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/nrt_ar_ar.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 204 | |
| with TEMP | 203 | 99.5% |
| with PSAL | 194 | 95.1% |
| with PRES | 202 | 99.0% |
| with DEPH | 2 | 1.0% |
| with TIME_QC | 204 | 100.0% |
| with POSITION_QC | 195 | 95.6% |
| Extra parameters | CDOM, CHLT, CNDC, DENS, DOX1, DOX2, FLU2, LGH4, OSAT, SIGT, SVEL, TUR4 |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/nrt_ar_ar.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 204 |
| Profiles | 358,350 |
| Observations | 93,203,306 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 55,624,509 | 59.7% | 0 | 0.0% | 36,896,497 | 39.6% | 682,300 | 0.7% |
| Salinity | 55,103,366 | 59.1% | 0 | 0.0% | 36,857,318 | 39.5% | 1,242,622 | 1.3% |
| Pressure | 56,306,687 | 60.4% | 0 | 0.0% | 36,896,619 | 39.6% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/nrt_ar_ar.summary.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 358,351 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 0 | 0.0% |
| of which reversed | 0 | 0.0% |
| of which non-monotonic | 0 | 0.0% |
| Platforms with such profiles | 0 | 0.0% |
| Files with such profiles | 0 | 0.0% |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/nrt_ar_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 204 | 100.0% | 0.0% |
| Profiles | 356,113 | 99.4% | 0.6% |
| Observations | 92,976,531 | 99.8% | 0.2% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/nrt_ar_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 194 | 95.1% | 4.9% |
| Profiles | 346,212 | 96.6% | 3.4% |
| Observations | 87,016,103 | 93.4% | 6.6% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/nrt_ar_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 191 | 93.6% | 6.4% |
| Profiles | 306,091 | 85.4% | 14.6% |
| Observations | 80,667,512 | 86.6% | 13.4% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -179.987 | -179.987 |
| Longitude max | 179.998 | 179.998 |
| Latitude min | 60.000 | -74.355 |
| Latitude max | 89.984 | 89.984 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/nrt_ar_ar.parquet.tsv - File:
output/dedup/markdup/nrt_ar_ar.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 191 | 93.6% | 6.4% | 191 | 100.0% | 0.0% |
| Profiles | 306,091 | 85.4% | 14.6% | 306,091 | 100.0% | 0.0% |
| Observations | 80,667,512 | 86.6% | 13.4% | 80,667,512 | 100.0% | 0.0% |
| Duplicate profiles | 17,578 | 4.9% | 306,091 | 5.7% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 4,267 | |
| Duplicate profiles | 12,520 | 71.2% |
| Platforms | 116 | |
| Observations | 1,908,495 | 60.8% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 2,376 | |
| Duplicate profiles | 5,058 | 28.8% |
| Platforms | 22 | |
| Observations | 1,230,506 | 39.2% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 5,315 | 10,630 | 60.5% |
| 3 | 503 | 1,509 | 8.6% |
| 4 | 291 | 1,164 | 6.6% |
| 5 | 182 | 910 | 5.2% |
| 6 | 76 | 456 | 2.6% |
| 7 | 66 | 462 | 2.6% |
| 8 | 44 | 352 | 2.0% |
| 9 | 37 | 333 | 1.9% |
| 10 | 29 | 290 | 1.6% |
| 11+ | 100 | 1,472 | 8.4% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/nrt_ar_ar.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 191 | 93.6% | 6.4% | 191 | 100.0% | 0.0% |
| Profiles | 295,156 | 82.4% | 17.6% | 306,091 | 96.4% | 3.6% |
| Observations | 79,134,055 | 84.9% | 15.1% | 80,667,512 | 98.1% | 1.9% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/ar_nrt_vs_cora.tsv - File:
report/compare/ar_nrt_vs_gl.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 191 |
| Profiles | 295,156 |
| Profiles without a key | 0 |
| Observations | 79,134,055 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| cora_ar | 180 | 94.2% | 233,161 | 79.0% | 229,734 | 3,427 | 98.5% |
| nrt_ar_gl | 0 | 0.0% | 0 | 0.0% | 0 | 0 |
Arctic Ocean: Near Real Time, global product (GL)
Global (GL) Near Real Time product restricted to this region’s bounding box. It overlaps the regional product, so a profile can appear in both and duplicates are expected.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/nrt_ar_gl.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 560 | |
| with TEMP | 552 | 98.6% |
| with PSAL | 552 | 98.6% |
| with PRES | 350 | 62.5% |
| with DEPH | 380 | 67.9% |
| with TIME_QC | 560 | 100.0% |
| with POSITION_QC | 560 | 100.0% |
| Extra parameters | ALK3, ALKY, C13D, C14D, CDOM, CFC11, CFC113, CFC12, CHLT, CNDC, CPHL, DOX1, DOX2, DOXY, EWCT, FLU2, FLUO, HCDT, HCSP, HELD, HELM, LGH4, LGHT, NEON, NSCT, NTAW, NTRA, NTRI, NTRZ, NTZW, O18D, OSAT, PCO2, PHOS, PHOW, PHPH, SECC, SLCA, SLCW, SSAL, SVEL, TCO2, TRANSMISSIVITY, TRIW, TUR2, TUR3, TUR4, TUR6 |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/nrt_ar_gl.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 560 |
| Profiles | 737,465 |
| Observations | 279,465,196 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 239,474,284 | 85.7% | 0 | 0.0% | 39,988,103 | 14.3% | 2,809 | 0.0% |
| Salinity | 239,473,480 | 85.7% | 0 | 0.0% | 39,988,103 | 14.3% | 3,613 | 0.0% |
| Pressure | 240,916,360 | 86.2% | 0 | 0.0% | 38,548,836 | 13.8% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/nrt_ar_gl.summary.tsv - File:
report/convert/checkpres/nrt_ar_gl.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 753,991 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 15,836 | 2.1% |
| of which reversed | 420 | 0.1% |
| of which non-monotonic | 15,416 | 2.0% |
| Platforms with such profiles | 30 | 5.4% |
| Files with such profiles | 30 | 5.4% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| FNCM | 7,930 | 45.7% | 128 | 7,802 | 2000-01-01 | 2023-04-17 |
| FNIN | 2,679 | 56.9% | 21 | 2,658 | 2012-01-26 | 2022-05-16 |
| FMCY | 2,200 | 20.1% | 75 | 2,125 | 2015-01-12 | 2022-02-10 |
| FNFP | 1,086 | 6.2% | 196 | 890 | 1997-09-03 | 2026-02-12 |
| FABB | 984 | 11.8% | 0 | 984 | 2014-05-24 | 2019-05-25 |
| FNOY | 226 | 5.6% | 0 | 226 | 1972-02-21 | 1977-12-15 |
| SNGH | 203 | 6.7% | 0 | 203 | 2010-02-10 | 2015-10-19 |
| CGBV | 167 | 2.1% | 0 | 167 | 1971-05-10 | 1990-10-10 |
| CGDG | 70 | 0.4% | 0 | 70 | 1974-03-31 | 1998-06-06 |
| MJPX9 | 41 | 1.2% | 0 | 41 | 1997-08-12 | 2007-05-12 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/nrt_ar_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 559 | 99.8% | 0.2% |
| Profiles | 718,324 | 97.4% | 2.6% |
| Observations | 273,240,627 | 97.8% | 2.2% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/nrt_ar_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 550 | 98.2% | 1.8% |
| Profiles | 673,421 | 91.3% | 8.7% |
| Observations | 263,333,066 | 94.2% | 5.8% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/nrt_ar_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 545 | 97.3% | 2.7% |
| Profiles | 202,832 | 27.5% | 72.5% |
| Observations | 58,186,068 | 20.8% | 79.2% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -179.980 | -179.999 |
| Longitude max | 179.999 | 180.000 |
| Latitude min | 60.000 | -78.638 |
| Latitude max | 90.000 | 90.000 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/nrt_ar_gl.parquet.tsv - File:
output/dedup/markdup/nrt_ar_gl.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 545 | 97.3% | 2.7% | 545 | 100.0% | 0.0% |
| Profiles | 202,832 | 27.5% | 72.5% | 202,832 | 100.0% | 0.0% |
| Observations | 58,186,068 | 20.8% | 79.2% | 58,186,068 | 100.0% | 0.0% |
| Duplicate profiles | 56,663 | 7.7% | 202,832 | 27.9% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 14,629 | |
| Duplicate profiles | 30,957 | 54.6% |
| Platforms | 179 | |
| Observations | 11,543,875 | 70.4% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 12,683 | |
| Duplicate profiles | 25,706 | 45.4% |
| Platforms | 97 | |
| Observations | 4,861,757 | 29.6% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 26,210 | 52,420 | 92.5% |
| 3 | 804 | 2,412 | 4.3% |
| 4 | 160 | 640 | 1.1% |
| 5 | 42 | 210 | 0.4% |
| 6 | 25 | 150 | 0.3% |
| 7 | 14 | 98 | 0.2% |
| 8 | 12 | 96 | 0.2% |
| 9 | 6 | 54 | 0.1% |
| 10 | 3 | 30 | 0.1% |
| 11+ | 36 | 553 | 1.0% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/nrt_ar_gl.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 538 | 96.1% | 3.9% | 545 | 98.7% | 1.3% |
| Profiles | 173,481 | 23.5% | 76.5% | 202,832 | 85.5% | 14.5% |
| Observations | 50,392,172 | 18.0% | 82.0% | 58,186,068 | 86.6% | 13.4% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/ar_gl_vs_cora.tsv - File:
report/compare/ar_nrt_vs_gl.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 538 |
| Profiles | 173,481 |
| Profiles without a key | 0 |
| Observations | 50,392,172 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| cora_ar | 517 | 96.1% | 134,994 | 77.8% | 132,487 | 2,507 | 98.1% |
| nrt_ar_ar | 0 | 0.0% | 0 | 0.0% | 0 | 0 |
Arctic Ocean: CORA reanalysis
CORA delayed-mode reanalysis. Source files hold many platforms each, and the profiles are re-processed rather than near real time.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/cora_ar.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 20,975 | |
| with TEMP | 20,975 | 100.0% |
| with PSAL | 20,963 | 99.9% |
| with PRES | 17,402 | 83.0% |
| with DEPH | 20,817 | 99.2% |
| with TIME_QC | 20,975 | 100.0% |
| with POSITION_QC | 20,975 | 100.0% |
| Extra parameters | none |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/cora_ar.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 767 |
| Profiles | 499,801 |
| Observations | 137,477,306 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 137,477,306 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Salinity | 137,477,306 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Pressure | 137,477,306 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/cora_ar.summary.tsv - File:
report/convert/checkpres/cora_ar.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 502,841 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 2,234 | 0.4% |
| of which reversed | 21 | 0.0% |
| of which non-monotonic | 2,213 | 0.4% |
| Platforms with such profiles | 21 | 2.7% |
| Files with such profiles | 2,222 | 10.6% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| 68412 | 2,137 | 17.9% | 21 | 2,116 | 1953-04-09 | 1990-12-31 |
| CGDG | 18 | 0.9% | 0 | 18 | 1977-09-13 | 1987-08-28 |
| DBFP | 18 | 0.3% | 0 | 18 | 1984-11-12 | 1989-10-10 |
| EXIC0003 | 14 | 2.7% | 0 | 14 | 1978-07-26 | 1978-10-05 |
| DBLK | 9 | 0.2% | 0 | 9 | 1984-08-01 | 1997-08-02 |
| LMBG | 9 | 10.1% | 0 | 9 | 2008-08-12 | 2008-08-22 |
| UKKN | 6 | 14.6% | 0 | 6 | 1961-03-23 | 1961-04-09 |
| TFJA | 4 | 0.2% | 0 | 4 | 1996-11-01 | 2004-11-21 |
| UKUR | 3 | 6.1% | 0 | 3 | 1960-09-08 | 1960-12-29 |
| EXO10539 | 2 | 1.6% | 0 | 2 | 1964-04-04 | 1965-09-04 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/cora_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 762 | 99.3% | 0.7% |
| Profiles | 488,111 | 97.7% | 2.3% |
| Observations | 135,042,918 | 98.2% | 1.8% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/cora_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 758 | 98.8% | 1.2% |
| Profiles | 482,823 | 96.6% | 3.4% |
| Observations | 134,395,969 | 97.8% | 2.2% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/cora_ar.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 758 | 98.8% | 1.2% |
| Profiles | 482,823 | 96.6% | 3.4% |
| Observations | 134,395,969 | 97.8% | 2.2% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -179.987 | -179.987 |
| Longitude max | 179.999 | 179.999 |
| Latitude min | 60.000 | 60.000 |
| Latitude max | 89.998 | 89.998 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/cora_ar.parquet.tsv - File:
output/dedup/markdup/cora_ar.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 758 | 98.8% | 1.2% | 758 | 100.0% | 0.0% |
| Profiles | 482,823 | 96.6% | 3.4% | 482,823 | 100.0% | 0.0% |
| Observations | 134,395,969 | 97.8% | 2.2% | 134,395,969 | 100.0% | 0.0% |
| Duplicate profiles | 133,090 | 26.6% | 482,823 | 27.6% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 16,900 | |
| Duplicate profiles | 38,610 | 29.0% |
| Platforms | 252 | |
| Observations | 11,766,181 | 29.7% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 46,234 | |
| Duplicate profiles | 94,480 | 71.0% |
| Platforms | 347 | |
| Observations | 27,817,760 | 70.3% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 60,054 | 120,108 | 90.2% |
| 3 | 1,977 | 5,931 | 4.5% |
| 4 | 470 | 1,880 | 1.4% |
| 5 | 207 | 1,035 | 0.8% |
| 6 | 97 | 582 | 0.4% |
| 7 | 70 | 490 | 0.4% |
| 8 | 65 | 520 | 0.4% |
| 9 | 52 | 468 | 0.4% |
| 10 | 30 | 300 | 0.2% |
| 11+ | 112 | 1,776 | 1.3% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/cora_ar.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 747 | 97.4% | 2.6% | 758 | 98.5% | 1.5% |
| Profiles | 412,867 | 82.6% | 17.4% | 482,823 | 85.5% | 14.5% |
| Observations | 117,998,376 | 85.8% | 14.2% | 134,395,969 | 87.8% | 12.2% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/ar_gl_vs_cora.tsv - File:
report/compare/ar_nrt_vs_cora.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 747 |
| Profiles | 412,867 |
| Profiles without a key | 0 |
| Observations | 117,998,376 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| nrt_ar_ar | 180 | 24.1% | 233,161 | 56.5% | 229,734 | 3,427 | 98.5% |
| nrt_ar_gl | 517 | 69.2% | 134,994 | 32.7% | 132,487 | 2,507 | 98.1% |
Baltic Sea: Near Real Time, regional product (BO)
Regional Near Real Time product. Each source file holds a single platform.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/nrt_bo_bo.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 753 | |
| with TEMP | 753 | 100.0% |
| with PSAL | 753 | 100.0% |
| with PRES | 576 | 76.5% |
| with DEPH | 177 | 23.5% |
| with TIME_QC | 753 | 100.0% |
| with POSITION_QC | 461 | 61.2% |
| Extra parameters | DOX1, FLU2, LGHT, SVEL, TUR4 |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/nrt_bo_bo.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 753 |
| Profiles | 113,277 |
| Observations | 9,392,800 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 9,392,800 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Salinity | 9,392,799 | 100.0% | 1 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Pressure | 9,392,800 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/nrt_bo_bo.summary.tsv - File:
report/convert/checkpres/nrt_bo_bo.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 113,277 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 2,405 | 2.1% |
| of which reversed | 0 | 0.0% |
| of which non-monotonic | 2,405 | 2.1% |
| Platforms with such profiles | 98 | 13.0% |
| Files with such profiles | 98 | 13.0% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| DMU413 | 87 | 44.4% | 0 | 87 | 1992-02-10 | 2009-09-17 |
| DMU403 | 84 | 47.5% | 0 | 84 | 1992-02-11 | 2009-09-16 |
| DMU954 | 84 | 47.7% | 0 | 84 | 1992-02-20 | 2009-09-14 |
| DMU925 | 83 | 46.1% | 0 | 83 | 1992-02-18 | 2009-09-16 |
| DMU935 | 83 | 51.2% | 0 | 83 | 1993-09-29 | 2009-09-15 |
| DMU905 | 82 | 49.4% | 0 | 82 | 1992-02-11 | 2009-09-16 |
| DMU939 | 82 | 45.1% | 0 | 82 | 1993-04-29 | 2009-09-15 |
| DMU418 | 62 | 44.9% | 0 | 62 | 1994-01-10 | 2009-09-17 |
| VSJ10003 | 60 | 10.3% | 0 | 60 | 1990-03-12 | 2006-04-20 |
| DMU1007 | 57 | 42.2% | 0 | 57 | 1994-07-12 | 2009-09-16 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/nrt_bo_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 753 | 100.0% | 0.0% |
| Profiles | 107,375 | 94.8% | 5.2% |
| Observations | 8,590,343 | 91.5% | 8.5% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/nrt_bo_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 748 | 99.3% | 0.7% |
| Profiles | 105,200 | 92.9% | 7.1% |
| Observations | 8,569,834 | 91.2% | 8.8% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/nrt_bo_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 748 | 99.3% | 0.7% |
| Profiles | 105,200 | 92.9% | 7.1% |
| Observations | 8,569,834 | 91.2% | 8.8% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | 6.300 | 6.300 |
| Longitude max | 27.453 | 27.453 |
| Latitude min | 54.000 | 54.000 |
| Latitude max | 65.730 | 65.730 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/nrt_bo_bo.parquet.tsv - File:
output/dedup/markdup/nrt_bo_bo.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 748 | 99.3% | 0.7% | 748 | 100.0% | 0.0% |
| Profiles | 105,200 | 92.9% | 7.1% | 105,200 | 100.0% | 0.0% |
| Observations | 8,569,834 | 91.2% | 8.8% | 8,569,834 | 100.0% | 0.0% |
| Duplicate profiles | 28,773 | 25.4% | 105,200 | 27.4% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 3,079 | |
| Duplicate profiles | 6,280 | 21.8% |
| Platforms | 139 | |
| Observations | 256,911 | 16.5% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 6,760 | |
| Duplicate profiles | 22,493 | 78.2% |
| Platforms | 106 | |
| Observations | 1,298,937 | 83.5% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 5,825 | 11,650 | 40.5% |
| 3 | 1,801 | 5,403 | 18.8% |
| 4 | 884 | 3,536 | 12.3% |
| 5 | 572 | 2,860 | 9.9% |
| 6 | 367 | 2,202 | 7.7% |
| 7 | 208 | 1,456 | 5.1% |
| 8 | 75 | 600 | 2.1% |
| 9 | 48 | 432 | 1.5% |
| 10 | 39 | 390 | 1.4% |
| 11+ | 20 | 244 | 0.8% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/nrt_bo_bo.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 741 | 98.4% | 1.6% | 748 | 99.1% | 0.9% |
| Profiles | 86,266 | 76.2% | 23.8% | 105,200 | 82.0% | 18.0% |
| Observations | 7,734,361 | 82.3% | 17.7% | 8,569,834 | 90.3% | 9.7% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/bo_nrt_vs_cora.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 741 |
| Profiles | 86,266 |
| Profiles without a key | 0 |
| Observations | 7,734,361 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| cora_bo | 454 | 61.3% | 49,646 | 57.5% | 48,934 | 712 | 98.6% |
Baltic Sea: CORA reanalysis
CORA delayed-mode reanalysis. Source files hold many platforms each, and the profiles are re-processed rather than near real time.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/cora_bo.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 12,482 | |
| with TEMP | 12,482 | 100.0% |
| with PSAL | 12,482 | 100.0% |
| with PRES | 12,473 | 99.9% |
| with DEPH | 11,973 | 95.9% |
| with TIME_QC | 12,482 | 100.0% |
| with POSITION_QC | 12,482 | 100.0% |
| Extra parameters | none |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/cora_bo.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 907 |
| Profiles | 230,250 |
| Observations | 19,103,053 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 18,604,396 | 97.4% | 0 | 0.0% | 0 | 0.0% | 498,657 | 2.6% |
| Salinity | 18,604,396 | 97.4% | 0 | 0.0% | 0 | 0.0% | 498,657 | 2.6% |
| Pressure | 18,604,396 | 97.4% | 0 | 0.0% | 0 | 0.0% | 498,657 | 2.6% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/cora_bo.summary.tsv - File:
report/convert/checkpres/cora_bo.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 234,621 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 4,264 | 1.8% |
| of which reversed | 1 | 0.0% |
| of which non-monotonic | 4,263 | 1.8% |
| Platforms with such profiles | 245 | 27.0% |
| Files with such profiles | 1,218 | 9.8% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| 58GD | 263 | 4.1% | 0 | 263 | 2020-03-07 | 2022-11-30 |
| OWPB | 228 | 40.3% | 0 | 228 | 2002-02-04 | 2004-11-20 |
| SNGH | 203 | 6.7% | 0 | 203 | 2010-02-10 | 2015-10-19 |
| OXBH | 169 | 31.6% | 0 | 169 | 2020-02-28 | 2022-11-16 |
| OHLV | 110 | 1.6% | 0 | 110 | 2006-05-03 | 2020-08-14 |
| DMU413 | 87 | 44.4% | 0 | 87 | 1992-02-10 | 2009-09-17 |
| DMU403 | 84 | 47.5% | 0 | 84 | 1992-02-11 | 2009-09-16 |
| DMU954 | 84 | 47.7% | 0 | 84 | 1992-02-20 | 2009-09-14 |
| DMU925 | 83 | 46.1% | 0 | 83 | 1992-02-18 | 2009-09-16 |
| DMU935 | 83 | 51.2% | 0 | 83 | 1993-09-29 | 2009-09-15 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/cora_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 640 | 70.6% | 29.4% |
| Profiles | 188,780 | 82.0% | 18.0% |
| Observations | 17,100,067 | 89.5% | 10.5% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/cora_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 639 | 70.5% | 29.5% |
| Profiles | 187,257 | 81.3% | 18.7% |
| Observations | 17,024,499 | 89.1% | 10.9% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/cora_bo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 639 | 70.5% | 29.5% |
| Profiles | 187,257 | 81.3% | 18.7% |
| Observations | 17,024,499 | 89.1% | 10.9% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | 8.000 | 8.000 |
| Longitude max | 29.447 | 29.447 |
| Latitude min | 53.333 | 53.333 |
| Latitude max | 65.808 | 65.808 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/cora_bo.parquet.tsv - File:
output/dedup/markdup/cora_bo.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 639 | 70.5% | 29.5% | 639 | 100.0% | 0.0% |
| Profiles | 187,257 | 81.3% | 18.7% | 187,257 | 100.0% | 0.0% |
| Observations | 17,024,499 | 89.1% | 10.9% | 17,024,499 | 100.0% | 0.0% |
| Duplicate profiles | 54,505 | 23.7% | 187,257 | 29.1% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 11,095 | |
| Duplicate profiles | 23,898 | 43.8% |
| Platforms | 178 | |
| Observations | 1,942,749 | 49.7% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 11,479 | |
| Duplicate profiles | 30,607 | 56.2% |
| Platforms | 277 | |
| Observations | 1,966,436 | 50.3% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 18,594 | 37,188 | 68.2% |
| 3 | 1,807 | 5,421 | 9.9% |
| 4 | 899 | 3,596 | 6.6% |
| 5 | 520 | 2,600 | 4.8% |
| 6 | 367 | 2,202 | 4.0% |
| 7 | 180 | 1,260 | 2.3% |
| 8 | 83 | 664 | 1.2% |
| 9 | 45 | 405 | 0.7% |
| 10 | 27 | 270 | 0.5% |
| 11+ | 52 | 899 | 1.6% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/cora_bo.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 631 | 69.6% | 30.4% | 639 | 98.7% | 1.3% |
| Profiles | 155,326 | 67.5% | 32.5% | 187,257 | 82.9% | 17.1% |
| Observations | 15,179,626 | 79.5% | 20.5% | 17,024,499 | 89.2% | 10.8% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/bo_nrt_vs_cora.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 631 |
| Profiles | 155,326 |
| Profiles without a key | 0 |
| Observations | 15,179,626 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| nrt_bo_bo | 454 | 71.9% | 49,646 | 32.0% | 48,934 | 712 | 98.6% |
Mediterranean Sea: Near Real Time, regional product (MO)
Regional Near Real Time product. Each source file holds a single platform.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/nrt_mo_mo.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 79 | |
| with TEMP | 47 | 59.5% |
| with PSAL | 79 | 100.0% |
| with PRES | 79 | 100.0% |
| with DEPH | 1 | 1.3% |
| with TIME_QC | 79 | 100.0% |
| with POSITION_QC | 79 | 100.0% |
| Extra parameters | AMON, BCCW, CNDC, CPHL, DENS, DOX1, DOX2, DOXY, FLU2, LGH4, LGHT, NRAD, NTRZ, PHOS, POTENTIAL_TEMP, SLCA, TUR3, TUR4 |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/nrt_mo_mo.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 10 |
| Profiles | 1,652 |
| Observations | 363,495 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 311,648 | 85.7% | 0 | 0.0% | 0 | 0.0% | 51,847 | 14.3% |
| Salinity | 363,495 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Pressure | 363,495 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/nrt_mo_mo.summary.tsv - File:
report/convert/checkpres/nrt_mo_mo.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 1,655 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 29 | 1.8% |
| of which reversed | 0 | 0.0% |
| of which non-monotonic | 29 | 1.8% |
| Platforms with such profiles | 2 | 20.0% |
| Files with such profiles | 2 | 2.5% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| 29SO | 27 | 2.5% | 0 | 27 | 2015-11-28 | 2017-07-03 |
| EABV | 2 | 0.8% | 0 | 2 | 2014-05-27 | 2014-11-27 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/nrt_mo_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 10 | 100.0% | 0.0% |
| Profiles | 1,652 | 100.0% | 0.0% |
| Observations | 363,495 | 100.0% | 0.0% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/nrt_mo_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 9 | 90.0% | 10.0% |
| Profiles | 1,615 | 97.8% | 2.2% |
| Observations | 311,633 | 85.7% | 14.3% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/nrt_mo_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 9 | 90.0% | 10.0% |
| Profiles | 1,593 | 96.4% | 3.6% |
| Observations | 309,803 | 85.2% | 14.8% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -3.204 | -3.204 |
| Longitude max | 26.933 | 26.933 |
| Latitude min | 33.658 | 0.000 |
| Latitude max | 41.669 | 41.669 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/nrt_mo_mo.parquet.tsv - File:
output/dedup/markdup/nrt_mo_mo.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 9 | 90.0% | 10.0% | 9 | 100.0% | 0.0% |
| Profiles | 1,593 | 96.4% | 3.6% | 1,593 | 100.0% | 0.0% |
| Observations | 309,803 | 85.2% | 14.8% | 309,803 | 100.0% | 0.0% |
| Duplicate profiles | 58 | 3.5% | 1,593 | 3.6% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 15 | |
| Duplicate profiles | 37 | 63.8% |
| Platforms | 4 | |
| Observations | 14,972 | 87.5% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 10 | |
| Duplicate profiles | 21 | 36.2% |
| Platforms | 2 | |
| Observations | 2,136 | 12.5% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 18 | 36 | 62.1% |
| 3 | 6 | 18 | 31.0% |
| 4 | 1 | 4 | 6.9% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/nrt_mo_mo.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 9 | 90.0% | 10.0% | 9 | 100.0% | 0.0% |
| Profiles | 1,560 | 94.4% | 5.6% | 1,593 | 97.9% | 2.1% |
| Observations | 303,868 | 83.6% | 16.4% | 309,803 | 98.1% | 1.9% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/mo_nrt_vs_cora.tsv - File:
report/compare/mo_nrt_vs_gl.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 9 |
| Profiles | 1,560 |
| Profiles without a key | 0 |
| Observations | 303,868 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| cora_mo | 9 | 100.0% | 1,403 | 89.9% | 1,387 | 16 | 98.9% |
| nrt_mo_gl | 0 | 0.0% | 0 | 0.0% | 0 | 0 |
Mediterranean Sea: Near Real Time, global product (GL)
Global (GL) Near Real Time product restricted to this region’s bounding box. It overlaps the regional product, so a profile can appear in both and duplicates are expected.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/nrt_mo_gl.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 187 | |
| with TEMP | 185 | 98.9% |
| with PSAL | 179 | 95.7% |
| with PRES | 114 | 61.0% |
| with DEPH | 155 | 82.9% |
| with TIME_QC | 187 | 100.0% |
| with POSITION_QC | 186 | 99.5% |
| Extra parameters | ALK3, ALKY, C13D, C14D, CDOM, CF3W, CFC11, CFC12, CHLT, CNDC, CPHL, DOX1, DOX2, DOXY, EWCT, FLU2, FLUO, HCDT, HCSP, HELD, HELM, HELW, LGH4, LGHT, NEON, NEOW, NSCT, NTAW, NTRA, NTRI, NTRZ, NTZW, OSAT, PCO2, PHOS, PHOW, PHPH, SLCA, SLCW, SSAL, SVEL, TCO2, TRANSMISSIVITY, TRIW, TUR2, TUR3, TUR4, TUR5, TUR6 |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/nrt_mo_gl.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 187 |
| Profiles | 415,974 |
| Observations | 167,629,126 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 166,573,227 | 99.4% | 0 | 0.0% | 689,675 | 0.4% | 366,224 | 0.2% |
| Salinity | 166,740,690 | 99.5% | 0 | 0.0% | 689,675 | 0.4% | 198,761 | 0.1% |
| Pressure | 167,599,516 | 100.0% | 0 | 0.0% | 29,610 | 0.0% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/nrt_mo_gl.summary.tsv - File:
report/convert/checkpres/nrt_mo_gl.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 433,306 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 26,229 | 6.1% |
| of which reversed | 634 | 0.1% |
| of which non-monotonic | 25,595 | 5.9% |
| Platforms with such profiles | 34 | 18.2% |
| Files with such profiles | 34 | 18.2% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| FGTO | 8,933 | 55.2% | 140 | 8,793 | 2004-09-09 | 2025-10-17 |
| FNCM | 7,930 | 45.7% | 128 | 7,802 | 2000-01-01 | 2023-04-17 |
| FNIN | 2,679 | 56.9% | 21 | 2,658 | 2012-01-26 | 2022-05-16 |
| FMCY | 2,200 | 20.1% | 75 | 2,125 | 2015-01-12 | 2022-02-10 |
| FKJB | 1,413 | 39.9% | 72 | 1,341 | 1997-07-12 | 2023-01-11 |
| FNFP | 1,086 | 6.2% | 196 | 890 | 1997-09-03 | 2026-02-12 |
| FABB | 984 | 11.8% | 0 | 984 | 2014-05-24 | 2019-05-25 |
| FNOY | 226 | 5.6% | 0 | 226 | 1972-02-21 | 1977-12-15 |
| FITA | 163 | 5.8% | 0 | 163 | 1972-01-19 | 1993-01-14 |
| FZVN | 119 | 2.0% | 2 | 117 | 1981-04-07 | 2012-03-11 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/nrt_mo_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 187 | 100.0% | 0.0% |
| Profiles | 405,663 | 97.5% | 2.5% |
| Observations | 164,518,957 | 98.1% | 1.9% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/nrt_mo_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 178 | 95.2% | 4.8% |
| Profiles | 373,274 | 89.7% | 10.3% |
| Observations | 155,370,568 | 92.7% | 7.3% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/nrt_mo_gl.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 177 | 94.7% | 5.3% |
| Profiles | 87,018 | 20.9% | 79.1% |
| Observations | 32,475,568 | 19.4% | 80.6% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -5.610 | -180.000 |
| Longitude max | 35.567 | 180.000 |
| Latitude min | 28.378 | -77.893 |
| Latitude max | 45.755 | 86.550 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/nrt_mo_gl.parquet.tsv - File:
output/dedup/markdup/nrt_mo_gl.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 177 | 94.7% | 5.3% | 177 | 100.0% | 0.0% |
| Profiles | 87,018 | 20.9% | 79.1% | 87,018 | 100.0% | 0.0% |
| Observations | 32,475,568 | 19.4% | 80.6% | 32,475,568 | 100.0% | 0.0% |
| Duplicate profiles | 20,085 | 4.8% | 87,018 | 23.1% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 3,454 | |
| Duplicate profiles | 14,292 | 71.2% |
| Platforms | 69 | |
| Observations | 2,536,786 | 49.7% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 2,641 | |
| Duplicate profiles | 5,793 | 28.8% |
| Platforms | 52 | |
| Observations | 2,570,753 | 50.3% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 4,487 | 8,974 | 44.7% |
| 3 | 220 | 660 | 3.3% |
| 4 | 137 | 548 | 2.7% |
| 5 | 72 | 360 | 1.8% |
| 6 | 93 | 558 | 2.8% |
| 7 | 165 | 1,155 | 5.8% |
| 8 | 853 | 6,824 | 34.0% |
| 9 | 13 | 117 | 0.6% |
| 10 | 20 | 200 | 1.0% |
| 11+ | 35 | 689 | 3.4% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/nrt_mo_gl.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 175 | 93.6% | 6.4% | 177 | 98.9% | 1.1% |
| Profiles | 73,028 | 17.6% | 82.4% | 87,018 | 83.9% | 16.1% |
| Observations | 29,862,720 | 17.8% | 82.2% | 32,475,568 | 92.0% | 8.0% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/mo_gl_vs_cora.tsv - File:
report/compare/mo_nrt_vs_gl.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 175 |
| Profiles | 73,028 |
| Profiles without a key | 0 |
| Observations | 29,862,720 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| cora_mo | 171 | 97.7% | 65,702 | 90.0% | 63,890 | 1,812 | 97.2% |
| nrt_mo_mo | 0 | 0.0% | 0 | 0.0% | 0 | 0 |
Mediterranean Sea: CORA reanalysis
CORA delayed-mode reanalysis. Source files hold many platforms each, and the profiles are re-processed rather than near real time.
File summary
Coverage of the core measurement variables and the two profile-level QC flags across the source NetCDF files. A file counts as having one if the variable is present, regardless of how many of its values are valid. “Extra parameters” lists the non-core variables seen in any file.
- File:
report/header/cora_mo.yaml.tsv
| Metric | Count | % of files |
|---|---|---|
| Files | 7,905 | |
| with TEMP | 7,905 | 100.0% |
| with PSAL | 7,904 | 100.0% |
| with PRES | 7,849 | 99.3% |
| with DEPH | 7,869 | 99.5% |
| with TIME_QC | 7,905 | 100.0% |
| with POSITION_QC | 7,905 | 100.0% |
| Extra parameters | none |
Conversion
Counts after converting the source NetCDF files to Parquet and merging them into one file. The merge sorts each profile’s observations by increasing pressure and drops observations without a pressure value (a profile with no pressure at all is dropped with them); no other profile is dropped yet. These are the “original” numbers every later stage is compared against.
- File:
report/convert/cora_mo.parquet.tsv
| Metric | Count |
|---|---|
| Platforms | 195 |
| Profiles | 93,575 |
| Observations | 33,243,462 |
Data mode
Observations per data mode for each parameter: real-time (R), adjusted in real time (A), or delayed mode (D), as recorded in the source files. Percentages are shares of all observations. Unknown counts observations with no data mode: a fill value in the source file, a file without data-mode information, or a parameter the file does not have.
| Parameter | Real-time (R) | % R | Adjusted (A) | % A | Delayed mode (D) | % D | Unknown | % Unknown |
|---|---|---|---|---|---|---|---|---|
| Temperature | 33,243,462 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Salinity | 33,243,462 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
| Pressure | 33,243,462 | 100.0% | 0 | 0.0% | 0 | 0.0% | 0 | 0.0% |
Pressure order
Checks, before the merge, that pressure increases along each profile in the order the source file stores it. A profile is counted when its pressure steps down between two observations; missing pressures are skipped and a repeated pressure is fine. “Reversed” profiles are stored from the bottom up, which the merge’s sort by pressure puts right; “non-monotonic” ones go both up and down, which can mean loops, spikes or misplaced levels, and the sort hides them. Shares are of the profiles, platforms and files checked; profiles without any pressure are not checked (the merge drops them). Nothing is removed here.
- File:
report/convert/checkpres/cora_mo.summary.tsv - File:
report/convert/checkpres/cora_mo.platforms.tsv
| Metric | Count | Share |
|---|---|---|
| Profiles checked | 100,158 | |
| Profiles without pressure (not checked) | 0 | |
| Profiles with decreasing pressure | 14,579 | 14.6% |
| of which reversed | 223 | 0.2% |
| of which non-monotonic | 14,356 | 14.3% |
| Platforms with such profiles | 25 | 12.8% |
| Files with such profiles | 566 | 7.2% |
Platforms
The platforms with the most such profiles, at most 10; the full list, and every profile with its time and position, are in the checkpres reports.
| Platform | Profiles | % of its profiles | Reversed | Non-monotonic | First | Last |
|---|---|---|---|---|---|---|
| FGTO | 4,964 | 47.5% | 69 | 4,895 | 2004-09-09 | 2023-03-08 |
| FNCM | 4,555 | 53.0% | 3 | 4,552 | 2017-01-27 | 2020-10-19 |
| FMCY | 2,200 | 77.5% | 75 | 2,125 | 2015-01-12 | 2022-02-10 |
| FKJB | 1,413 | 40.6% | 72 | 1,341 | 1997-07-12 | 2023-01-11 |
| FABB | 642 | 14.1% | 0 | 642 | 2016-03-23 | 2018-05-13 |
| FNOY | 178 | 35.4% | 0 | 178 | 1972-02-21 | 1975-03-10 |
| FITA | 156 | 18.1% | 0 | 156 | 1972-01-19 | 1985-06-01 |
| FZVN | 115 | 5.2% | 0 | 115 | 1981-04-07 | 1992-04-26 |
| OCL0179 | 112 | 26.0% | 0 | 112 | 1986-07-10 | 1998-11-10 |
| FZGD | 51 | 69.9% | 0 | 51 | 1975-01-25 | 1975-12-22 |
Cleaning
Stages that drop whole profiles that are unusable or out of scope. They run in the order below, each on the output of the previous one, so the counts fall monotonically.
Drop bad QC
Drops whole profiles whose profile-level quality flags are bad. A profile is kept only if both its time and position QC are good (flag 1) or absent. Many files ship no profile-level QC, and those profiles are kept.
- File:
report/clean/dropqc/cora_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 193 | 99.0% | 1.0% |
| Profiles | 81,928 | 87.6% | 12.4% |
| Observations | 32,366,521 | 97.4% | 2.6% |
Drop all-NA profiles
Drops whole profiles that carry no valid measurement at all in any one of temperature, salinity, or pressure. A profile is kept only if each of the three has at least one valid observation.
- File:
report/clean/dropna/cora_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 183 | 93.8% | 6.2% |
| Profiles | 78,553 | 83.9% | 16.1% |
| Observations | 31,859,184 | 95.8% | 4.2% |
Filter by region
Keeps only the profiles whose position falls inside the region’s bounding box. A profile with a missing position counts as outside and is dropped.
- File:
report/clean/filter/cora_mo.parquet.tsv
| Metric | Count | % of original | Deleted |
|---|---|---|---|
| Platforms | 183 | 93.8% | 6.2% |
| Profiles | 78,542 | 83.9% | 16.1% |
| Observations | 31,856,266 | 95.8% | 4.2% |
Bounding box
Geographic extent of the profiles that survived the filter, in decimal degrees. The “Original” column, when present, is the extent of the converted data before any cleaning stage ran, so the two columns show how much the bounding box tightened. Profiles with a missing position are ignored.
| Metric | Filtered | Original |
|---|---|---|
| Longitude min | -5.610 | -5.610 |
| Longitude max | 35.567 | 36.280 |
| Latitude min | 28.378 | 28.378 |
| Latitude max | 45.755 | 45.755 |
Deduplication
Stages that find and remove profiles measuring the same time and place. Profiles match on date and rounded longitude/latitude. The platform is not part of the key, so duplicates are found across platforms as well as within one.
Mark duplicates
Flags every profile that shares its (date, position) key with at least one other. Nothing is removed here, so the counts match the previous stage; “Duplicate profiles” is the pool the next stage picks a survivor from.
- File:
report/dedup/markdup/cora_mo.parquet.tsv - File:
output/dedup/markdup/cora_mo.dups.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 183 | 93.8% | 6.2% | 183 | 100.0% | 0.0% |
| Profiles | 78,542 | 83.9% | 16.1% | 78,542 | 100.0% | 0.0% |
| Observations | 31,856,266 | 95.8% | 4.2% | 31,856,266 | 100.0% | 0.0% |
| Duplicate profiles | 11,772 | 12.6% | 78,542 | 15.0% |
Duplicates within a platform
Duplicate groups whose profiles all carry the same platform code: one platform reporting the same cast more than once. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 2,466 | |
| Duplicate profiles | 6,115 | 51.9% |
| Platforms | 71 | |
| Observations | 2,521,844 | 50.2% |
Duplicates across platforms
Duplicate groups whose profiles carry two or more different platform codes: the same cast reaching the archive under more than one platform, typically via overlapping products. Percentages are shares of all duplicate profiles.
| Metric | Count | % of duplicates |
|---|---|---|
| Duplicate groups | 2,580 | |
| Duplicate profiles | 5,657 | 48.1% |
| Platforms | 53 | |
| Observations | 2,501,114 | 49.8% |
Duplicate group sizes
How many profiles each duplicate group holds. A group of 2 is a cast recorded twice; larger groups are the same cast repeated more often. Sizes above 10 are pooled into the final row.
| Profiles per group | Groups | Profiles | % of duplicates |
|---|---|---|---|
| 2 | 4,597 | 9,194 | 78.1% |
| 3 | 191 | 573 | 4.9% |
| 4 | 86 | 344 | 2.9% |
| 5 | 25 | 125 | 1.1% |
| 6 | 38 | 228 | 1.9% |
| 7 | 20 | 140 | 1.2% |
| 8 | 25 | 200 | 1.7% |
| 9 | 8 | 72 | 0.6% |
| 10 | 19 | 190 | 1.6% |
| 11+ | 37 | 706 | 6.0% |
Remove duplicates
Keeps one profile per duplicate key and drops the rest. The survivor is the profile with the most observations, with ties broken by first appearance. Profiles with no key (missing time or position) are never treated as duplicates and always survive.
- File:
report/dedup/dedup/cora_mo.parquet.tsv
| Metric | Count | % of original | Deleted | Cleaned | % of cleaned | Deleted (cleaned) |
|---|---|---|---|---|---|---|
| Platforms | 181 | 92.8% | 7.2% | 183 | 98.9% | 1.1% |
| Profiles | 71,816 | 76.7% | 23.3% | 78,542 | 91.4% | 8.6% |
| Observations | 29,329,436 | 88.2% | 11.8% | 31,856,266 | 92.1% | 7.9% |
Comparison
How this product compares with the other products covering the same region. Each other product is measured with this one as the reference: how many of this product’s platforms and profiles it also holds, with profiles matched on date and rounded longitude/latitude. Coverage is one-directional, so a product that contains this one covers it fully while this one covers only part of it.
- File:
report/compare/mo_gl_vs_cora.tsv - File:
report/compare/mo_nrt_vs_cora.tsv
This product
This product’s own totals, the denominators the coverage below is measured against. “Profiles without a key” have a missing time or position, so they can never be matched and are counted against coverage.
| Metric | Count |
|---|---|
| Platforms | 181 |
| Profiles | 71,816 |
| Profiles without a key | 0 |
| Observations | 29,329,436 |
Coverage of other products
One row per other product. “Platform coverage” is the share of this product’s platforms the other also has; “Profile coverage” the share of its profiles. Among the profiles found in both, “Same obs” carry the same number of observations in each product and “Diff obs” differ, which separates the same profiles cleaned differently from genuinely different ones; “Obs agreement” is the share of matched profiles that are the same.
| Compared with | Common platforms | Platform coverage | Matched profiles | Profile coverage | Same obs | Diff obs | Obs agreement |
|---|---|---|---|---|---|---|---|
| nrt_mo_gl | 171 | 94.5% | 65,702 | 91.5% | 63,890 | 1,812 | 97.2% |
| nrt_mo_mo | 9 | 5.0% | 1,403 | 2.0% | 1,387 | 16 | 98.9% |