The World According To Measurements - 22

Wooden Ships

I thought I would drop in and give an update on the status of building the new SQL database from the WORLD OCEAN DATABASE (WOD) datasets I recently downloaded.

I am still preparing the new dataset using the latest WOD data that was recently updated.

There is a lot of work involved in making the WOD data TEOS-10 compatible, mainly because TEOS-10 functionality can only be invoked properly if conductivity / salinity, temperature, and depth measurements are made concurrently:

"For an oceanographer, understanding the physical properties of sea water, including salinity and temperature, and depth are parameters that are critical for studying ocean processes. Luckily, oceanographers have an oceanographic instrument that does that very thing, and it’s called a CTD.

A CTD apparatus being lowered

A CTD is an acronym for sensor that measures conductivity (which can be used to determine salinity), temperature and depth. The instrument can be incorporated into a variety of observing platforms, including gliders, vertical profiling floats, fixed observing buoys, moored pods and vertical profiling rosettes.
...
CTD deployments, called casts, are the workhorses of instrument measurements. By knowing the conductivity, temperature and depth of a body of water, many other physical properties of seawater can be inferred. It is for this reason that the CTD is often a staple of oceanographic research cruises."

(CTD: The Workhorse of Oceanography, emphasis added). That quote is primarily absolute when one is doing thermodynamic types of work, rather than doing biological types of work.

Many casts and their subsequent data that are placed in the WOD are done in biological research, so they may not have temperature & salinity pairs in a cast.

At other times one or the other can malfunction resulting in recording only one or two of the required three measurements.

Realizing that, I parse each cast selecting only the measurements that can be used for thermodynamics a la TEOS-10.

Here is an example (1 of 8 WOD file types) of the parsing of casts my software does in order to extract only TEOS-10 compatible sets at up to 33 depth layers:

Processing file: APBO2005 (1 of 36)
346,231 casts processed (19,756,923 in situ measurements);
154,419 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (2,245 not used)

Processing file: APBO2007 (2 of 36)
261,266 casts processed (16,200,433 in situ measurements);
449,633 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (9,362 not used)

Processing file: APBO2008 (3 of 36)
254,145 casts processed (15,984,645 in situ measurements);
738,792 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBS2005 (4 of 36)
346,231 casts processed (11,473,818 in situ measurements);
248,375 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (5,226 not used)

Processing file: APBO2010 (5 of 36)
165,137 casts processed (12,141,483 in situ measurements);
884,496 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (2,665 not used)

Processing file: APBO2006 (6 of 36)
137,722 casts processed (10,585,613 in situ measurements);
87,025 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (113 not used)

Processing file: APBS2008 (7 of 36)
254,145 casts processed (9,590,204 in situ measurements);
1,386,286 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (149 not used)

Processing file: APBS2007 (8 of 36)
261,266 casts processed (9,169,282 in situ measurements);
709,498 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (9,795 not used)

Processing file: APBO2009 (9 of 36)
127,882 casts processed (8,779,947 in situ measurements);
837,207 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO2004 (10 of 36)
164,311 casts processed (7,562,141 in situ measurements);
45,518 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (37,807 not used)

Processing file: APBS2010 (11 of 36)
165,137 casts processed (6,215,167 in situ measurements);
1,311,389 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (1,902 not used)

Processing file: APBS2009 (12 of 36)
127,882 casts processed (5,434,867 in situ measurements);
1,427,845 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (248 not used)

Processing file: APBS2004 (13 of 36)
164,311 casts processed (4,745,861 in situ measurements);
109,613 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (55,909 not used)

Processing file: APBS2006 (14 of 36)
137,722 casts processed (4,511,642 in situ measurements);
119,716 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (282 not used)

Processing file: APBS1998 (15 of 36)
44,626 casts processed (5,696,807 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Processing file: APBS2011 (16 of 36)
61,909 casts processed (2,689,223 in situ measurements);
1,168,433 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (41,167 not used)

Processing file: APBO2011 (17 of 36)
61,909 casts processed (2,928,517 in situ measurements);
788,261 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (26,583 not used)

Processing file: APBS2012 (18 of 36)
51,589 casts processed (2,625,751 in situ measurements);
1,281,107 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (1,861 not used)

Processing file: APBS2014 (19 of 36)
44,671 casts processed (2,382,490 in situ measurements);
1,181,837 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (2,374 not used)

Processing file: APBO1998 (20 of 36)
44,626 casts processed (277,7548 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Processing file: APBO2012 (21 of 36)
51,589 casts processed (2,261,831 in situ measurements);
760,833 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO2014 (22 of 36)
44,671 casts processed (1,770,252 in situ measurements);
637,772 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (7,328 not used)

Processing file: APBS2015 (23 of 36)
30,680 casts processed (1,667,212 in situ measurements);
831,216 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (211 not used)

Processing file: APBS1997 (24 of 36)
19,875 casts processed (2,014,858 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Processing file: APBS2016 (25 of 36)
32,020 casts processed (1,522,535 in situ measurements);
755,755 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (3,254 not used)

Processing file: APBS2013 (26 of 36)
25,307 casts processed (1,269,668 in situ measurements);
617471 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (26 not used)

Processing file: APBS2017 (27 of 36)
27,180 casts processed (1,163,155 in situ measurements);
559,984 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (70 not used)

Processing file: APBO2016 (28 of 36)
32,020 casts processed (1,216,170 in situ measurements);
467,903 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO2015 (29 of 36)
30,680 casts processed (1,144,727 in situ measurements);
410,070 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (330 not used)

Processing file: APBO1997 (30 of 36)
19,875 casts processed (1,232,148 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Processing file: APBS1999 (31 of 36)
11,164 casts processed (1,297,228 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Processing file: APBS2018 (32 of 36)
20,003 casts processed (1,017,057 in situ measurements);
495,928 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (24 not used)

Processing file: APBO2013 (33 of 36)
25,307 casts processed (999,582 in situ measurements);
335,263 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO2017 (34 of 36)
27,180 casts processed (899,308 in situ measurements);
358,245 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO2018 (35 of 36)
20,003 casts processed (535,161 in situ measurements);
258,093 TEOS-10 (dual: 1 CT row + 1 S_A row) sets; (0 not used)

Processing file: APBO1999 (36 of 36)
11,164 casts processed (551,920 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 S_A row) sets;

Notice that a single cast can have from a few up to millions of in situ measurements.

Those measurements can be parsed to select only those applicable to one's special data needs (e.g. thermodynamic research or biological research).

It won't be long until I have finished loading the SQL server.

When that happens the first thing I want to do is to compare the WOD-2013 dataset to the WOD-2018 dataset, and then share the observations with readers.

The next post in this series is here, the previous post in this series is here.

---

Ode to politicians and sailors who have some things is common ...

---