Thursday, December 6, 2018

The World According To Measurements - 22

Wooden Ships
I thought I would drop in and give an update on the status of building the new SQL database from the WORLD OCEAN DATABASE (WOD) datasets I recently downloaded.

I am still preparing the new dataset using the latest WOD data that was recently updated.

There is a lot of work involved in making the WOD data TEOS-10 compatible, mainly because TEOS-10 functionality can only be invoked properly if conductivity / salinity, temperature, and depth measurements are made concurrently:
"For an oceanographer, understanding the physical properties of sea water, including salinity and temperature, and depth are parameters that are critical for studying ocean processes. Luckily, oceanographers have an oceanographic instrument that does that very thing, and it’s called a CTD.
A CTD apparatus being lowered

A CTD is an acronym for sensor that measures conductivity (which can be used to determine salinity), temperature and depth. The instrument can be incorporated into a variety of observing platforms, including gliders, vertical profiling floats, fixed observing buoys, moored pods and vertical profiling rosettes.
...
CTD deployments, called casts, are the workhorses of instrument measurements. By knowing the conductivity, temperature and depth of a body of water, many other physical properties of seawater can be inferred. It is for this reason that the CTD is often a staple of oceanographic research cruises."
(CTD: The Workhorse of Oceanography, emphasis added). That quote is primarily absolute when one is doing thermodynamic types of work, rather than doing biological types of work.

Many casts and their subsequent data that are placed in the WOD are done in biological research, so they may not have temperature & salinity pairs in a cast.

At other times one or the other can malfunction resulting in recording only one or two of the required three measurements.

Realizing that, I parse each cast selecting only the measurements that can be used for thermodynamics a la TEOS-10.

Here is an example (1 of 8 WOD file types) of the parsing of casts my software does in order to extract only TEOS-10 compatible sets at up to 33 depth layers:
Processing file: APBO2005 (1 of 36)
346,231 casts processed (19,756,923 in situ measurements);
154,419 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (2,245 not used)

Processing file: APBO2007 (2 of 36)
261,266 casts processed (16,200,433 in situ measurements);
449,633 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (9,362 not used)

Processing file: APBO2008 (3 of 36)
254,145 casts processed (15,984,645 in situ measurements);
738,792 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBS2005 (4 of 36)
346,231 casts processed (11,473,818 in situ measurements);
248,375 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (5,226 not used)

Processing file: APBO2010 (5 of 36)
165,137 casts processed (12,141,483 in situ measurements);
884,496 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (2,665 not used)

Processing file: APBO2006 (6 of 36)
137,722 casts processed (10,585,613 in situ measurements);
87,025 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (113 not used)

Processing file: APBS2008 (7 of 36)
254,145 casts processed (9,590,204 in situ measurements);
1,386,286 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (149 not used)

Processing file: APBS2007 (8 of 36)
261,266 casts processed (9,169,282 in situ measurements);
709,498 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (9,795 not used)

Processing file: APBO2009 (9 of 36)
127,882 casts processed (8,779,947 in situ measurements);
837,207 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO2004 (10 of 36)
164,311 casts processed (7,562,141 in situ measurements);
45,518 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (37,807 not used)

Processing file: APBS2010 (11 of 36)
165,137 casts processed (6,215,167 in situ measurements);
1,311,389 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (1,902 not used)

Processing file: APBS2009 (12 of 36)
127,882 casts processed (5,434,867 in situ measurements);
1,427,845 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (248 not used)

Processing file: APBS2004 (13 of 36)
164,311 casts processed (4,745,861 in situ measurements);
109,613 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (55,909 not used)

Processing file: APBS2006 (14 of 36)
137,722 casts processed (4,511,642 in situ measurements);
119,716 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (282 not used)

Processing file: APBS1998 (15 of 36)
44,626 casts processed (5,696,807 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;

Processing file: APBS2011 (16 of 36)
61,909 casts processed (2,689,223 in situ measurements);
1,168,433 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (41,167 not used)

Processing file: APBO2011 (17 of 36)
61,909 casts processed (2,928,517 in situ measurements);
788,261 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (26,583 not used)

Processing file: APBS2012 (18 of 36)
51,589 casts processed (2,625,751 in situ measurements);
1,281,107 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (1,861 not used)

Processing file: APBS2014 (19 of 36)
44,671 casts processed (2,382,490 in situ measurements);
1,181,837 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (2,374 not used)

Processing file: APBO1998 (20 of 36)
44,626 casts processed (277,7548 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;

Processing file: APBO2012 (21 of 36)
51,589 casts processed (2,261,831 in situ measurements);
760,833 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO2014 (22 of 36)
44,671 casts processed (1,770,252 in situ measurements);
637,772 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (7,328 not used)

Processing file: APBS2015 (23 of 36)
30,680 casts processed (1,667,212 in situ measurements);
831,216 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (211 not used)

Processing file: APBS1997 (24 of 36)
19,875 casts processed (2,014,858 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;

Processing file: APBS2016 (25 of 36)
32,020 casts processed (1,522,535 in situ measurements);
755,755 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (3,254 not used)

Processing file: APBS2013 (26 of 36)
25,307 casts processed (1,269,668 in situ measurements);
617471 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (26 not used)

Processing file: APBS2017 (27 of 36)
27,180 casts processed (1,163,155 in situ measurements);
559,984 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (70 not used)

Processing file: APBO2016 (28 of 36)
32,020 casts processed (1,216,170 in situ measurements);
467,903 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO2015 (29 of 36)
30,680 casts processed (1,144,727 in situ measurements);
410,070 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (330 not used)

Processing file: APBO1997 (30 of 36)
19,875 casts processed (1,232,148 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;

Processing file: APBS1999 (31 of 36)
11,164 casts processed (1,297,228 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;

Processing file: APBS2018 (32 of 36)
20,003 casts processed (1,017,057 in situ measurements);
495,928 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (24 not used)

Processing file: APBO2013 (33 of 36)
25,307 casts processed (999,582 in situ measurements);
335,263 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO2017 (34 of 36)
27,180 casts processed (899,308 in situ measurements);
358,245 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO2018 (35 of 36)
20,003 casts processed (535,161 in situ measurements);
258,093 TEOS-10 (dual: 1 CT row + 1 SA row) sets; (0 not used)

Processing file: APBO1999 (36 of 36)
11,164 casts processed (551,920 in situ measurements);
0 TEOS-10 (dual: 1 CT row + 1 SA row) sets;
Notice that a single cast can have from a few up to millions of in situ measurements.

Those measurements can be parsed to select only those applicable to one's special data needs (e.g. thermodynamic research or biological research).

It won't be long until I have finished loading the SQL server.

When that happens the first thing I want to do is to compare the WOD-2013 dataset to the WOD-2018 dataset, and then share the observations with readers.

The next post in this series is here, the previous post in this series is here.

Ode to politicians and sailors who have some things is common ...



Monday, December 3, 2018

New World Odor

RIP President Bush I
One who spoke of the "new world order" and "a kinder, gentler, nation"  passed away recently (President George H.W. Bush).

Our current replacement criticized President Bush for saying that.

Our current president who would rather have a "new world odor" and a meaner, despotic nation instead of a new world order, is climate change denier in chief, The "only I can do it" Don (The Shapeshifters of Bullshitistan, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15).

President Bush (RIP) was president when Dr. James Hansen, in 1988, revealed the dangerous waters ahead of us due to civilization's use of fossil fuels.

The reaction President Bush had was to work with congress to pass a law that I have blogged about (Government Climate Change Report, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11).

The latest report (Fourth National Climate Assessment) is out now:
"Since we first understood climate change in the 1970s from studying Venus’ and Earth’s atmospheres in detail, humans in the developed world have been too slow, too stupid and too late."
(New Government Report On Climate Change -- Will It Matter?). The "Forbes" contributor does not seem to think it will matter (Sarah Huckabee Sanders: Climate change report 'not based on facts').

Anyway, in the first post of that series about that law I wrote:
"The report's focus was mandated by legislation of the U.S. Congress, and was signed into law by President George H. W. Bush in 1990.

The law specified that major reports were to be produced periodically (Global Climate Change Research Act).

A recent Dredd Blog post (Oil-Qaeda: The Indictment) indicates that Oil-Qaeda soon thereafter began to spend mega-bucks to deceive the public about global warming induced climate change.

Oil-Qaeda started the global warming denier movement to deny that global warming is caused by the use of fossil fuels which are now known to be "addictive." [see also Smoke & Fumes]"
(Government Climate Change Report, ~6 yrs ago). What has happened to the GOP in the years since is obvious to a few (Once Upon A Time In The West - 2).

Historically, this is the path taken in some 26 earlier civilizations where a minority of the populace becomes demented, then follows a demented leader into tyranny:
But always TCS is primarily the population segment diagnosed as a despotic minority which the once most-often-quoted historian, Toynbee, fingered as one of the members of the trinity of extinction that he found in all civilizations that were about to become very successful at becoming extinct:
That something is the dementia that produces and ends up in suicide:
"In other words, a society does not ever die 'from natural causes', but always dies from suicide or murder --- and nearly always from the former, as this chapter has shown."
(A Study of History, by Arnold J. Toynbee). There is no cure for the final symptom of that group dementia, there is only prevention by way of avoiding it altogether in the first place.

The components of that group dementia were pointed out in an encyclopedia piece concerning that historian quoted above:
"In the Study Toynbee examined the rise and fall of 26 civilizations in the course of human history, and he concluded that they rose by responding successfully to challenges under the leadership of creative minorities composed of elite leaders. Civilizations declined when their leaders stopped responding creatively, and the civilizations then sank owing to the sins of nationalism, militarism, and the tyranny of a despotic minority. Unlike Spengler in his The Decline of the West, Toynbee did not regard the death of a civilization as inevitable, for it may or may not continue to respond to successive challenges. Unlike Karl Marx, he saw history as shaped by spiritual, not economic forces" ...
(Encyclopedia Britannica, emphasis added). The show stopper, in terms of remedy, in this type of group dementia is that it is a contagious dementia.
(Etiology of Social Dementia - 18). That particular "minority" is not a racial or ethnic minority, rather, it is primarily composed of a destructive suicidal trance (Choose Your Trances Carefully, 2, 3, 4, 5, 6, 7, 8).
(Arrested Development: The Creep State). Our culture is composed, now, of the toxins of power that habitually destroy nations and civilizations (Hypothesis: The Cultural Amygdala - 2).
(When You Are Governed By Psychopaths - 8; cf. How To Identify The Despotic Minority).

A new world order would be better than a new world odor.

"They say everything can be replaced ..."