Tuesday, September 2, 2014

Will The Military Become The Police? - 8

I've been having some fun with the "1033" Pentagon program data.

It is in a .csv file that I downloaded from the internet.

It is a database concerning military hardware that has been given to various police departments around the nation.

Such as Ferguson, MO, as well as some 2,585 counties in every state in the United States.

It also includes DC, the Virgin Islands, Puerto Rico, and Guam.

(Your tax dollars at work converting the men in blue to the men in camouflage, the men in squad cars to the men in $733,000.00 dollar war zone equipment like the MRAP shown above.)

The information was not entered into the spread sheet or database with sufficient care, so I wrote some programs to clean it up.

There are 243,492 rows of data, with 8 columns or fields of information in each row.

Each row is one transaction where various types and amounts of military hardware were delivered to one of 2,585 counties in the U.S. and abroad.

The programs I wrote convert the comma delimited files into text, html, and SQL data.

Here is a log file for the processing of counties in the state of Texas:
Processed [EASTLAND] in [TX] (1, 1) in [32] secs
Processed [HARRISON] in [TX] (1, 2) in [1] secs
Processed [MEDINA] in [TX] (1, 3) in [1] secs
Processed [SMITH] in [TX] (1, 4) in [1] secs
Processed [CRANE] in [TX] (1, 5) in [1] secs
Processed [DELTA] in [TX] (1, 6) in [0] secs
Processed [REFUGIO] in [TX] (1, 7) in [10] secs
Processed [TOM_GREEN] in [TX] (1, 8) in [1] secs
Processed [CHILDRESS] in [TX] (1, 9) in [0] secs
Processed [MENARD] in [TX] (1, 10) in [0] secs
Processed [CHEROKEE] in [TX] (1, 11) in [1] secs
Processed [COMANCHE] in [TX] (1, 12) in [1] secs
Processed [SHELBY] in [TX] (1, 13) in [2] secs
Processed [BURLESON] in [TX] (1, 14) in [1] secs
Processed [GUADALUPE] in [TX] (1, 15) in [1] secs
Processed [FREESTONE] in [TX] (1, 16) in [4] secs
Processed [FALLS] in [TX] (1, 17) in [0] secs
Processed [COLEMAN] in [TX] (1, 18) in [1] secs
Processed [POLK] in [TX] (1, 19) in [1] secs
Processed [JASPER] in [TX] (1, 20) in [2] secs
Processed [BOWIE] in [TX] (1, 21) in [1] secs
Processed [LLANO] in [TX] (1, 22) in [3] secs
Processed [ANDERSON] in [TX] (1, 23) in [1] secs
Processed [HALL] in [TX] (1, 24) in [5] secs
Processed [HARTLEY] in [TX] (1, 25) in [0] secs
Processed [MONTGOMERY] in [TX] (1, 26) in [16] secs
Processed [SWISHER] in [TX] (1, 27) in [0] secs
Processed [ORANGE] in [TX] (1, 28) in [0] secs
Processed [ANGELINA] in [TX] (1, 29) in [11] secs
Processed [KAUFMAN] in [TX] (1, 30) in [2] secs
Processed [ECTOR] in [TX] (1, 31) in [11] secs
Processed [UPSHUR] in [TX] (1, 32) in [2] secs
Processed [GRIMES] in [TX] (1, 33) in [0] secs
Processed [KNOX] in [TX] (1, 34) in [1] secs
Processed [PARMER] in [TX] (1, 35) in [0] secs
Processed [CROSBY] in [TX] (1, 36) in [0] secs
Processed [WILLIAMSON] in [TX] (1, 37) in [61] secs
Processed [COOKE] in [TX] (1, 38) in [0] secs
Processed [MATAGORDA] in [TX] (1, 39) in [4] secs
Processed [TITUS] in [TX] (1, 40) in [3] secs
Processed [DALLAS] in [TX] (1, 41) in [24] secs
Processed [FOARD] in [TX] (1, 42) in [1] secs
Processed [VAL_VERDE] in [TX] (1, 43) in [3] secs
Processed [CALHOUN] in [TX] (1, 44) in [1] secs
Processed [MONTAGUE] in [TX] (1, 45) in [10] secs
Processed [KLEBERG] in [TX] (1, 46) in [1] secs
Processed [SHERMAN] in [TX] (1, 47) in [1] secs
Processed [DALLAM] in [TX] (1, 48) in [6] secs
Processed [HUDSPETH] in [TX] (1, 49) in [1] secs
Processed [RED_RIVER] in [TX] (1, 50) in [0] secs
Processed [BREWSTER] in [TX] (1, 51) in [0] secs
Processed [GRAYSON] in [TX] (1, 52) in [0] secs
Processed [GRAY] in [TX] (1, 53) in [0] secs
Processed [LIMESTONE] in [TX] (1, 54) in [1] secs
Processed [MADISON] in [TX] (1, 55) in [0] secs
Processed [DE_WITT] in [TX] (1, 56) in [1] secs
Processed [BURNET] in [TX] (1, 57) in [1] secs
Processed [BLANCO] in [TX] (1, 58) in [0] secs
Processed [SCHLEICHER] in [TX] (1, 59) in [1] secs
Processed [HARRIS] in [TX] (1, 60) in [80] secs
Processed [NUECES] in [TX] (1, 61) in [0] secs
Processed [PECOS] in [TX] (1, 62) in [32] secs
Processed [BAILEY] in [TX] (1, 63) in [0] secs
Processed [TYLER] in [TX] (1, 64) in [34] secs
Processed [TRAVIS] in [TX] (1, 65) in [73] secs
Processed [SAN_JACINTO] in [TX] (1, 66) in [0] secs
Processed [HIDALGO] in [TX] (1, 67) in [113] secs
Processed [DENTON] in [TX] (1, 68) in [5] secs
Processed [MAVERICK] in [TX] (1, 69) in [1] secs
Processed [VICTORIA] in [TX] (1, 70) in [6] secs
Processed [BROWN] in [TX] (1, 71) in [0] secs
Processed [CAMERON] in [TX] (1, 72) in [6] secs
Processed [RANDALL] in [TX] (1, 73) in [1] secs
Processed [LAMPASAS] in [TX] (1, 74) in [0] secs
Processed [WOOD] in [TX] (1, 75) in [1] secs
Processed [JOHNSON] in [TX] (1, 76) in [9] secs
Processed [DONLEY] in [TX] (1, 77) in [0] secs
Processed [BRISCOE] in [TX] (1, 78) in [0] secs
Processed [VAN_ZANDT] in [TX] (1, 79) in [2] secs
Processed [WEBB] in [TX] (1, 80) in [5] secs
Processed [PALO_PINTO] in [TX] (1, 81) in [10] secs
Processed [FRANKLIN] in [TX] (1, 82) in [1] secs
Processed [REEVES] in [TX] (1, 83) in [0] secs
Processed [LA_SALLE] in [TX] (1, 84) in [2] secs
Processed [BANDERA] in [TX] (1, 85) in [0] secs
Processed [STARR] in [TX] (1, 86) in [6] secs
Processed [COLLIN] in [TX] (1, 87) in [12] secs
Processed [BRAZORIA] in [TX] (1, 88) in [4] secs
Processed [NACOGDOCHES] in [TX] (1, 89) in [1] secs
Processed [AUSTIN] in [TX] (1, 90) in [2] secs
Processed [WISE] in [TX] (1, 91) in [1] secs
Processed [LAVACA] in [TX] (1, 92) in [2] secs
Processed [TAYLOR] in [TX] (1, 93) in [3] secs
Processed [ANDREWS] in [TX] (1, 94) in [0] secs
Processed [HUNT] in [TX] (1, 95) in [8] secs
Processed [HARDEMAN] in [TX] (1, 96) in [0] secs
Processed [RUSK] in [TX] (1, 97) in [2] secs
Processed [UVALDE] in [TX] (1, 98) in [0] secs
Processed [PANOLA] in [TX] (1, 99) in [1] secs
Processed [GREGG] in [TX] (1, 100) in [8] secs
Processed [MORRIS] in [TX] (1, 101) in [1] secs
Processed [HANSFORD] in [TX] (1, 102) in [3] secs
Processed [JONES] in [TX] (1, 103) in [0] secs
Processed [ARMSTRONG] in [TX] (1, 104) in [0] secs
Processed [HILL] in [TX] (1, 105) in [3] secs
Processed [COMAL] in [TX] (1, 106) in [6] secs
Processed [LAMB] in [TX] (1, 107) in [0] secs
Processed [BASTROP] in [TX] (1, 108) in [19] secs
Processed [MARTIN] in [TX] (1, 109) in [0] secs
Processed [HAYS] in [TX] (1, 110) in [49] secs
Processed [HOOD] in [TX] (1, 111) in [1] secs
Processed [JEFFERSON] in [TX] (1, 112) in [13] secs
Processed [LUBBOCK] in [TX] (1, 113) in [2] secs
Processed [JACK] in [TX] (1, 114) in [0] secs
Processed [SUTTON] in [TX] (1, 115) in [0] secs
Processed [MCLENNAN] in [TX] (1, 116) in [4] secs
Processed [SABINE] in [TX] (1, 117) in [1] secs
Processed [HALE] in [TX] (1, 118) in [1] secs
Processed [HENDERSON] in [TX] (1, 119) in [17] secs
Processed [PARKER] in [TX] (1, 120) in [1] secs
Processed [FAYETTE] in [TX] (1, 121) in [2] secs
Processed [BOSQUE] in [TX] (1, 122) in [0] secs
Processed [TRINITY] in [TX] (1, 123) in [5] secs
Processed [RUNNELS] in [TX] (1, 124) in [0] secs
Processed [HARDIN] in [TX] (1, 125) in [3] secs
Processed [MILLS] in [TX] (1, 126) in [0] secs
Processed [CAMP] in [TX] (1, 127) in [0] secs
Processed [WARD] in [TX] (1, 128) in [1] secs
Processed [HUTCHINSON] in [TX] (1, 129) in [0] secs
Processed [BELL] in [TX] (1, 130) in [4] secs
Processed [LIBERTY] in [TX] (1, 131) in [0] secs
Processed [ROCKWALL] in [TX] (1, 132) in [1] secs
Processed [SAN_PATRICIO] in [TX] (1, 133) in [3] secs
Processed [KENT] in [TX] (1, 134) in [0] secs
Processed [BRAZOS] in [TX] (1, 135) in [4] secs
Processed [ATASCOSA] in [TX] (1, 136) in [0] secs
Processed [HOPKINS] in [TX] (1, 137) in [1] secs
Processed [BORDEN] in [TX] (1, 138) in [0] secs
Processed [CALLAHAN] in [TX] (1, 139) in [0] secs
Processed [TARRANT] in [TX] (1, 140) in [16] secs
Processed [GALVESTON] in [TX] (1, 141) in [6] secs
Processed [COLORADO] in [TX] (1, 142) in [1] secs
Processed [JEFF_DAVIS] in [TX] (1, 143) in [0] secs
Processed [MIDLAND] in [TX] (1, 144) in [4] secs
Processed [PRESIDIO] in [TX] (1, 145) in [0] secs
Processed [YOUNG] in [TX] (1, 146) in [2] secs
Processed [CASS] in [TX] (1, 147) in [4] secs
Processed [TERRELL] in [TX] (1, 148) in [0] secs
Processed [LEE] in [TX] (1, 149) in [1] secs
Processed [EL_PASO] in [TX] (1, 150) in [134] secs
Processed [BEXAR] in [TX] (1, 151) in [20] secs
Processed [NAVARRO] in [TX] (1, 152) in [3] secs
Processed [MOTLEY] in [TX] (1, 153) in [2] secs
Processed [SHACKELFORD] in [TX] (1, 154) in [0] secs
Processed [GONZALES] in [TX] (1, 155) in [2] secs
Processed [ZAVALA] in [TX] (1, 156) in [0] secs
Processed [STEPHENS] in [TX] (1, 157) in [2] secs
Processed [DUVAL] in [TX] (1, 158) in [1] secs
Processed [ELLIS] in [TX] (1, 159) in [3] secs
Processed [FLOYD] in [TX] (1, 160) in [0] secs
Processed [ARCHER] in [TX] (1, 161) in [0] secs
Processed [POTTER] in [TX] (1, 162) in [3] secs
Processed [WICHITA] in [TX] (1, 163) in [45] secs
Processed [FORT_BEND] in [TX] (1, 164) in [1] secs
Processed [CALDWELL] in [TX] (1, 165) in [2] secs
Processed [FANNIN] in [TX] (1, 166) in [1] secs
Processed [ROBERTSON] in [TX] (1, 167) in [0] secs
Processed [GARZA] in [TX] (1, 168) in [1] secs
The name of each county where military equipment was sent is listed, the state, which state in the list of 54 "states" it represents (TX=1) number of counties in that state which got military equipment (168), and the amount of time to load, clean, and insert into the SQL database (x secs).

One thing I noticed right away is that the longer it took to process a particular county, the more equipment that was sent to that county, and hence the more militarized police in those counties will tend to be.

Once I get it all worked out I plan to make a condensed report based on queries to the SQL database.

I will share the results with Dredd Blog readers.

Back to work on it now ...

Hope you all had a nice labor day weekend.

The next post in this series is here, the previous post in this series is here.

1 comment:

  1. Officer Friendly is out to kill us!

    Tom

    ReplyDelete