Correlation set update

* overrides.conf: Latest source data corrections from
script-assisted research.

These remaining files are generated data. Normally they're not
something I feel good about committing into version control, but in
this case it allows for logging and tracking deltas in the data over
time...

* airports: Removed 18 airports corresponding to nonexistent
stations.

* stations: Removed 326 stations with no recent conditions, added
429.

* zones: Removed 45 zones with no recent forecasts, added 104.

* places, zctas: Based on latest Census Bureau data corrections,
updated with new correlations.

* overrides.log: Record of correlation set build.

* slist, zlist: State of active stations and weather zones at the
time of generation.
This commit is contained in:
Jeremy Stanley
2016-10-05 01:06:27 +00:00
parent a33dd24ec1
commit 840b91b4fd
10 changed files with 102614 additions and 110389 deletions

100
airports
View File

@@ -1,20 +1,20 @@
# Copyright (c) 2006-2014 Jeremy Stanley <fungi@yuggoth.org>. Permission to
# Copyright (c) 2006-2016 Jeremy Stanley <fungi@yuggoth.org>. Permission to
# use, copy, modify, and distribute this software is granted under terms
# provided in the LICENSE file distributed with this software.
#
# generated by weather on 2014-11-10 from these public domain sources:
# generated by weather on 2016-10-04 from these public domain sources:
#
# http://www.census.gov/geo/maps-data/data/gazetteer2014.html
# 6a7af64ddfa89fc276aaf6793567c9cd 2014-07-28 2014_Gaz_counties_national.zip
# 37ebebca082ef099147b5d8e2119b18d 2014-07-28 2014_Gaz_cousubs_national.zip
# f319845358951aa73f870bffa67f299f 2014-07-28 2014_Gaz_place_national.zip
# 0d012b742b9001cf2d1b92be4a0a2974 2014-07-28 2014_Gaz_zcta_national.zip
# http://www.census.gov/geo/maps-data/data/gazetteer2015.html
# 6ce9ebdecb92182a7e3882bc09c5f352 2015-08-11 2015_Gaz_counties_national.zip
# 92d61a96ace60d4844f2a9b69057332e 2015-08-11 2015_Gaz_cousubs_national.zip
# 932cb1dbc84877637f4703e0917203d7 2015-08-11 2015_Gaz_place_national.zip
# 3405d3aa4311bd5e9983784b55e4bbfb 2015-08-11 2015_Gaz_zcta_national.zip
#
# http://www.weather.gov/geodata/catalog/wsom/html/cntyzone.htm
# 236b0a6db5b0caaf647f494c26295364 2014-10-01 bp03de14.dbx
# 527ff353fa08d6d466679a4f9e1aa6c3 2016-07-19 bp16jn16.dbx
#
# http://weather.noaa.gov/data/nsd_cccc.txt
# 6561bd4dc1ffd4147e35cf6dee7503d5 2011-05-04 nsd_cccc.txt
# http://tgftp.nws.noaa.gov/data/nsd_cccc.txt
# 6561bd4dc1ffd4147e35cf6dee7503d5 2016-08-31 nsd_cccc.txt
#
# http://tgftp.nws.noaa.gov/data/zonecatalog.curr.tar
# 748043471973d418cb415fccc3a0000b 2007-06-07 zonecatalog.curr.tar
@@ -23,12 +23,12 @@
# 2bbef16bbf41add353650c5d09f35066 2013-07-25 metar.tbl
#
# http://www.ncdc.noaa.gov/homr/reports
# 653c168039de789823cd65c4f55091be 2014-11-03 coop-stations.txt
# f34a107a1988a540333f204c5726df29 2016-09-02 coop-stations.txt
#
# ...and these manually-generated or hand-compiled adjustments:
# 520549d5a63f3a97e6b276f739af60bb 2014-11-10 overrides.conf
# 6462849b2c9ebae079634a49d62c2e26 2014-11-10 slist
# 2a8b5978a55994ee24f31fbebb32bc24 2014-11-10 zlist
# 635d51cce0f3ca2dd4d7dca96d9566f5 2016-10-04 overrides.conf
# d0b80c13450ce3e0d297e25b3f55f33f 2016-10-04 slist
# 4ae3719b5d837e48374f1a0d0565d589 2016-10-04 zlist
[aby]
comment = manually aligned to match 1.x defaults
@@ -50,14 +50,6 @@ station = lfjr
comment = missing from the NWS list, information researched manually
station = wmka
[aqa]
comment = missing from the NWS list, information researched manually
station = sbaq
[aru]
comment = missing from the NWS list, information researched manually
station = sbau
[atk]
comment = missing from the NWS list, information researched manually
station = patq
@@ -142,22 +134,10 @@ station = gvba
comment = missing from the NWS list, information researched manually
station = kbxk
[cac]
comment = missing from the NWS list, information researched manually
station = sbca
[caj]
comment = missing from the NWS list, information researched manually
station = svcn
[ccj]
comment = missing from the NWS list, information researched manually
station = vocl
[ccm]
comment = missing from the NWS list, information researched manually
station = sbcm
[cei]
comment = missing from the NWS list, information researched manually
station = vtct
@@ -190,10 +170,6 @@ station = kcod
comment = missing from the NWS list, information researched manually
station = voci
[cso]
comment = missing from the NWS list, information researched manually
station = edbc
[csy]
comment = missing from the NWS list, information researched manually
station = uwks
@@ -206,10 +182,6 @@ station = kctj
comment = manually aligned to match 1.x defaults
station = kcty
[cxj]
comment = missing from the NWS list, information researched manually
station = sbcx
[dgw]
comment = manually aligned to match 1.x defaults
station = kdgw
@@ -230,10 +202,6 @@ station = egcn
comment = missing from the NWS list, information researched manually
station = omdw
[dzn]
comment = missing from the NWS list, information researched manually
station = uakd
[ebl]
comment = missing from the NWS list, information researched manually
station = orer
@@ -278,10 +246,6 @@ station = kgai
comment = manually aligned to match 1.x defaults
station = kgcc
[gcj]
comment = missing from the NWS list, information researched manually
station = fagc
[gdt]
comment = missing from the NWS list, information researched manually
station = mbgt
@@ -378,10 +342,6 @@ station = mdjb
comment = manually aligned to match 1.x defaults
station = kjct
[joi]
comment = missing from the NWS list, information researched manually
station = sbjv
[kbv]
comment = missing from the NWS list, information researched manually
station = vtsg
@@ -466,10 +426,6 @@ station = kmdw
comment = missing from the NWS list, information researched manually
station = kmgc
[mii]
comment = missing from the NWS list, information researched manually
station = sbml
[mji]
comment = missing from the NWS list, information researched manually
station = hllm
@@ -482,10 +438,6 @@ station = padm
comment = missing from the NWS list, information researched manually
station = trpg
[mou]
comment = missing from the NWS list, information researched manually
station = pamo
[mqf]
comment = missing from the NWS list, information researched manually
station = uscm
@@ -638,10 +590,6 @@ station = papn
comment = missing from the NWS list, information researched manually
station = uloo
[pmw]
comment = missing from the NWS list, information researched manually
station = sbpj
[pnt]
comment = missing from the NWS list, information researched manually
station = scnt
@@ -674,10 +622,6 @@ station = pary
comment = manually aligned to match 1.x defaults
station = kriw
[riy]
comment = missing from the NWS list, information researched manually
station = oyrn
[rmf]
comment = missing from the NWS list, information researched manually
station = hema
@@ -706,10 +650,6 @@ station = ksbo
comment = missing from the NWS list, information researched manually
station = pacm
[shg]
comment = missing from the NWS list, information researched manually
station = pagh
[sig]
comment = missing from the NWS list, information researched manually
station = tjig
@@ -722,10 +662,6 @@ station = ksjc
comment = missing from the NWS list, information researched manually
station = zbsj
[skk]
comment = missing from the NWS list, information researched manually
station = pfsh
[skt]
comment = missing from the NWS list, information researched manually
station = opst
@@ -830,10 +766,6 @@ station = uuok
comment = missing from the NWS list, information researched manually
station = vtsm
[vai]
comment = missing from the NWS list, information researched manually
station = ayvn
[vav]
comment = missing from the NWS list, information researched manually
station = nftv
@@ -858,10 +790,6 @@ station = kwwr
comment = missing from the NWS list, information researched manually
station = ywha
[xfl]
comment = missing from the NWS list, information researched manually
station = kxfl
[xsp]
comment = missing from the NWS list, information researched manually
station = wssl

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

29456
places

File diff suppressed because it is too large Load Diff

110
qa.log
View File

@@ -0,0 +1,110 @@
alz262: within one km of alz266
alz263: within one km of alz265
alz265: within one km of alz263
alz266: within one km of alz262
caz032: no centroid
caz101: within one km of caz103
caz102: within one km of caz101
caz103: within one km of caz101
caz104: within one km of caz101
caz105: within one km of caz101
caz106: within one km of caz101
caz107: within one km of caz110
caz108: within one km of caz110
caz110: within one km of caz108
caz111: within one km of caz112
caz112: within one km of caz113
caz113: within one km of caz112
caz549: no centroid
caz550: no centroid
flz024: within one km of flz124
flz025: within one km of flz125
flz124: within one km of flz024
flz125: within one km of flz025
flz139: within one km of flz239
flz142: within one km of flz242
flz148: within one km of flz248
flz149: within one km of flz249
flz155: within one km of flz255
flz160: within one km of flz260
flz162: within one km of flz262
flz239: within one km of flz139
flz242: within one km of flz142
flz248: within one km of flz148
flz249: within one km of flz149
flz255: within one km of flz155
flz260: within one km of flz160
flz262: within one km of flz162
idz001: within one km of wyz001
laz069: no centroid
laz073: within one km of laz074
laz074: within one km of laz073
mtz001: within one km of wyz001
nmz401: no centroid
nmz403: no centroid
nmz404: no centroid
nmz405: no centroid
nmz406: no centroid
nmz407: no centroid
nmz408: no centroid
nmz409: no centroid
nmz410: no centroid
nmz411: no centroid
nmz412: no centroid
nmz413: no centroid
nmz414: no centroid
nmz415: no centroid
nmz416: no centroid
nmz417: no centroid
orz015: no centroid
orz016: no centroid
orz510: no centroid
orz511: no centroid
paz101: within one km of paz102
paz102: within one km of paz101
paz103: within one km of paz104
paz104: within one km of paz103
paz105: within one km of paz106
paz106: within one km of paz105
txz418: no centroid
txz419: no centroid
txz420: no centroid
txz421: no centroid
txz422: no centroid
txz423: no centroid
txz424: no centroid
vaz509: no centroid
vaz510: no centroid
vaz511: no centroid
vaz512: no centroid
vaz513: within one km of vaz514
vaz514: within one km of vaz513
vaz515: within one km of vaz516
vaz516: within one km of vaz515
vaz517: within one km of vaz518
vaz518: within one km of vaz517
vaz519: within one km of vaz520
vaz520: within one km of vaz519
vaz523: no centroid
vtz004: no centroid
waz045: no centroid
waz046: no centroid
waz503: within one km of waz567
waz504: within one km of waz569
waz507: within one km of waz555
waz511: within one km of waz559
waz555: within one km of waz507
waz556: within one km of waz568
waz559: within one km of waz511
waz567: within one km of waz503
waz568: within one km of waz556
waz569: within one km of waz504
wvz506: within one km of wvz507
wvz507: within one km of wvz506
wvz509: within one km of wvz510
wvz510: within one km of wvz509
wvz511: within one km of wvz512
wvz512: within one km of wvz511
wvz513: within one km of wvz514
wvz514: within one km of wvz513
wyz001: within one km of mtz001

755
slist

File diff suppressed because it is too large Load Diff

5379
stations

File diff suppressed because it is too large Load Diff

14928
zctas

File diff suppressed because it is too large Load Diff

103
zlist
View File

@@ -1,7 +1,8 @@
# Copyright (c) 2006-2012 Jeremy Stanley <fungi@yuggoth.org>. Permission to # use, copy, modify, and distribute this software is granted under terms
# Copyright (c) 2006-2016 Jeremy Stanley <fungi@yuggoth.org>. Permission to
# use, copy, modify, and distribute this software is granted under terms
# provided in the LICENSE file distributed with this software.
#
# generated on 2014-11-10 by running:
# generated on 2016-10-04 by running:
#
# for area in $(
# wget -qO- http://tgftp.nws.noaa.gov/data/forecasts/zone/ \
@@ -14,7 +15,6 @@
# sleep 1
# done
akz017
akz017
akz018
akz019
@@ -132,15 +132,17 @@ alz057
alz058
alz059
alz060
alz061
alz062
alz063
alz064
alz065
alz066
alz067
alz068
alz069
alz261
alz262
alz263
alz264
alz265
alz266
arz001
arz002
arz003
@@ -266,10 +268,6 @@ azz512
azz513
azz514
azz515
caz001
caz002
caz003
caz004
caz006
caz013
caz014
@@ -290,7 +288,6 @@ caz038
caz039
caz040
caz041
caz042
caz043
caz044
caz045
@@ -311,6 +308,7 @@ caz061
caz062
caz063
caz064
caz065
caz066
caz067
caz068
@@ -319,7 +317,6 @@ caz070
caz071
caz072
caz073
caz076
caz080
caz081
caz082
@@ -339,6 +336,19 @@ caz096
caz097
caz098
caz099
caz101
caz102
caz103
caz104
caz105
caz106
caz107
caz108
caz109
caz110
caz111
caz112
caz113
caz505
caz506
caz507
@@ -365,6 +375,10 @@ caz529
caz530
caz547
caz548
caz549
caz550
caz552
caz554
coz001
coz002
coz003
@@ -468,12 +482,6 @@ dez001
dez002
dez003
dez004
flz001
flz002
flz003
flz004
flz005
flz006
flz007
flz008
flz009
@@ -542,6 +550,8 @@ flz112
flz114
flz115
flz118
flz124
flz125
flz127
flz128
flz134
@@ -561,6 +571,12 @@ flz168
flz172
flz173
flz174
flz201
flz202
flz203
flz204
flz205
flz206
flz239
flz242
flz248
@@ -1422,10 +1438,7 @@ mdz003
mdz004
mdz005
mdz006
mdz007
mdz008
mdz009
mdz010
mdz011
mdz012
mdz013
@@ -1443,6 +1456,12 @@ mdz024
mdz025
mdz501
mdz502
mdz503
mdz504
mdz505
mdz506
mdz507
mdz508
mez001
mez002
mez003
@@ -3273,14 +3292,12 @@ vaz037
vaz038
vaz039
vaz040
vaz042
vaz043
vaz044
vaz045
vaz046
vaz047
vaz048
vaz049
vaz050
vaz051
vaz052
@@ -3294,18 +3311,12 @@ vaz059
vaz060
vaz061
vaz062
vaz063
vaz064
vaz065
vaz066
vaz067
vaz068
vaz069
vaz070
vaz071
vaz072
vaz073
vaz074
vaz075
vaz076
vaz077
@@ -3322,10 +3333,8 @@ vaz087
vaz088
vaz089
vaz090
vaz091
vaz092
vaz093
vaz094
vaz095
vaz096
vaz097
@@ -3336,6 +3345,27 @@ vaz501
vaz502
vaz503
vaz504
vaz505
vaz506
vaz507
vaz508
vaz509
vaz510
vaz511
vaz512
vaz513
vaz514
vaz515
vaz516
vaz517
vaz518
vaz519
vaz520
vaz521
vaz522
vaz523
vaz524
vaz525
viz001
viz002
vtz001
@@ -3501,8 +3531,6 @@ wvz018
wvz019
wvz020
wvz021
wvz022
wvz023
wvz024
wvz025
wvz026
@@ -3520,7 +3548,6 @@ wvz037
wvz038
wvz039
wvz040
wvz041
wvz042
wvz043
wvz044
@@ -3539,6 +3566,12 @@ wvz505
wvz506
wvz507
wvz508
wvz509
wvz510
wvz511
wvz512
wvz513
wvz514
wyz001
wyz002
wyz003

152828
zones

File diff suppressed because it is too large Load Diff