Correlation set update

* overrides.conf: Latest source data corrections from
script-assisted research.

These remaining files are generated data. Normally they're not
something I feel good about committing into version control, but in
this case it allows for logging and tracking deltas in the data over
time...

* airports: Removed 18 airports corresponding to nonexistent
stations.

* stations: Removed 326 stations with no recent conditions, added
429.

* zones: Removed 45 zones with no recent forecasts, added 104.

* places, zctas: Based on latest Census Bureau data corrections,
updated with new correlations.

* overrides.log: Record of correlation set build.

* slist, zlist: State of active stations and weather zones at the
time of generation.
This commit is contained in:
Jeremy Stanley
2016-10-05 01:06:27 +00:00
parent a33dd24ec1
commit 840b91b4fd
10 changed files with 102614 additions and 110389 deletions

100
airports
View File

@@ -1,20 +1,20 @@
# Copyright (c) 2006-2014 Jeremy Stanley <fungi@yuggoth.org>. Permission to # Copyright (c) 2006-2016 Jeremy Stanley <fungi@yuggoth.org>. Permission to
# use, copy, modify, and distribute this software is granted under terms # use, copy, modify, and distribute this software is granted under terms
# provided in the LICENSE file distributed with this software. # provided in the LICENSE file distributed with this software.
# #
# generated by weather on 2014-11-10 from these public domain sources: # generated by weather on 2016-10-04 from these public domain sources:
# #
# http://www.census.gov/geo/maps-data/data/gazetteer2014.html # http://www.census.gov/geo/maps-data/data/gazetteer2015.html
# 6a7af64ddfa89fc276aaf6793567c9cd 2014-07-28 2014_Gaz_counties_national.zip # 6ce9ebdecb92182a7e3882bc09c5f352 2015-08-11 2015_Gaz_counties_national.zip
# 37ebebca082ef099147b5d8e2119b18d 2014-07-28 2014_Gaz_cousubs_national.zip # 92d61a96ace60d4844f2a9b69057332e 2015-08-11 2015_Gaz_cousubs_national.zip
# f319845358951aa73f870bffa67f299f 2014-07-28 2014_Gaz_place_national.zip # 932cb1dbc84877637f4703e0917203d7 2015-08-11 2015_Gaz_place_national.zip
# 0d012b742b9001cf2d1b92be4a0a2974 2014-07-28 2014_Gaz_zcta_national.zip # 3405d3aa4311bd5e9983784b55e4bbfb 2015-08-11 2015_Gaz_zcta_national.zip
# #
# http://www.weather.gov/geodata/catalog/wsom/html/cntyzone.htm # http://www.weather.gov/geodata/catalog/wsom/html/cntyzone.htm
# 236b0a6db5b0caaf647f494c26295364 2014-10-01 bp03de14.dbx # 527ff353fa08d6d466679a4f9e1aa6c3 2016-07-19 bp16jn16.dbx
# #
# http://weather.noaa.gov/data/nsd_cccc.txt # http://tgftp.nws.noaa.gov/data/nsd_cccc.txt
# 6561bd4dc1ffd4147e35cf6dee7503d5 2011-05-04 nsd_cccc.txt # 6561bd4dc1ffd4147e35cf6dee7503d5 2016-08-31 nsd_cccc.txt
# #
# http://tgftp.nws.noaa.gov/data/zonecatalog.curr.tar # http://tgftp.nws.noaa.gov/data/zonecatalog.curr.tar
# 748043471973d418cb415fccc3a0000b 2007-06-07 zonecatalog.curr.tar # 748043471973d418cb415fccc3a0000b 2007-06-07 zonecatalog.curr.tar
@@ -23,12 +23,12 @@
# 2bbef16bbf41add353650c5d09f35066 2013-07-25 metar.tbl # 2bbef16bbf41add353650c5d09f35066 2013-07-25 metar.tbl
# #
# http://www.ncdc.noaa.gov/homr/reports # http://www.ncdc.noaa.gov/homr/reports
# 653c168039de789823cd65c4f55091be 2014-11-03 coop-stations.txt # f34a107a1988a540333f204c5726df29 2016-09-02 coop-stations.txt
# #
# ...and these manually-generated or hand-compiled adjustments: # ...and these manually-generated or hand-compiled adjustments:
# 520549d5a63f3a97e6b276f739af60bb 2014-11-10 overrides.conf # 635d51cce0f3ca2dd4d7dca96d9566f5 2016-10-04 overrides.conf
# 6462849b2c9ebae079634a49d62c2e26 2014-11-10 slist # d0b80c13450ce3e0d297e25b3f55f33f 2016-10-04 slist
# 2a8b5978a55994ee24f31fbebb32bc24 2014-11-10 zlist # 4ae3719b5d837e48374f1a0d0565d589 2016-10-04 zlist
[aby] [aby]
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
@@ -50,14 +50,6 @@ station = lfjr
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = wmka station = wmka
[aqa]
comment = missing from the NWS list, information researched manually
station = sbaq
[aru]
comment = missing from the NWS list, information researched manually
station = sbau
[atk] [atk]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = patq station = patq
@@ -142,22 +134,10 @@ station = gvba
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = kbxk station = kbxk
[cac]
comment = missing from the NWS list, information researched manually
station = sbca
[caj]
comment = missing from the NWS list, information researched manually
station = svcn
[ccj] [ccj]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = vocl station = vocl
[ccm]
comment = missing from the NWS list, information researched manually
station = sbcm
[cei] [cei]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = vtct station = vtct
@@ -190,10 +170,6 @@ station = kcod
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = voci station = voci
[cso]
comment = missing from the NWS list, information researched manually
station = edbc
[csy] [csy]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = uwks station = uwks
@@ -206,10 +182,6 @@ station = kctj
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
station = kcty station = kcty
[cxj]
comment = missing from the NWS list, information researched manually
station = sbcx
[dgw] [dgw]
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
station = kdgw station = kdgw
@@ -230,10 +202,6 @@ station = egcn
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = omdw station = omdw
[dzn]
comment = missing from the NWS list, information researched manually
station = uakd
[ebl] [ebl]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = orer station = orer
@@ -278,10 +246,6 @@ station = kgai
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
station = kgcc station = kgcc
[gcj]
comment = missing from the NWS list, information researched manually
station = fagc
[gdt] [gdt]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = mbgt station = mbgt
@@ -378,10 +342,6 @@ station = mdjb
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
station = kjct station = kjct
[joi]
comment = missing from the NWS list, information researched manually
station = sbjv
[kbv] [kbv]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = vtsg station = vtsg
@@ -466,10 +426,6 @@ station = kmdw
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = kmgc station = kmgc
[mii]
comment = missing from the NWS list, information researched manually
station = sbml
[mji] [mji]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = hllm station = hllm
@@ -482,10 +438,6 @@ station = padm
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = trpg station = trpg
[mou]
comment = missing from the NWS list, information researched manually
station = pamo
[mqf] [mqf]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = uscm station = uscm
@@ -638,10 +590,6 @@ station = papn
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = uloo station = uloo
[pmw]
comment = missing from the NWS list, information researched manually
station = sbpj
[pnt] [pnt]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = scnt station = scnt
@@ -674,10 +622,6 @@ station = pary
comment = manually aligned to match 1.x defaults comment = manually aligned to match 1.x defaults
station = kriw station = kriw
[riy]
comment = missing from the NWS list, information researched manually
station = oyrn
[rmf] [rmf]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = hema station = hema
@@ -706,10 +650,6 @@ station = ksbo
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = pacm station = pacm
[shg]
comment = missing from the NWS list, information researched manually
station = pagh
[sig] [sig]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = tjig station = tjig
@@ -722,10 +662,6 @@ station = ksjc
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = zbsj station = zbsj
[skk]
comment = missing from the NWS list, information researched manually
station = pfsh
[skt] [skt]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = opst station = opst
@@ -830,10 +766,6 @@ station = uuok
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = vtsm station = vtsm
[vai]
comment = missing from the NWS list, information researched manually
station = ayvn
[vav] [vav]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = nftv station = nftv
@@ -858,10 +790,6 @@ station = kwwr
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = ywha station = ywha
[xfl]
comment = missing from the NWS list, information researched manually
station = kxfl
[xsp] [xsp]
comment = missing from the NWS list, information researched manually comment = missing from the NWS list, information researched manually
station = wssl station = wssl

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

29456
places

File diff suppressed because it is too large Load Diff

110
qa.log
View File

@@ -0,0 +1,110 @@
alz262: within one km of alz266
alz263: within one km of alz265
alz265: within one km of alz263
alz266: within one km of alz262
caz032: no centroid
caz101: within one km of caz103
caz102: within one km of caz101
caz103: within one km of caz101
caz104: within one km of caz101
caz105: within one km of caz101
caz106: within one km of caz101
caz107: within one km of caz110
caz108: within one km of caz110
caz110: within one km of caz108
caz111: within one km of caz112
caz112: within one km of caz113
caz113: within one km of caz112
caz549: no centroid
caz550: no centroid
flz024: within one km of flz124
flz025: within one km of flz125
flz124: within one km of flz024
flz125: within one km of flz025
flz139: within one km of flz239
flz142: within one km of flz242
flz148: within one km of flz248
flz149: within one km of flz249
flz155: within one km of flz255
flz160: within one km of flz260
flz162: within one km of flz262
flz239: within one km of flz139
flz242: within one km of flz142
flz248: within one km of flz148
flz249: within one km of flz149
flz255: within one km of flz155
flz260: within one km of flz160
flz262: within one km of flz162
idz001: within one km of wyz001
laz069: no centroid
laz073: within one km of laz074
laz074: within one km of laz073
mtz001: within one km of wyz001
nmz401: no centroid
nmz403: no centroid
nmz404: no centroid
nmz405: no centroid
nmz406: no centroid
nmz407: no centroid
nmz408: no centroid
nmz409: no centroid
nmz410: no centroid
nmz411: no centroid
nmz412: no centroid
nmz413: no centroid
nmz414: no centroid
nmz415: no centroid
nmz416: no centroid
nmz417: no centroid
orz015: no centroid
orz016: no centroid
orz510: no centroid
orz511: no centroid
paz101: within one km of paz102
paz102: within one km of paz101
paz103: within one km of paz104
paz104: within one km of paz103
paz105: within one km of paz106
paz106: within one km of paz105
txz418: no centroid
txz419: no centroid
txz420: no centroid
txz421: no centroid
txz422: no centroid
txz423: no centroid
txz424: no centroid
vaz509: no centroid
vaz510: no centroid
vaz511: no centroid
vaz512: no centroid
vaz513: within one km of vaz514
vaz514: within one km of vaz513
vaz515: within one km of vaz516
vaz516: within one km of vaz515
vaz517: within one km of vaz518
vaz518: within one km of vaz517
vaz519: within one km of vaz520
vaz520: within one km of vaz519
vaz523: no centroid
vtz004: no centroid
waz045: no centroid
waz046: no centroid
waz503: within one km of waz567
waz504: within one km of waz569
waz507: within one km of waz555
waz511: within one km of waz559
waz555: within one km of waz507
waz556: within one km of waz568
waz559: within one km of waz511
waz567: within one km of waz503
waz568: within one km of waz556
waz569: within one km of waz504
wvz506: within one km of wvz507
wvz507: within one km of wvz506
wvz509: within one km of wvz510
wvz510: within one km of wvz509
wvz511: within one km of wvz512
wvz512: within one km of wvz511
wvz513: within one km of wvz514
wvz514: within one km of wvz513
wyz001: within one km of mtz001

755
slist

File diff suppressed because it is too large Load Diff

5379
stations

File diff suppressed because it is too large Load Diff

14928
zctas

File diff suppressed because it is too large Load Diff

103
zlist
View File

@@ -1,7 +1,8 @@
# Copyright (c) 2006-2012 Jeremy Stanley <fungi@yuggoth.org>. Permission to # use, copy, modify, and distribute this software is granted under terms # Copyright (c) 2006-2016 Jeremy Stanley <fungi@yuggoth.org>. Permission to
# use, copy, modify, and distribute this software is granted under terms
# provided in the LICENSE file distributed with this software. # provided in the LICENSE file distributed with this software.
# #
# generated on 2014-11-10 by running: # generated on 2016-10-04 by running:
# #
# for area in $( # for area in $(
# wget -qO- http://tgftp.nws.noaa.gov/data/forecasts/zone/ \ # wget -qO- http://tgftp.nws.noaa.gov/data/forecasts/zone/ \
@@ -14,7 +15,6 @@
# sleep 1 # sleep 1
# done # done
akz017
akz017 akz017
akz018 akz018
akz019 akz019
@@ -132,15 +132,17 @@ alz057
alz058 alz058
alz059 alz059
alz060 alz060
alz061
alz062
alz063
alz064
alz065 alz065
alz066 alz066
alz067 alz067
alz068 alz068
alz069 alz069
alz261
alz262
alz263
alz264
alz265
alz266
arz001 arz001
arz002 arz002
arz003 arz003
@@ -266,10 +268,6 @@ azz512
azz513 azz513
azz514 azz514
azz515 azz515
caz001
caz002
caz003
caz004
caz006 caz006
caz013 caz013
caz014 caz014
@@ -290,7 +288,6 @@ caz038
caz039 caz039
caz040 caz040
caz041 caz041
caz042
caz043 caz043
caz044 caz044
caz045 caz045
@@ -311,6 +308,7 @@ caz061
caz062 caz062
caz063 caz063
caz064 caz064
caz065
caz066 caz066
caz067 caz067
caz068 caz068
@@ -319,7 +317,6 @@ caz070
caz071 caz071
caz072 caz072
caz073 caz073
caz076
caz080 caz080
caz081 caz081
caz082 caz082
@@ -339,6 +336,19 @@ caz096
caz097 caz097
caz098 caz098
caz099 caz099
caz101
caz102
caz103
caz104
caz105
caz106
caz107
caz108
caz109
caz110
caz111
caz112
caz113
caz505 caz505
caz506 caz506
caz507 caz507
@@ -365,6 +375,10 @@ caz529
caz530 caz530
caz547 caz547
caz548 caz548
caz549
caz550
caz552
caz554
coz001 coz001
coz002 coz002
coz003 coz003
@@ -468,12 +482,6 @@ dez001
dez002 dez002
dez003 dez003
dez004 dez004
flz001
flz002
flz003
flz004
flz005
flz006
flz007 flz007
flz008 flz008
flz009 flz009
@@ -542,6 +550,8 @@ flz112
flz114 flz114
flz115 flz115
flz118 flz118
flz124
flz125
flz127 flz127
flz128 flz128
flz134 flz134
@@ -561,6 +571,12 @@ flz168
flz172 flz172
flz173 flz173
flz174 flz174
flz201
flz202
flz203
flz204
flz205
flz206
flz239 flz239
flz242 flz242
flz248 flz248
@@ -1422,10 +1438,7 @@ mdz003
mdz004 mdz004
mdz005 mdz005
mdz006 mdz006
mdz007
mdz008 mdz008
mdz009
mdz010
mdz011 mdz011
mdz012 mdz012
mdz013 mdz013
@@ -1443,6 +1456,12 @@ mdz024
mdz025 mdz025
mdz501 mdz501
mdz502 mdz502
mdz503
mdz504
mdz505
mdz506
mdz507
mdz508
mez001 mez001
mez002 mez002
mez003 mez003
@@ -3273,14 +3292,12 @@ vaz037
vaz038 vaz038
vaz039 vaz039
vaz040 vaz040
vaz042
vaz043 vaz043
vaz044 vaz044
vaz045 vaz045
vaz046 vaz046
vaz047 vaz047
vaz048 vaz048
vaz049
vaz050 vaz050
vaz051 vaz051
vaz052 vaz052
@@ -3294,18 +3311,12 @@ vaz059
vaz060 vaz060
vaz061 vaz061
vaz062 vaz062
vaz063
vaz064 vaz064
vaz065 vaz065
vaz066 vaz066
vaz067 vaz067
vaz068 vaz068
vaz069 vaz069
vaz070
vaz071
vaz072
vaz073
vaz074
vaz075 vaz075
vaz076 vaz076
vaz077 vaz077
@@ -3322,10 +3333,8 @@ vaz087
vaz088 vaz088
vaz089 vaz089
vaz090 vaz090
vaz091
vaz092 vaz092
vaz093 vaz093
vaz094
vaz095 vaz095
vaz096 vaz096
vaz097 vaz097
@@ -3336,6 +3345,27 @@ vaz501
vaz502 vaz502
vaz503 vaz503
vaz504 vaz504
vaz505
vaz506
vaz507
vaz508
vaz509
vaz510
vaz511
vaz512
vaz513
vaz514
vaz515
vaz516
vaz517
vaz518
vaz519
vaz520
vaz521
vaz522
vaz523
vaz524
vaz525
viz001 viz001
viz002 viz002
vtz001 vtz001
@@ -3501,8 +3531,6 @@ wvz018
wvz019 wvz019
wvz020 wvz020
wvz021 wvz021
wvz022
wvz023
wvz024 wvz024
wvz025 wvz025
wvz026 wvz026
@@ -3520,7 +3548,6 @@ wvz037
wvz038 wvz038
wvz039 wvz039
wvz040 wvz040
wvz041
wvz042 wvz042
wvz043 wvz043
wvz044 wvz044
@@ -3539,6 +3566,12 @@ wvz505
wvz506 wvz506
wvz507 wvz507
wvz508 wvz508
wvz509
wvz510
wvz511
wvz512
wvz513
wvz514
wyz001 wyz001
wyz002 wyz002
wyz003 wyz003

152828
zones

File diff suppressed because it is too large Load Diff