Thursday, July 28, 2011

Comparison of January 2010 and July 2011 CRUTEM3 subset releases

The Met Office has released a new subset of CRUTEM3 for donwload. This is the first update to this dataset since January 2010.

The new set contains 5,113 station files, the previous release contained 3,780. No station files have been removed. Many other files updated for to add temperature data for 2010 and 2011.

Both the January 2010 and the July 2011 sets can be processed using the Perl programs that the Met Office released in 2009. They also work with my code. My code throws up a small number of anomalies in the data:

station_files/02/026160: Normals value -0.1 != -0.00333333333333329 (difference 0.0966666666666667) (month 1)
station_files/02/026960: Normals value -0.1 != -0.03 (difference 0.07) (month 2)
station_files/09/094547: Normals value -0.1 != -0.0124999999999999 (difference 0.0875000000000001) (month 0)
station_files/10/109340: Normals value -0.1 != -0.025 (difference 0.075) (month 0)
station_files/11/111010: Normals value -0.1 != -0.04 (difference 0.06) (month 0)
station_files/13/133760: Normals value -0.1 != -0.00526315789473685 (difference 0.0947368421052632) (month 0)
station_files/14/140140: Normals value -0.1 != -0.0222222222222222 (difference 0.0777777777777778) (month 11)
station_files/26/262580: Normals value -0.1 != -0.00344827586206892 (difference 0.0965517241379311) (month 10)
station_files/31/314160: Normals value -0.1 != -0.00333333333333334 (difference 0.0966666666666667) (month 3)
station_files/35/357460: Normals value -0.1 != -0.00999999999999999 (difference 0.09) (month 10)
station_files/40/407030: Normals value -0.1 != -0.0166666666666667 (difference 0.0833333333333333) (month 1)
station_files/44/442127: Normals value -0.1 != -0.00909090909090916 (difference 0.0909090909090908) (month 9)
station_files/44/442300: Normals value -0.1 != -0.0285714285714286 (difference 0.0714285714285714) (month 9)
station_files/47/474260: Normals value -0.1 != -0.00666666666666668 (difference 0.0933333333333333) (month 2)
station_files/47/475850: Normals value -0.1 != -0.02 (difference 0.08) (month 0)
station_files/70/703810: Normals value -0.1 != -0.0233333333333333 (difference 0.0766666666666667) (month 10)
station_files/71/710720: Normals value -0.1 != -0.0366666666666666 (difference 0.0633333333333334) (month 5)
station_files/71/718070: Normals value -0.1 != -0.0125000000000001 (difference 0.0874999999999999) (month 11)
station_files/71/719530: Normals value -0.1 != -0.0066666666666666 (difference 0.0933333333333334) (month 9)
station_files/72/720052: Normals value -0.1 != -0.00333333333333338 (difference 0.0966666666666666) (month 0)
station_files/72/720307: Normals value -0.1 != -0.02 (difference 0.08) (month 10)
station_files/72/720445: Normals value -0.1 != -0.0100000000000002 (difference 0.0899999999999998) (month 11)
station_files/72/720452: Normals value -0.1 != -0.0206896551724138 (difference 0.0793103448275862) (month 11)
station_files/72/720538: Normals value -0.1 != -0.00333333333333334 (difference 0.0966666666666667) (month 11)
station_files/72/720566: Normals value -0.1 != -0.00666666666666676 (difference 0.0933333333333332) (month 11)
station_files/72/723607: Normals value -0.1 != -0.0150000000000001 (difference 0.085) (month 10)
station_files/72/724660: Normals value -0.1 != -0.0133333333333333 (difference 0.0866666666666667) (month 1)
station_files/72/724714: Normals value -0.1 != -0.00333333333333328 (difference 0.0966666666666667) (month 1)
station_files/72/727798: Normals value -0.1 != -0.01 (difference 0.09) (month 1)
station_files/73/730100: Normals value -0.1 != -0.0133333333333333 (difference 0.0866666666666667) (month 10)
station_files/75/751200: Normals value -0.1 != -0.0166666666666666 (difference 0.0833333333333334) (month 1)
station_files/75/752020: Normals value -0.1 != -0.0133333333333334 (difference 0.0866666666666666) (month 2)
station_files/75/752072: Normals value -0.1 != -0.0379310344827586 (difference 0.0620689655172414) (month 1)
station_files/75/752101: Normals value -0.1 != -0.0178571428571428 (difference 0.0821428571428572) (month 2)
station_files/75/756014: Normals value -0.1 != -0.0275862068965517 (difference 0.0724137931034483) (month 1)
station_files/75/756138: Normals value -0.1 != -0.0392857142857144 (difference 0.0607142857142856) (month 2)
station_files/75/756190: Normals value -0.1 != -0.0137931034482759 (difference 0.0862068965517241) (month 10)
station_files/75/756292: Normals value -0.1 != -0.0133333333333334 (difference 0.0866666666666666) (month 11)
station_files/75/756294: Normals value -0.1 != -0.00689655172413789 (difference 0.0931034482758621) (month 2)
station_files/75/756515: Normals value -0.1 != -0.0172413793103448 (difference 0.0827586206896552) (month 10)
station_files/89/890570: Normals value -0.1 != -0.032 (difference 0.068) (month 2)
station_files/93/932920: Normals value 19.4 != 19.4758620689655 (difference 0.0758620689655203) (month 0)
station_files/93/932920: Normals value 10.3 != 10.3724137931034 (difference 0.0724137931034452) (month 7)
station_files/94/942380: Normals value 29.9 != 30.1045454545454 (difference 0.204545454545443) (month 1)
station_files/94/942380: Normals value 25.9 != 25.65 (difference -0.25) (month 3)
station_files/94/942380: Normals value 21.8 != 22.0545454545455 (difference 0.254545454545458) (month 4)
station_files/94/942380: Normals value 18.7 != 18.5590909090909 (difference -0.140909090909094) (month 5)
station_files/94/942380: Normals value 18.1 != 18.2772727272727 (difference 0.177272727272726) (month 6)
station_files/94/942380: Normals value 20.7 != 21.0227272727273 (difference 0.322727272727278) (month 7)
station_files/94/942380: Normals value 24.4 != 24.3 (difference -0.100000000000001) (month 8)
station_files/94/942380: Normals value 30.3 != 30.1318181818182 (difference -0.168181818181822) (month 10)
station_files/94/942380: Normals value 31.5 != 31.4090909090909 (difference -0.0909090909090899) (month 11)
station_files/94/945270: Normals value 26.1 != 26.3444444444444 (difference 0.244444444444447) (month 0)
station_files/94/945270: Normals value 23.5 != 23.662962962963 (difference 0.162962962962965) (month 2)
station_files/94/945270: Normals value 19.6 != 19.6814814814815 (difference 0.0814814814814788) (month 3)
station_files/94/945270: Normals value 15.0 != 15.1074074074074 (difference 0.107407407407409) (month 4)
station_files/94/945270: Normals value 11.7 != 11.762962962963 (difference 0.0629629629629616) (month 5)
station_files/94/945270: Normals value 10.5 != 10.5925925925926 (difference 0.0925925925925934) (month 6)
station_files/94/945270: Normals value 25.0 != 25.2222222222222 (difference 0.222222222222221) (month 11)
station_files/94/946380: Normals value 21.2 != 21.0636363636364 (difference -0.136363636363633) (month 0)
station_files/94/946380: Normals value 21.1 != 21.2272727272727 (difference 0.127272727272725) (month 1)
station_files/94/946380: Normals value 20.4 != 20.2954545454545 (difference -0.104545454545452) (month 2)
station_files/94/946380: Normals value 15.5 != 15.5863636363636 (difference 0.0863636363636378) (month 4)
station_files/94/946380: Normals value 13.6 != 13.4909090909091 (difference -0.109090909090908) (month 5)
station_files/94/946380: Normals value 13.1 != 13.2181818181818 (difference 0.118181818181821) (month 7)
station_files/94/946380: Normals value 14.4 != 14.4954545454545 (difference 0.0954545454545492) (month 8)
station_files/94/946380: Normals value 16.1 != 15.9818181818182 (difference -0.118181818181821) (month 9)
station_files/94/947110: Normals value 13.9 != 13.9758620689655 (difference 0.0758620689655167) (month 4)

Could be a repeat of the error reported here where some of the normals were incorrectly calculated. This was also true in the January 2010 data as well (there were still errors in the normals values for some stations).

Plotting the two together shows very little difference.

Labels:

If you enjoyed this blog post, you might enjoy my travel book for people interested in science and technology: The Geek Atlas. Signed copies of The Geek Atlas are available.

<$BlogCommentBody$>

<$BlogCommentDateTime$> <$BlogCommentDeleteIcon$>

Post a Comment

Links to this post:

<$BlogBacklinkControl$> <$BlogBacklinkTitle$> <$BlogBacklinkDeleteIcon$>
<$BlogBacklinkSnippet$>
Create a Link

<< Home