Showing posts with label Illinois temperature. Show all posts
Showing posts with label Illinois temperature. Show all posts

Sunday, September 12, 2010

Illinois TOBS temperature review

Back in June when I first looked at the historic temperature data for Illinois I had some problem in comparing the GISS data, with that from the USHCN. There are 36 stations in the USHCN list, and as with the station data from other states, there are several years from 1895 until now where stations have no annual data for the TOBS (Time of Observation) correction to the raw data sets. In the original review I had accepted the homogenization of the data to produce the annual averages at each station, but am now going back to see what difference that homogenization created.

The problem of comparison in Illinois is that, using Chiefio’s list of GISS stations that are actually used in their global analysis, the ones used in Illinois are Chicago, Peoria and Moline. The problem arises in that there are two stations possible for Chicago (O’Hare and Midway) and that each only provides a partial record, while for Moline the data also exists for only part of the period, though there is a nearby station at Davenport that might provide equivalent values when Moline wasn’t there. To work out what correction might be needed I looked at the differences between the two sets of stations:


As I commented at the time, there is a very slight trend line increase in difference with time for Chicago, but it is not great, and the average temperature difference in Chicago is that Midway is 1.26 deg F warmer, and Moline is 0.97 deg F cooler than Davenport. It is a bit of a kludge to put the two together, but with that adjustment to allow using a full set of data for the 3 GISS stations, the difference between the GISS stations and the USHCN stations using the homogenized data showed a fairly consistent (no significant statistical change over time) 1.13 degrees lower for the GISS sites. Which is not surprising at least as regards the difference, really, given that the 3 GISS stations are all located in the Northern part of the state.

Turning to the TOBS data, however, there is a consistent increase in the GISS temperatures, relative to the USHCN.


This wasn’t there with the homogenized data, and since the GISS data has remained the same this suggests that homogenizing the data introduces a warming trend that was not there in the original data.

Looking at the TOBS average values for the state over the interval,


The annual increase in temperature is very small (0.3 deg per century) relative to that found with the homogenized data, which was 0.9 deg per century. This is fairly significantly less than that reported for the entire county, and the highest temperatures were 1921 and 1931, with the dust bowl years having consistently higher temperatures than today.

It was at this point back in June that Stuart Staniford commented on my use of statistics. So it is perhaps appropriate that I should explain a little more of what I am doing, and why. Most of my life was spent in finding how to understand and use high-pressure water in removing material. And while this can be done today, I suppose, with sophisticated computer models, back when I started a calculator with 9 memories and a printer cost $3,000. Thus, in order to analyze what caused the behavior of the jet to change, I used to run rather large full factorial experiments. I would change a number of parameters within the experiments, and the first thing one did, in the analysis (which got a whole lot more intricate downstream), was to find out which parameters caused a greater change in result. It was using very simple first order correlations to see what was most important (and incidentally it showed that flow rate can be more important than pressure – to the chagrin of some of my colleagues). I am fundamentally, as I acquire the data around the country, doing the same thing again. Trying to see what factors most control local temperatures.

And the most obvious is where the place sits between the North Pole and the Equator. Looking at the data from each of the states, the latitude of the station strongly controls the relative temperature at that site.


The correlation here is so good, that were I to get it in a lab test, I’d go back and check to make sure there wasn’t some hidden bias somewhere, but apart from the high level of correlation, it is consistent with what I have found elsewhere. It does make me wonder though if this is because of the relative flatness of the state.

Looking at longitude, without any significant mountains on either side, there isn’t any clear trend over the state:


However, and this was the surprise when I first looked at the state, when one looks at the effect of elevation change, this is very evident, and that does not change when one uses the TOBS data.


There are thus two factors that need to be considered when estimating average temperatures, based on station data, one is the relative latitude of the average point relative to that of the stations contributing to that average, and the other is elevation. I make this point, which is to a degree intuitive, since basing the average temperature of Illinois on the three GISS stations would, without such corrections, give an inaccurate estimate of the average state temperature.
The second surprise that I found in the original data, related to the effect of population on temperature (essentially a look at the Urban Heat Island effect). Until now in the less populous states, where there were many stations with few inhabitants there was a clear log relationship.

In Illinois, where the majority of the stations were located in larger communities, this correlation is not as clear.


Most of the states as I move from Missouri east are going to have the same sort of population distribution, so it should be interesting to see how this all works out.

Read more!

Saturday, June 12, 2010

Illinois temperature data

Today I am going to return to looking at state temperatures over the past 110 years. It is something that I started doing on Saturdays a while ago, since there has been some debate, in the blog sphere, about the validity of certain choices for stations used in the Goddard Institute for Space Studies (GISS) network for the United States. In the non-too-distant past they have truncated the number of stations that they use to determine temperature, and I became curious as to why they chose the stations that they did. So, recognizing that it is a long-handed way of doing this, I put together a procedure for looking at individual state data, which now covers a number of states (See the list on the lower right side of the page).

And in that procedure I write the post as I find and evaluate the numbers, so that as I start I don’t actually know what I am going to find. The first step in the process is to download the USHCN data for the sites that they list in Illinois and add them to the spreadsheet. There are 36 sites, and the data is smoothly transferred.

A quick check, and Chiefio states that GISS uses three stations for Illinois, Chicago, Peoria and Moline. Now this immediately gives a problem. Because when you look for Chicago on the GISS site it gives you two alternatives – Midway and O’Hare. The problem is that the data for Midway is from 1880 to 1981, and that for O’Hare is 1958 to 2010. For those not familiar with the city, I seem to recall that Midway actually sits on the lake, while O’Hare is a bit further inland. But being curious I downloaded both sets of data – with the intent of correlating the concurrent years and seeing if there was a correction I could then apply to the O’Hare data to give a full suite of data over the period of interest (1895 to 2008).


Peoria is fine, a full set of data, but Moline is also a problem, since GISS doesn’t have a station there. Hmmm! Odd! Well there is one for Davenport Iowa, which is just across the river, so I’ll use this for now. But then I check on the stations nearest to Davenport and lo! There is a Moline station, but it doesn’t start until 1944. So I’ll patch it and the Davenport data from before that period together. But first a check to ensure that they are similar, over the common period. Looking at both the two Chicago stations and then the Davenport/Moline one. Well it turns out that even though they are close, the two temperatures don’t exactly follow each other directly in either case. I have plotted the differences (Midway – O’Hare, Davenport – Moline) over the common time periods.


There is a very slight trend line increase in difference with time for Chicago, but it is not great, and the average temperature difference in Chicago is that Midway is 1.26 deg F warmer, and Moline is 0.97 deg F cooler than Davenport. It is a bit of a kludge to put the two together, but with that adjustment to allow using a full set of data for the 3 GISS stations, the difference between the GISS stations and the USHCN stations is a fairly consistent (no significant statistical change over time) 1.13 degrees lower. Which is not surprising, really, given that the 3 GISS stations are all located in the Northern part of the state.


As for the state as a whole, looking at the temperature trend for the past 115 odd years we get:


Not a very strong increase in temperature with time, in fact barely significant, and the trend is moving back towards the historical average. (I am beginning to suspect that we might see this in the MidWest states, maybe I should pose it as a hypothesis in the next state I do?)

Well I said that the reason that the GISS averages were low was that they were in the Northern part of the state, which would mean a strong correlation of temperature with latitude. And, as usual, there is.


On the other hand there isn’t much of a correlation with Longitude – not a whole lot of change in the state, going from one side to the other.


And here is the first surprise of the evening, with relatively little elevation change, I didn’t think that there would be much correlation with elevation – Wrong!


So even though the change In height is small, it is consistent with what we saw for states with much greater elevation change out west.

The premise of the next plot was that conditions around stations have deteriorated with time, and that, as a result the standard deviation of the station data would increase with time. With one or two exceptions that hasn’t proved true, but this shows steady improvement – which may be due to the automation of the data gathering.


So now it is time to get the population data (since this is one of the larger disagreements with GISS). I use the information from a Google search, and the city-data values, where available, which in this case is for all the sites in this survey. And, whoops, the second surprise of the night.


This is about the first time that there has not been a good correlation with a log-plot, and perhaps it is because of the geography of the state, where the communities are scattered around the state, with the largest city in the North.
Well I could take out latitude, and see what that did, but since I am just getting back into this, I think, for now, we’ll leave it where it is.

Now which way to go next?

Read more!