Arguments
How reliable are climate models?
What the science says...
| Select a level... |
Basic
|
Intermediate
| |||
|
Models successfully reproduce temperatures since 1900 globally, by land, in the air and the ocean. |
|||||
Climate Myth...
Models are unreliable
"[Models] are full of fudge factors that are fitted to the existing climate, so the models more or less agree with the observed data. But there is no reason to believe that the same fudge factors would give the right behaviour in a world with different chemistry, for example in a world with increased CO2 in the atmosphere." (Freeman Dyson)
At a glance
So, what are computer models? Computer modelling is the simulation and study of complex physical systems using mathematics and computer science. Models can be used to explore the effects of changes to any or all of the system components. Such techniques have a wide range of applications. For example, engineering makes a lot of use of computer models, from aircraft design to dam construction and everything in between. Many aspects of our modern lives depend, one way and another, on computer modelling. If you don't trust computer models but like flying, you might want to think about that.
Computer models can be as simple or as complicated as required. It depends on what part of a system you're looking at and its complexity. A simple model might consist of a few equations on a spreadsheet. Complex models, on the other hand, can run to millions of lines of code. Designing them involves intensive collaboration between multiple specialist scientists, mathematicians and top-end coders working as a team.
Modelling of the planet's climate system dates back to the late 1960s. Climate modelling involves incorporating all the equations that describe the interactions between all the components of our climate system. Climate modelling is especially maths-heavy, requiring phenomenal computer power to run vast numbers of equations at the same time.
Climate models are designed to estimate trends rather than events. For example, a fairly simple climate model can readily tell you it will be colder in winter. However, it can’t tell you what the temperature will be on a specific day – that’s weather forecasting. Weather forecast-models rarely extend to even a fortnight ahead. Big difference. Climate trends deal with things such as temperature or sea-level changes, over multiple decades. Trends are important because they eliminate or 'smooth out' single events that may be extreme but uncommon. In other words, trends tell you which way the system's heading.
All climate models must be tested to find out if they work before they are deployed. That can be done by using the past. We know what happened back then either because we made observations or since evidence is preserved in the geological record. If a model can correctly simulate trends from a starting point somewhere in the past through to the present day, it has passed that test. We can therefore expect it to simulate what might happen in the future. And that's exactly what has happened. From early on, climate models predicted future global warming. Multiple lines of hard physical evidence now confirm the prediction was correct.
Finally, all models, weather or climate, have uncertainties associated with them. This doesn't mean scientists don't know anything - far from it. If you work in science, uncertainty is an everyday word and is to be expected. Sources of uncertainty can be identified, isolated and worked upon. As a consequence, a model's performance improves. In this way, science is a self-correcting process over time. This is quite different from climate science denial, whose practitioners speak confidently and with certainty about something they do not work on day in and day out. They don't need to fully understand the topic, since spreading confusion and doubt is their task.
Climate models are not perfect. Nothing is. But they are phenomenally useful.
Please use this form to provide feedback about this new "At a glance" section. Read a more technical version below or dig deeper via the tabs above!
Further details
Climate models are mathematical representations of the interactions between the atmosphere, oceans, land surface, ice – and the sun. This is clearly a very complex task, so models are built to estimate trends rather than events. For example, a climate model can tell you it will be cold in winter, but it can’t tell you what the temperature will be on a specific day – that’s weather forecasting. Climate trends are weather, averaged out over time - usually 30 years. Trends are important because they eliminate - or "smooth out" - single events that may be extreme, but quite rare.
Climate models have to be tested to find out if they work. We can’t wait for 30 years to see if a model is any good or not; models are tested against the past, against what we know happened. If a model can correctly predict trends from a starting point somewhere in the past, we could expect it to predict with reasonable certainty what might happen in the future.
So all models are first tested in a process called Hindcasting. The models used to predict future global warming can accurately map past climate changes. If they get the past right, there is no reason to think their predictions would be wrong. Testing models against the existing instrumental record suggested CO2 must cause global warming, because the models could not simulate what had already happened unless the extra CO2 was added to the model. All other known forcings are adequate in explaining temperature variations prior to the rise in temperature over the last thirty years, while none of them are capable of explaining the rise in the past thirty years. CO2 does explain that rise, and explains it completely without any need for additional, as yet unknown forcings.
Where models have been running for sufficient time, they have also been proved to make accurate predictions. For example, the eruption of Mt. Pinatubo allowed modellers to test the accuracy of models by feeding in the data about the eruption. The models successfully predicted the climatic response after the eruption. Models also correctly predicted other effects subsequently confirmed by observation, including greater warming in the Arctic and over land, greater warming at night, and stratospheric cooling.
The climate models, far from being melodramatic, may be conservative in the predictions they produce. For example, here’s a graph of sea level rise:
Observed sea level rise since 1970 from tide gauge data (red) and satellite measurements (blue) compared to model projections for 1990-2010 from the IPCC Third Assessment Report (grey band). (Source: The Copenhagen Diagnosis, 2009)
Here, the models have understated the problem. In reality, observed sea level is tracking at the upper range of the model projections. There are other examples of models being too conservative, rather than alarmist as some portray them. All models have limits - uncertainties - for they are modelling complex systems. However, all models improve over time, and with increasing sources of real-world information such as satellites, the output of climate models can be constantly refined to increase their power and usefulness.
Climate models have already predicted many of the phenomena for which we now have empirical evidence. Climate models form a reliable guide to potential climate change.
Mainstream climate models have also accurately projected global surface temperature changes. Climate contrarians have not.
Various global temperature projections by mainstream climate scientists and models, and by climate contrarians, compared to observations by NASA GISS. Created by Dana Nuccitelli.
A 2019 study led by Zeke Hausfather (Hausfather et al. 2019) evaluated 17 global surface temperature projections from climate models in studies published between 1970 and 2007. The authors found "14 out of the 17 model projections indistinguishable from what actually occurred."
There's one chart often used to argue to the contrary, but it's got some serious problems, and ignores most of the data.
Last updated on 26 May 2023 by John Mason. View Archives
One Planet Only Forever @1325,
Spencer is not the first to waste his time searching for that mythical archepelago known as The Urban Heat Islands. Of course these explorers are not trying to show such islands exist (they do) but to show the rate of AGW is being exaggerated because of these islands. That's where their myth-making kicks off.
This particular blog of Spencer's is a bit odd on a number of counts. He tells us he is correlating 'temperature' against 'level of urbanisation' using temperature data of his own derivation and paired urban/rural sites, this all restricted to summer months. Yet this data shown in his Fig 1 seems to show temperatures mainly for a set of pretty-much fixed levels of ΔUrbanisation (no more than 5% ΔUrbanisation over a 10-mile square area), so not for any significant changing levels of urbanisation. The data showing these urban records warming faster under AGW that nearby rural stations and thus the actual variation in warming between his paired rural/urban stations is not being presented.
And note his "sanity check" appears to confirm that "homogenization" provides entirely expected results so why is he using his own temperature derivations?
And I'm also not sure his analysis isn't hiding some embarassing findings. Thus according to the GISTEMP station data, the urban Calgary Int Airport & rural Red Deer have a lot less summer warming than the urban Edmonton Int Airport & rural Cold Lake. The data doesn't cover the full period, but it is rural Cold Lake that shows the most warming of the four.
MA Roger @1326,
Thank you for adding technical details to my 'general evaluation' that Spencer is not developing and sharing genuine improvements of awareness and understanding.
The following part of the Conclusion that I quoted @1325 is a very bizarre thing to be stated by someone supposedly knowledgeable and trying to help others better understand what is going on.
"As it is, there is evidence (e.g. here) the climate models used to guide policy produce more warming than observed, especially in the summer when excess heat is of concern. If that observed warming is even less than being reported, then the climate models become increasingly irrelevant to energy policy decisions."
Spencer is silent about considering aspects of the models that underestimate the warming (those aspects probably deserve as much, and potentially more, consideration). Their narrow focus actually makes their developed analysis 'irrelevant to energy policy decisions'.
In spite of Spencer creating something claimed to dictate that there should be reduced effort to end fossil fuel use, the point remains that the overall global warming and resulting global consequences are the required understanding for Policy Development by any government (at any level).
I have work experience with the development of large complex projects. Planning is done at various stages to establish an expected duration and cost to complete the project. The resulting plans often trigger game-playing by project proponents, especially if the plan indicates that completion will be too late or cost too much for the project to be pursued any further. The game-players try to focus on what they believe are long duration aspects that should be able to be done quicker or higher cost items that should be able to be less expensive. What people like me do, to be helpful to all parties involved, is agree with the narrow-focused project proponents as long as they agree to put the extra effort into re-evaluating every aspect of the project plan, especially the items that could take much longer or cost more than estimated.
People like Spencer are like those project proponents. They seek out and focus on the bits they think help justify their preferred belief rather than increasing their overall understanding to make a more knowledgeable decision.
Discovered inaccuracies in the models may be important to correct. But for Energy Policy development the most important consideration is the overall understanding of the model results, not a focus on selected bits of model results.
That is one weird analysis presented by Spencer. I read the blog post OPOF pointed to, and the one linked in it that points to an earlier similar analysis.
I really cannot figure out what he has done. Figure 1 refers to "2-Station Temp Diff.", but there is no indication of how many stations are included in the dataset, or exactly how he paired them up. Is each station only paired to one other station, or is there a point generated for each "station 2" that is within a certain distance? He talks about a 21x21km area centered on each station - but he also mentioned a 150km distance limit in pairing stations. Not at all clear.
There are also some really wonky statements. He talks about "operational hourly (or 3-hourly) observations made to support aviation at airports" and claims "...better instrumentation and maintenance for aviation safety support." He clearly has no understanding of the history of weather observations in Canada. Aviation weather historically was collected by Transport Canada (a federal government department), and indeed the Meteorological Service of Canada (as it is now known) was part of that department before the creation of Environment Canada in the early 1970s. Even though MSC was in a different department, it still looked after the installation, calibration, and maintenance of the "Transport Canada" aviation weather instrumentation. This even continued (under contract) for a good number of years after the air services were moved out into the newly-created private corporation Nav Canada in 1996. The standards and instrumentation at aviation weather stations was no different from any other station operated by MSC. Now, Nav Canada buys and maintains its own instruments, and MSC has ended up going back to many of these locations to install their own instrumentation because the Nav Canada "aviation" requirements do not include long-term climate monitoring. (Nav Canada data still funnels into the MSC systems, though.)
What has changed over time is levels of automation. Originally, human observers recorded data and sent it into central collection points. Now, nearly all observations are made by fully-automated systems. A variety of automatic station types have existed over the decades, and there have been changes in instrumentation.
As for the 3-hour observing frequency? Not an aviation requirement - but rather the standard synoptic reporting interval used by the World Meteorological Organization.
So, reading Spencer's analysis raises large numbers of questions:
Without this information, it is very difficult to check the validity of the comparisons he is making. Figure 1 has a lot of points - but later in the post he mentions only having four stations in "SE Alberta" (Edmonton, Red Deer, Calgary, and Cold Lake). Does figure 1 included many "within 150km" stations paired to each individual station in the list? Does this mean that within an area containing say 5 stations, that there are 4x3x2 "pairs"? That would be one way of getting a lot of points - but they would not be independent. We are left guessing.
Spencer links to this data source for weather data. I managed to search for stations in "Alberta", and found 177 active on January 1, 2021. It contains six stations with "Edmonton" in the name. Which one is Spencer's "Edmonton" is important. It is almost certainly the International airport south of the city (often jokingly called "Leduc International Airport because of its distance from the city proper), but the downtown Municipal airport is also on the NOAA/NCEI list. The difference in urbanization is huge - the Leduc one has some industrial areas to the east, but as you can see on this Google Earth image, it is largely surrounded by rural land. The downtown airport would be a much better "urban" location. The Leduc location only has "urbanization" to the east - downwind of the predominant west-east wind and weather system movements.
My number of 177 Alberta stations is an overestimate, as the NOAA/NCEI web page treats "Alberta" as a rectangular block that catches part of SE British Columbia. I also only grabbed recently-active stations - the number available over time changes quite a bit. The lack of clarity from Spencer about station selection is disturbing.
As MAR has pointed out, Spencer's four "SE Alberta" stations of Edmonton, Red Deer, Calgary, and Cold Lake make for an odd mix. The first three are all in a 300km N-S line in the middle of the province. Edmonton is 250km from the mountains; Red Deer about 125km, and Calgary about 65km. (For a while, I had an office window in Calgary where I could look out at the snow-capped mountains.) Cold Lake is about 250km NE of Edmonton, near the Saskatchewan border. The differences in climate are strong. Spencer dismisses these factors as unimportant.
Spencer's Table 1 (cities across Canada) suffers from the same problems: not clearly identifying exactly which station he is examining. At least here he says "Edmonton Intl. Arpt".
He does not clearly explain his method of urban de-trending. I followed his link to the earlier blog post that gives more information, but it is not all that helpful. As far as I can tell, he's used figure 4 in that blog post to determine a "temperature difference vs urbanization difference" relationship and then used that linear slope to "correct" trends at individual stations based on the Urbanization coefficients he obtained from a European Landsat analysis for the three times he used in his analysis (1990, 2000, and 2014). Figure 4 is a shotgun blast, and he provides no justification for assuming that an urbanization change from 0 to 10% has the same effect as a change from 80-90%. (Such an assumption appears to be implicit in his methodology.) In fact, many studies in urban heat island effect have show log-linear relationships for UHI vs population of other indicators (e.g., Oke, 1973). Spencer's figure 4 in that second blog post is also for "United States east of 95W". No justification as to why that analysis (with all its weaknesses) would be applicable in a very different climate zone such as the Canadian prairies (Alberta).
His list of 10 Canadian cities also has some wildly different climate zones in it.
Spencer should be embarrassed by this sort of analysis, but I doubt he cares. He has the "result" he wants.
Bob Loblaw @1328,
Thanks for providing even more evidence and reasons to doubt what Spencer produces and the claims he makes-up.
I share the understanding that Spencer does not care about how flawed his analysis is.
I would add that it appears to be highly likely that, long ago, he predetermined that his focus would be on finding ways to claim that less aggressive leadership action should be taken to end fossil fuel use. Spencer's motivating requirement appears to be having the analysis 'results' fit that narrative.
Can anyone comment (in terms that an intelligent but relative domain novice might understand) on Nic Lewis's 'rebuttal' (specifically his 3 claims and conclusion) of Steven Sherwood et al's findings relative to effective sensitivity and it's uncertainty ?
Sherwood: https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2019RG000678
Lewis: https://link.springer.com/article/10.1007/s00382-022-06468-x
[BL] Links activated...
...but, you have asked the same question on another thread, and have already received an answer there.
Please do not post the same information on multiple threads. Pick one, and stick to it, so all responses can be seen together. New comments are always visible - regardless of the thread - from the Comments link immediately under the masthead.
Anyone reading this comment in the "Models are unreliable" thread should follow the link to the comment on the "How sensitive is our climate?" thread and respond there.
Please note: the basic version of this rebuttal has been updated on May 26, 2023 and now includes an "at a glance“ section at the top. To learn more about these updates and how you can help with evaluating their effectiveness, please check out the accompanying blog post @ https://sks.to/at-a-glance
Thanks - the Skeptical Science Team.