Climate Science Glossary

Term Lookup

Enter a term in the search box to find its definition.

Settings

Use the controls in the far right panel to increase or decrease the number of terms automatically displayed (or to completely turn that feature off).

Term Lookup

Settings


All IPCC definitions taken from Climate Change 2007: The Physical Science Basis. Working Group I Contribution to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, Annex I, Glossary, pp. 941-954. Cambridge University Press.

Home Arguments Software Resources Comments The Consensus Project Translations About Support

Twitter Facebook YouTube Mastodon MeWe

RSS Posts RSS Comments Email Subscribe


Climate's changed before
It's the sun
It's not bad
There is no consensus
It's cooling
Models are unreliable
Temp record is unreliable
Animals and plants can adapt
It hasn't warmed since 1998
Antarctica is gaining ice
View All Arguments...



Username
Password
New? Register here
Forgot your password?

Latest Posts

Archives

Just Put the Model Down, Roy

Posted on 2 August 2011 by bbickmore

This is a re-post of an entry on Dr. Barry Bickmore's blog, Anti-Climate Change Extremism in Utah

For the past few years, Roy Spencer has had a love affair, of sorts, with “simple climate models”.  After all, who needs some fancy-schmancy global circulation model (GCM) when you can boil down the main features (energy in and energy out) to a simple “1-box” or “zero-dimensional” model that you can run on a spreadsheet?

Spencer wasn’t the first one to use such a model, and every modeler knows that it is usually a good idea to use the simplest model you can get away with to represent complex physical processes.  The key here is to recognize that the simpler the model, the more phenomena are glossed over, so simpler models are only going to be good for particular, specialized purposes.

In this case, Spencer wants to use simple climate models to estimate equilibrium climate sensitivity for a doubling of CO2.  Let’s look back and see how he’s done with that so far.

The Model

The basic model is shown in Eqn. 1 below.

Equation 1:  d(?T)/dt = (Forcing – Feedback)/Cp

Here, ?T is the difference between the temperature at time t and the temperature at equilibrium.  (That is, ?T is the “temperature anomaly” with respect to equilibrium.)  Cp is the total heat capacity of a column of ocean water 1 m^2 on top and h meters deep.  The Forcing tells us the rate at which extra energy is coming in, while the feedback tells us how the climate system responds to the push, by either enhancing the forcing or hitting the brakes.  Another way of putting it is that (Forcing –Feedback) gives you the net change in the energy accumulating in the ocean, and Cp controls how quickly the ocean temperature can change in response.

The Feedback term in Eqn. 1 can be broken down as in Eqn. 2 below.  This means that the hotter the ocean becomes, the more it radiates energy back into space, and the alpha term determines the degree to which this is the case.  The alpha term also determines the equilibrium climate sensitivity

Equation 2:  Feedback = alpha * ?T

The Forcing term can be divided up into contributions from different sources–changes in solar output, greenhouse gases, aerosols, and so on–or lumped into one.  In some versions of his model, Spencer uses the GISS forcing history, where they are all lumped together.  In others, he multiplies the index for some natural mode of climate variability (like ENSO or PDO) with a scaling factor to obtain a hypothetical forcing, as in Eqn. 3, where beta is a scaling factor and Vi is the natural variability index being used.  In still other incarnations, he combines the GISS forcing with the “internal” forcing provided by Eqn. 3.

Equation 3:  Forcing = beta * Vi

Finally, in the latest versions of his model, Spencer has begun adding more layers to the ocean.  Whereas the original version only had one homogeneous ocean layer of depth h, the latest ones have 30-40 ocean layers, each 50 m deep.  Eqn. 1 governs the net energy input into the top layer, but Spencer also adds a “diffusion” term so heat can escape into the next layer down.  The second through 30th layers all have diffusion terms for heat coming in the top and heat going out the bottom.  Eqn. 4 shows what one of these diffusion terms look like for heat going out the bottom of a layer, where ?T is the temperature anomaly of the layer in question, ?Tnl is the temperature anomaly of the next layer down, D is a diffusion coefficient, and Cp is the heat capacity of a 1 x 1 x 50 m column of water.

Equation 4:  -d(?T)/dt = D * (?T – ?Tnl)/Cp

It’s the PDO!

In his first attempt, Spencer asked, what if it isn’t human greenhouse emissions that have been driving climate change, lately, but rather natural, chaotic oscillations?  Spencer thinks that one such oscillation, the Pacific Decadal Oscillation (PDO) may have been the culprit.  He fit his simple climate model (Eqns. 1-3 with only one ocean layer) to temperature data for the 20th century, and found that he could explain most of the observed warming!  He tried to publish these results in a climate journal, but (he says) biased reviewers and editors maliciously quashed the manuscript.  So instead, he decided to take his message directly to the people by publishing this work in his book, The Great Global Warming Blunder.

I wrote about this modeling effort in Part 3 of my recent review of Spencer’s book.  I even went to the trouble of programming his model into MATLAB and fitting the parameters using least-squares regression.  I found that some of the parameters in the model were perfectly covariant, so that there were an infinite number of “best-fit” solutions with climate sensitivities ranging from really low to really high.  You see, if you fool around with alpha and beta, you can control how fast energy builds up in the ocean surface layer, and if you fool around with the depth of the surface layer (h), you can control how much water has to be heated up, which affects how quickly the temperature can approach a new equilibrium.  He also had a couple other fitting parameters (for a total of five) that I discussed in the review.

But even though he could have gotten exactly as good a fit to the data with low or high climate sensitivity, Roy Spencer claimed his modeling provided striking evidence for low sensitivity.  The secret was that he didn’t use a normal optimization routine to get his “best fit” parameter values.  Instead, he made up a bogus statistical technique that automagically allowed him to obtain a low sensitivity (about 1.3 °C for 2x CO2).  Furthermore, by manipulating the starting value of his model temperature series, Spencer was able to make his model fit the first half of the data without much influence from the PDO.  Finally, he used wildly unphysical model parameters, e.g., a 700 m ocean mixed layer.  When you are fitting a model with 4-5 completely unconstrained parameters, after all, it’s hardly surprising if you can explain some data, but it would be foolhardy to take the fitted parameter values too seriously.

To put it bluntly, I found that this work deserved to be rejected–with prejudice–from the scientific literature.

It turned out that my book review became rather popular, and many of Roy’s blog readers were asking him for a response.  He did respond…that he wasn’t going to respond.  Why?  Because he was working on a paper for the peer-reviewed literature, so he couldn’t be bothered to respond to a mere blog critique.  I thought that was kind of funny, given that my review was about work Spencer had published in a book because he claimed the peer-review process had been corrupted, but hey, people have to prioritize.  It’s been months, however, and Spencer still hasn’t gotten around to answering my initial criticisms.  He has, ironically, had time to publish four more blog posts in which he used variants of the same simple climate model to support his claim that climate sensitivity is low.

Ocean Heat Content

In the first of these posts, Spencer drove his model with GISS forcing estimates and fit it to ocean heat content (OHC) data since 1955.  Once again, I reviewed his methods and found he had made several elementary mistakes, ALL of which drove his model climate sensitivity lower.  When I corrected these mistakes, I got a higher climate sensitivity, within the IPCC’s most probable range of 2-4.5 °C (2x CO2).  I also mentioned that it isn’t clear such a simple climate model is really suited for estimating climate sensitivity, especially when only constrained by about 50 years of data.  Isaac Held, for instance, had fit a simple climate model just like Roy’s to the 20th century output of a GCM with a climate sensitivity of 3.4 °C, but the sensitivity of the simple model (which was tuned to give the same output!!!) was only about 1.5 °C.  No response from Roy so far.

Ocean Temperature Change With Depth

Now we come to Spencer’s second and third blog posts of this type (with a follow-up on the third post here), in which he used somewhat more complicated versions of the model.  As I mentioned above, these new versions of the model are different in that they represent the ocean with 30-40 layers, each 50 m deep.  The heat flux into the top layer was determined by the same old simple climate model (Eqns. 1-2), but then for every ocean layer Spencer added another term to represent “diffusion” of heat from that layer into the next one down (Eqn. 4).  In his second blog post, he drove his model with the GISS forcings and fit the output to match a profile of temperature change with ocean depth for the last 40 years, published by the IPCC (2007, WG1, Fig. 9.15).  In his third post, he drove the model using both the GISS forcings and “internal” forcing caused by ENSO (Eqn. 4), and fit his model to the temperature evolution over 1955-present or 1880-present.  He also compared the temperature change from 1955-present in the different ocean layers to the IPCC curve.

The curve fits look pretty impressive, especially when the ENSO forcing is added in.  Even many of the little squiggles in the surface temperature data are matched quite well by the model!  What’s more, the model climate sensitivities were only around 1 °C, much lower than the IPCC estimate of 2-4.5 °C!!!  Indeed, Spencer began one of these blog posts with the following bold proclamation.

The evidence for anthropogenic global warming being a false alarm does not get much more convincing than this, folks.

But wait–remember how I criticized Spencer for the wild and crazy curve-fitting adventures he chronicled in his book?  And how he decided he wasn’t going to respond?  Well, the fact is that he’s making the same kinds of errors again, and patting himself on the back for it.  Here are several reasons why nobody should take Roy’s pronouncements of victory seriously.

In Spencer’s original model, he could tune the beta and h parameters to get ANY CLIMATE SENSITIVITY HE WANTED, with exactly the same quality of curve fit.  That was because manipulating beta and alpha (which determines climate sensitivity) changes the net rate of energy input into the top of the surface layer, while manipulating h changes how fast the ocean heats up in response.  In his latest posts, it’s about the same story.  He can still manipulate beta and alpha to change the net input into the top of the ocean, but now to change the temperature response, he just has to change the thermal diffusion rate out the bottom!  I dinked around with a spreadsheet he provided in one of his posts, and sure enough, I could fit the data just about as well with higher climate sensitivity (within the IPCC range).

That’s a big problem, because Spencer’s entire argument is statistical in nature, but he has made no attempt to find out how sensitive his model fits are to the different parameter values.  If the model fit is about equally as good with low or high climate sensitivity, after all, then the modeling exercise has given us NO INFORMATION about the relative plausibility of either scenario.  It does not count as evidence for ANYTHING, in other words.

Supposing Spencer does try to go back and quantify parameter sensitivity, then good luck with that, because his newer models all have MORE THAN 30 FULLY ADJUSTABLE PARAMETERS (alpha, beta, and diffusion coefficients for heat transfer between layers).  After Tim Lambert over at Deltoid read my review of Spencer’s book, he posted a quotation from the famous mathematician, John von Neumann.

With four parameters I can fit an elephant, and with five I can make him wiggle his trunk.

Well, give me more than 30 parameters, and I can fit a trans-dimensional lizard-goat and make rainbow monkeys shoot out its rear end.

Some Spencer-boosters might complain that the GCMs used by IPCC scientists have many more parameters than that.  That’s a good point, except that those are typically not “fully adjustable.”  When a modeler is using a complicated model, instead of letting all the parameters ride in some kind of statistical free-for-all, he or she typically would constrain most of the parameters to physically reasonable values.  For instance, if in his original attempt Spencer had constrained the mixed-layer depth of the ocean (h) to a physically reasonable value (say about 100 m), he would have come up with much higher climate sensitivity.  Instead, he allowed a 700 m mixed layer depth (!!!!!) to get the answer he wanted.

In the later versions of his model, Spencer would have to constrain his diffusion coefficients to physically reasonable values, but there’s a problem with that.  In the real world, “diffusion” is governed by random molecular motions, and can be described by expressions like Eqn. 4, but it’s typically very, very slow.  Since heat transfer in the ocean doesn’t happen so slowly, it’s apparent that much of the heat transfer is due to “advection,” rather than diffusion.  Thermal advection is essentially movement of heat with the medium, i.e., in currents, and it isn’t necessarily linearly proportional to the temperature difference between layers of the ocean, as in Eqn. 4.  That being the case, I don’t have a clue what “physically reasonable” values for the model’s diffusion coefficients would be.

Let’s ignore that last objection about the form of the model for a moment, and bring up a nitpick about how Spencer set up his model.  That is, he set the initial temperature anomalies to zero for ALL the ocean layers.  Since heat diffusion is dependent on the temperature difference between layers (Eqn. 4), that means Spencer set his model up so there would be NO HEAT TRANSFER among layers at the beginning of the simulation, and it gradually builds up over time.

The Challenge

I could go on with more nitpicks, but I’m going to stop here, because it should be clear that, once again, Spencer has made a big deal out of something that doesn’t have any evidentiary value.  So if, as Spencer claims, “[t]he evidence for anthropogenic global warming being a false alarm does not get much more convincing than this,” then can we please move on?  Can Roy PLEASE put his toy model down?

I doubt he will, but maybe he will accept this challenge.  Instead of complaining about how biased and awful the peer review system has gotten, he should (at the very least) get a statistician to work with him and do the modeling right, and then submit it for publication.  Personally, I don’t think the work can be saved, even then.  However, I think the exercise of working with someone who knows how to properly make statistical inferences would be enlightening for Roy Spencer.

0 0

Printable Version  |  Link to this page

Comments

Prev  1  2  

Comments 51 to 59 out of 59:

  1. Mostly, you cannot change people's political values. We may even be born with them. What you need to do is divorce the facts from a particular political strategy. Normal political narratives (right or left) retell facts and history to fit a values-based outlook on the world. Politicians are extremely adept at this so its best not to try and compete.
    0 0
  2. scaddenp @51 I agree totally. The trouble is that media outlets, at least in Australia and the USA, seem to be becomming more polarised towards representing particular political points of view. Dispassionate representation of facts and background is on the decline. Makes getting a scientific result across to the public rather difficult when news outlets are partisan.
    0 0
  3. Hrmmm . . . yeah I don't know, scadden. It has been demonstrated endlessly that when one's position within the economy changes, one's politics change. Some of the basic goals might not change (e.g, "end human suffering"), but the willingness to accept certain means to achieve those goals does change. Education can also change politics. Particular political strategies emerge from the defense of economic positions, and this emergence is modified by awareness (knowledge does indeed force responsibility, to some extent). That's why the doubt game works so well. All that is needed is to bump an idea from the "fact" category to the "well, I don't know" category. You have to compete. A group of southerners in the U.S. tried for decades to normalize the idea of slavery. The idea didn't just peter out on its own. Changing someone;s politics can be done, but it takes repeated efforts, observable evidence, and tact. I suspect that even the most apparently unchangeable 'skeptics' who post here have had their politics altered significantly while engaging in the comment stream. That's what it takes: dialogue. Not the article but the discussion that follows. It's a beastly slow process, but it beats shooting people.
    0 0
  4. DSL @53 Thankyou for restoring my sense of hope. "repeated efforts, observable evidence, and tact" - that was very succinct and hit the nail squarely on the head.
    0 0
  5. "I don't know, scadden. It has been demonstrated endlessly that when one's position within the economy changes, one's politics change" Different to what I have read (though I am talking about political values). This is way, way off topic, but can you give me a reference? My very cynical view of politics is that for most voters, utter self-interest rules. For the rich that means "I'm expected to pay $x in tax? But I earned all this" while at the other end its "But I deserve this, its my right,- so someone should pay for it". Left and right then have serious thinkers to provide a backstay to both views. In this sense, I can see how movement in economy would affect vote, but there are values around liberty of action, group loyalty, criminal justice etc. etc. that I dont think are so pliable. I think the right wing denial of climate change goes further than self-interest.
    0 0
  6. I think I've commented on this before. Anyway, it's my business to understand how the beliefs of people are transformed. It's a huge subject scattered across education, psychology, political science, economics, art, and other disciplines. As far as economic position is concerned, consider what happens to the politics of a line worker when that worker is promoted to a management position. I've worked in factories, service industries, and owned a business, and I am now working in the ivory tower. In each of those situations, I've seen people (my own father, for example) change their relations as they moved from one position to another. I've seen a man who was a strong believer in collective bargaining and social justice promoted to manager and turn into an apologist for the company and a Republican voter ("all you have to do is work hard and good things will happen"). He'd even bring his new boat to work on Fridays, a behavior he would have found atrocious five years earlier. I've seen a man become wealthy and embrace religion in a way he had laughed at as a young adult (remember, religious belief and economy were once inseparable). I've also been friends with ex-managers who, after having been laid-off, took a good long look at how they had changed and been asked to behave as a manager. What's curious is what happened to these people next, and it depended on what they began to do for work. Pay gradation started out as a way to drive wedges into worker solidarity. Give a guy a tiny raise, and he's a little less likely to complain. It's like a kiss--a promise of future riches--a tiny concrete hook to hang one's dreams on. Suddenly it's about you and not solidarity. Most people simply don't actively monitor how their beliefs are constructed, and so they go through life being blown around on the winds of rhetoric. Their aggregate momentum is displayed in large-scale patterns--democratic oscillations, directionless "live-in-the-now" thinking, hyperindividualism, etc. I want to go into a description of postmodern conditions, but this is all a massive set of circumstances. You're right, though: this is way off topic. Spencer is a useful case, though. Note that people who want a more results-driven, pay-for-performance model of public education probably also tout Spencer as a leading authority on climate change. Insert X noise from old Family Feud episode.
    0 0
  7. This thread jogged my memory and I found this at Arthur Smith's site: "Roy Spencer's six trillion degree warming" It builds on Barry Btickmore's early debunking. Key takeway from Dr. Smith: "It turns out you need to set the starting temperature to negative six trillion degrees in 993, in order to match Spencer's model for the 20th century. 6 trillion degrees. Wow. Now that's global warming!" url: http://arthur.shumwaysmith.com/life/content/roy_spencers_six_trillion_degree_warming
    0 0
  8. @Rob Honeycutt >> I would be very interesting to use Roy's model to produce a "paper" showing extremely high climate sensitivity and publish it in the same journal this one was published. Right. Perhaps adjust the main equation a little if necessary. Then start the show by producing a new set of parameters that lead to similar predictions 100 years out after matching current data. [At this point "skeptics" will be jumping in their seats.] Then get a new set of parameters that lead to 200 deg C increase instead. Finally, wrap up with yet another set of values that predicts 200 deg C decrease despite overlapping with current satellite data. The point of the exercise would be to demonstrate to the layperson that we can construct a complex curve to resemble, in close-up range, any simpler curve (such as a simpler curve approximating satellite data of a certain time period). [Ask a mathematician to state a proper theorem and quantify it more accurately.] Intuitively, what is happening is that some parts of the complex formula look like the simpler curve while other parts of the complex formula cancel out or are close to zero during the particular close-up region. These parts that disappear during that region then kick in as we move away. A physical hypothetical example would be that some very high "positive feedbacks" are dormant until some level of its independent variables (eg, some particular gas level in the atmosphere or some temperature value) are triggered or until "exponential" growth "kicks in" at the resolution we are looking at. Another intuitive explanation is that we can trace over whatever simple curve we want and then draw out the rest of the curve into the future however we feel like it. This technique is sometimes also described this way "add your favorite data points next to satellite data points and let your 5 year old child connect the dots".
    0 0
  9. I wish I would have read comment 57 before posting 58.
    0 0

Prev  1  2  

You need to be logged in to post a comment. Login via the left margin or if you're new, register here.



The Consensus Project Website

THE ESCALATOR

(free to republish)


© Copyright 2024 John Cook
Home | Translations | About Us | Privacy | Contact Us