The right strategy wins the war WeatherShop.com Gifts, gadgets, weather stations, software and more...click here!\
The Blogosphere
Friday, September 30, 2011
GAO report on the poor quality of the US climate monitoring network

By Anthony Watts

Senator Inhofe’s EPW office issued a press release today on the subject of USHCN Climate Monitoring stations along with links to this report from the General Accounting Office (GAO)

...the report notes, “NOAA does not centrally track whether USHCN stations adhere to siting standards...nor does it have an agency-wide policy regarding stations that don’t meet standards.” The report continues, “Many of the USHCN stations have incomplete temperature records; very few have complete records. 24 of the 1,218 stations (about 2 percent) have complete data from the time they were established.” GAO goes on to state that most stations with long temperature records are likely to have undergone multiple changes in measurement conditions.

The report shows by their methodology that 42% of the network in 2010 failed to meet siting standards and they have recommendations to NOAA for solving this problem. This number is of course much lower than what we have found in the surfacestations.org survey, but bear in mind that NOAA has been slowly and systematically following my lead and reports and closing the worst stations or removing them from USHCN duty. For example I pointed out that the famous Marysville station (see An old friend put out to pasture: Marysville is no longer a USHCN climate station of record) that started all this was closed just a few months after I reported issues with its atrocious siting. Recent discoveries of closures include Armore (shown below) and Durant OK. This may account for a portion the lower 42% figure for “active stations” the GAO found. Another reason might be that they tended towards using a less exacting rating system than we did.

Recently, while resurveying stations that I previously surveyed in Oklahoma, I discovered that NOAA has been quietly removing the temperature sensors from some of the USHCN stations we cited as the worst (CRN4, 5) offenders of siting quality. For example, here are before and after photographs of the USHCN temperature station in Ardmore, OK, within a few feet of the traffic intersection at City Hall:

image
Ardmore USHCN station , MMTS temperature sensor, January 2009

image
Ardmore USHCN station , MMTS temperature sensor removed, March 2011

While NCDC has gone to great lengths to defend the quality of the USHCN network, their actions of closing them speak far louder than written words and peer reviewed publications.

I don’t have time today to go into detail, but will follow up at another time. Here is the GAO summary:

Climate Monitoring: NOAA Can Improve Management of the U.S. Historical Climatology Network

GAO-11-800 August 31, 2011
Highlights Page (PDF) Full Report (PDF, 47 pages) Accessible Text Recommendations (HTML)

Summary

The National Oceanic and Atmospheric Administration (NOAA) maintains a network of weather-monitoring stations known as the U.S. Historical Climatology Network (USHCN), which monitors the nation’s climate and analyzes long-term surface temperature trends. Recent reports have shown that some stations in the USHCN are not sited in accordance with NOAA’s standards, which state that temperature instruments should be located away from extensive paved surfaces or obstructions such as buildings and trees. GAO was asked to examine (1) how NOAA chose stations for the USHCN, (2) the extent to which these stations meet siting standards and other requirements, and (3) the extent to which NOAA tracks USHCN stations’ adherence to siting standards and other requirements and has established a policy for addressing nonadherence to siting standards. GAO reviewed data and documents, interviewed key NOAA officials, surveyed the 116 NOAA weather forecast offices responsible for managing stations in the USHCN, and visited 8 forecast offices.

In choosing USHCN stations from a larger set of existing weather-monitoring stations, NOAA placed a high priority on achieving a relatively uniform geographic distribution of stations across the contiguous 48 states. NOAA balanced geographic distribution with other factors, including a desire for a long history of temperature records, limited periods of missing data, and stability of a station’s location and other measurement conditions, since changes in such conditions can cause temperature shifts unrelated to climate trends. NOAA had to make certain exceptions, such as including many stations that had incomplete temperature records. In general, the extent to which the stations met NOAA’s siting standards played a limited role in the designation process, in part because NOAA officials considered other factors, such as geographic distribution and a long history of records, to be more important. USHCN stations meet NOAA’s siting standards and management requirements to varying degrees. According to GAO’s survey of weather forecast offices, about 42 percent of the active stations in 2010 did not meet one or more of the siting standards.

With regard to management requirements, GAO found that the weather forecast offices had generally but not always met the requirements to conduct annual station inspections and to update station records. NOAA officials told GAO that it is important to annually visit stations and keep records up to date, including siting conditions, so that NOAA and other users of the data know the conditions under which they were recorded. NOAA officials identified a variety of challenges that contribute to some stations not adhering to siting standards and management requirements, including the use of temperature - measuring equipment that is connected by a cable to an indoor readout device - which can require installing equipment closer to buildings than specified in the siting standards. NOAA does not centrally track whether USHCN stations adhere to siting standards and the requirement to update station records, and it does not have an agencywide policy regarding stations that do not meet its siting standards. Performance management guidelines call for using performance information to assess program results. NOAA’s information systems, however, are not designed to centrally track whether stations in the USHCN meet its siting standards or the requirement to update station records. Without centrally available information, NOAA cannot easily measure the performance of the USHCN in meeting siting standards and management requirements.

Furthermore, federal internal control standards call for agencies to document their policies and procedures to help managers achieve desired results. NOAA has not developed an agencywide policy, however, that clarifies for agency staff whether stations that do not adhere to siting standards should remain open because the continuity of the data is important, or should be moved or closed. As a result, weather forecast offices do not have a basis for making consistent decisions to address stations that do not meet the siting standards. GAO recommends that NOAA enhance its information systems to centrally capture information useful in managing the USHCN and develop a policy on how to address stations that do not meet its siting standards. NOAA agreed with GAO’s recommendations.

Recommendations

Our recommendations from this work are listed below with a Contact for more information. Status will change from “In process” to “Open,” “Closed - implemented,” or “Closed - not implemented” based on our follow up work.

Director: Anu K. Mittal
Team: Government Accountability Office: Natural Resources and Environment
Phone: (202) 512-9846
Recommendations for Executive Action
Recommendation: To improve the National Weather Service’s (NWS) ability to manage the USHCN in accordance with performance management guidelines and federal internal control standards, as well as to strengthen congressional and public confidence in the data the network provides, the Acting Secretary of Commerce should direct the Administrator of NOAA to enhance NWS’s information system to centrally capture information that would be useful in managing stations in the USHCN, including (1) more complete data on siting conditions (including when siting conditions change), which would allow the agency to assess the extent to which the stations meet its siting standards, and (2) existing data on when station records were last updated to monitor whether the records are being updated at least once every 5 years as NWS requires.

Agency Affected: Department of Commerce

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

---------------

Recommendation: To improve the National Weather Service’s (NWS) ability to manage the USHCN in accordance with performance management guidelines and federal internal control standards, as well as to strengthen congressional and public confidence in the data the network provides, the Acting Secretary of Commerce should direct the Administrator of NOAA to develop an NWS agencywide policy, in consultation with the National Climatic Data Center, on the actions weather forecast offices should take to address stations that do not meet siting standards.

Agency Affected: Department of Commerce

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

--------------------
Vindication for Alan Carlin
Anthony Watts

While the GAO issues a report today saying that the US Historical Climatological Monitoring Network has real tangible problems (as I have been saying for years) the Inspector General just released a report this week saying that EPA rushed their CO2 endangerment finding, skipping annoying steps like doing proper review. The lone man holding up his hand at the EPA saying “wait a minute” was Alan Carlin, who was excoriated for doing so. Read more here.

Icecap comment: Kudos to Anthony and the surfacestation.org team for raising this issue and forcing changes and now more transparency and to Alan Carlin for the courage to speak out from inside an agency on a mission.

Posted on 09/30 at 04:11 PM
(0) TrackbacksPermalink


Page 1 of 1 pages
Blogroll