Like TURF
Follow TURFToll forecasting slammed, grossly overstated
Wilbur Smith Assoc forecasting record slammed in report for Reston VA group
Posted on Fri, 2012-01-27 15:30
Toll Road News
Wilbur Smith Associates (WSA) record of traffic and revenue forecasting is blasted in a study done by a retired federal government economist Terry Maynard for the Reston Citizens Association (CRA) in northern Virginia. The report supports a call for an independent review of the WSA/CDMSmith traffic and revenue forecast of the Dulles Toll Road.
The analysis titled Traffic and Revenue Forecasts: Plenty of Room for Error by Terry Maynard finds that forecasts of revenue by WSA as it then was (just recently merged to form CDMSmith) are on average 2.27 times - or 127% too high - as compared with subsequently realized toll revenues.
This is based on the first five years of 12 toll projects forecast.
In addition Maynard finds that WSA had a pattern of understating the sensitive profit maximizing toll initially, then subsequently raising those estimates.
Maynard says that WSA routinely uses the highest population and employment forecasts for forecasting traffic.
Despite poor forecasts tollroads stuck with WSA.
WSA estimates for Dulles Toll Road revenues are suspect, Maynard writes, because they are already using numbers overstating Fairfax County employment by 25%.
What it calls the "pattern of overestimates" in WSA forecasting suggests a "substantial risk" in proceeding with the MWAA financial plan, Maynard writes.
Risks are:
- lenders won't fund the project without state guarantees or at investment grade rates
- tolls much higher than those forecast will emerge
- corridor economic growth will be hampered by the high costs
- MWAA may default and face much higher costs than cited
Terry Maynard: "RCA has long been enthusiastic about Metrorail to Dulles via Reston, but we do not want a rail line at any price, especially one that forces Dulles Toll Road users to absorb most of the financial burden and area communities to absorb added traffic on already crowded local roads. The prospects are even worse if the WSA forecasts overestimate revenues as much as our research suggests. We hope that an independent forecast, combined with ‘value engineering’ for Phase 2 and restructuring the financial arrangements will lead to a better outcome for everyone.”
2nd stage of Dulles Rail at stake
Future Dulles toll road revenues are being used as the security for selling the debt needed to fund a $5 billion Dulles Metrorail branch line from West Falls Church through Reston County to Dulles Airport and out into Loudoun County. Over half the capital cost is proposed to be covered by toll revenue bonds of the Dulles Toll Road issued by the Metropolitan Washington Airports Authority (MWAA) that has a 50 year franchise on the tollroad and is building the rail line.
Half of the rail line is a done deal, financed and under construction but the second half remains to be approved and financed. The WSA/CDMSmith investment grade traffic and revenue study to be released any week now will be key to whether the project proceeds.
A cover letter addressed to Governor Bob McDonnell, FHWA administrator Victor Mendez and top officials of MWAA and the two local counties charges that "WSA has made many very large errors in its forecasts that have been costly to investors, bondholders, governments, and toll road users who have relied on them to approve construction of major toll road projects."
It continues: "we believe that it is imperative that a second, independent T&R forecast be completed by another forecasting group before any decision is made to move forward with the construction of Phase 2 of the Silver (Dulles Rail) Line."
The citizens association says that given Wilbur Smith's record of overestimating revenues and the unexplained discrepancies between the first two WSA studies the various parties to the Dulles project - FHWA, MWAA, the two counties Fairfax and Loudoun as well as Virginia DOT - should defer any further commitments until Wilbur Smith's forecasts have been checked against those of an independent forecaster.
VDOT is called to take the lead in having WSA's results checked out.
It calls on FHWA to develop a process of 'best practices' for traffic and revenue forecasts given that the problem of gross exaggeration of traffic and revenue (T&R) prospects is seen across the whole T&R forecasting business.
Maynard devastating about track record of forecasting
A key finding of the Maynard Report (named after principal author Terry Maynard) is that "optimism bias" is endemic in the toll forecasting business, and that Wilbur Smith which does about half the industry's forecasts is typical of the industry - driven by sponsors to produce the exaggerated forecasts they want. It cites work by Robert Bain, Bent Flyvbjerg, NHCRP, and ourselves but goes into several forecasts with original work.
Bain using work he started at Standard and Poors found that of 100 tollroad forecasts worldwide the average actual traffic was 77% of forecast or an overestimate of about 30% for year 1 and only minor improvement after that.
NCHRP looked at 26 toll road forecasts in the US over the first five years and found worse results.
Writes Maynard: "The atrocious overestimates of revenue by all the forecasters reflected in this data highlight the difficulty in forecasting demand in the 'ramp-up' period of a new toll road. They are inadequate for planning future revenues, financing, and toll rates."
And there is little indication forecasts improve much over time.
On the Dulles Toll Road forecasting WSA starts with an inflated number for current employment in the major county served (900k vs 700k) and then inflates that faster than others with a higher growth rate (see graph nearby). Similarly on the Knik Arm bridge in Alaska WSA used exaggerated population and employment data, claiming to base them on numbers from a local University institute, which has denied its numbers are used.
Maynard picks up on what we reported (2011-04-11) as huge inconsistency in Dulles forecasting between WSA's modest projections of traffic and revenue for VDOT in 2005 and their highly bullish projections in 2009 for the new concessionaire MWAA. (see graphing of the inconsistency nearby)
Growth prospects declined in that period, and forecasts should have been lowered, not raised. WSA has never explained the basis for their large upward revisions.
"Our examination of vital population and employment input data used by WSA in its forecasts indicates it has almost always used the most optimistic data available to make its forecasts.
"This includes its 2005 and 2009 forecasts for the Dulles Toll Road. In its 2005 study, it utilized population and employment forecasts provided by GMU CRA which characterized official MWCOG forecasts as understating the area’s growth potential. Then, in 2009, it discarded the conclusions of the contractor it hired to do its socio-economic forecast, Linden Street Associates, Inc., of Alexandria, which had discounted the official MWCOG forecasts as overreaching.
"Instead, it used forecast data provided by Woods & Poole, Inc., another local demographic analysis shop, which was much more aggressive. As we have noted, in the one data point from those two studies we were able to check for Fairfax County—data from the US Census Bureau in 2010—the 2005 WSA forecast over-stated county employment by 25% and the 2009 study overstated it by 52%. In both cases, all the population forecasts we examined were within a reasonable five percentage points of the US Census 2010 count."
Detroit
In Detroit Michigan Maynard writes that an independent study by Halcrow found that WSA had used population and employment projections that were "far too high" and traffic was likely to be "about half" of WSA forecasts. He has an appendix commenting on the Detroit-Windsor DRIC/NITC bridge project.
Maynard says some of WSA's numbers are wrong, and that Halcrow's modeling is more convincing because it performs well in backward testing - not attempted by WSA.
NOTE: we're fully open to any response from WSA or any other forecasters. So far no response from WSA to the invitation to defend their work.