Claims Vs. Performance
While investment consultants tout their ability to identify future outperformers, the evidence clearly suggests otherwise. This raises such important questions as:
- On what basis are the claims made?
- Why do pension plans hire consultants?
Gordon Cookson, Tim Jenkinson, Howard Jones and Jose Vicente Martinez contribute to the literature on the performance of investment consultants with their July 2018 study “Investment Consultants’ Claims About Their Own Performance: What Lies Beneath?”
Their analysis is based on a unique data set sourced by the U.K. regulator Financial Conduct Authority, which provides detailed records of the institutional asset managers recommended by three leading investment consultants between 2006 and 2015. Each of these consultants, which together have a worldwide market share of around 45%, also produces an analysis of its own recommending performance, to which they had access. The following is a summary of their findings.
First, they found that all three consultants claim that the products they recommend produce significant excess returns, ranging between 1.6% and 2.5%. Each uses a different methodology and does not make the underlying data available to the public. Thus, institutional investors must take on trust the basis for these claims as well as their comparability.
Second, despite the claims, Cookson, Jenkinson, Jones and Martinez found that, on average, consultant-recommended investment products perform no better than other products available to institutional investors.
In fact, they found that over their 10-year sample period, the portfolio of all products recommended by investment consultants delivered average returns gross of management fees that are 0.2% per annum lower than the average returns obtained by a matched sample of available products classified in the same investment category (such as U.S. large cap value). They found no evidence of outperformance in any of the three categories of equity, fixed income and other (balanced/multi-asset, alternatives/hedge funds, real estate). They also found “no consistent differences between recommended and non-recommended products in terms of return volatility or betas with respect to manager-chosen benchmarks.”
Among the causes of the gap between claims and results, the authors found, were “comparisons to benchmarks [which can be inappropriate] rather than to peers, inclusion of simulated and backfilled returns [which create well known biases], use of investment horizons that allow losers to be forgotten [survivorship bias], and unexplained exclusions of products from the analysis.”
The authors concluded: “Institutional investors cannot verify investment consultants’ claims, and may therefore be following consultants’ manager recommendations, and allocating assets, on false pretenses.”
Cookson, Jenkinson, Jones and Martinez also concluded: “We find significant differences between consultants’ claimed performance and our own calculations. Most, but not all, of those differences can be attributed to practices by consultants in their self-assessment which we have identified. A comparison between consultants based on their own claimed performance shows that there is no monotonicity between consultants’ claims and their actual performance, suggesting that consultants’ disclosures may not be good guides to their relative performance either.”
The bottom line is that, while consultants may add value in other ways, there is no evidence to suggest they add value in the selection of actively managed funds, which begs the question: Why do pension plans continue to use them for that purpose?
One explanation is they are shielding themselves from blame in case their chosen managers perform badly. Another, suggested by Cookson, Jenkinson, Jones and Martinez, is that, “The way in which consultants present their own ability to pick fund managers is so favorable that it becomes difficult for plan sponsors to ignore their recommendations.”
Larry Swedroe is the director of research for The BAM Alliance, a community of more than 130 independent registered investment advisors throughout the country.