Financial Model Mistakes Can Cost Millions of Dollars

 

It's been awhile since I've blogged. Work has been busy and then I took off ten days to visit Paris. The City of Lights is amazing indeed. Now that I'm back, I will try to blog more frequently. There is certainly no shortage of topics about risk, governance, litigation, valuation and so on.

For those who don't know, I created a sister blog a few months ago. See GoodRiskGovernancePays.com. Nearly all of the time, the posts on each blog are different. However, I decided to reprint a post from GoodRiskGovernancePays.com here since the topic is hugely important. After all, for those defined benefit and defined contribution plans that are exposed to "hard-to-value" investments, leverage and perhaps higher than expected volatility, model risk could be the hidden alligator that bites if left unchecked. As always, I welcome your comments at contact@fiduciaryleadership.com.

Here is the post that was originally posted on June 2, 2011 by Dr. Susan Mangiero.

In a recently published article about financial models entitled "Financial Model Mistakes Can Cost Millions of Dollars" (American Bar Association, Section of Litigation, Expert Witnesses, May 31, 2011), Dr. Susan Mangiero defines model risk and explains why it is so important. Referencing the recent $242 million enforcement action by the U.S. Securities and Exchange Commission as a result of model mistakes made by a well-known asset management firm, this financial expert cites the heightened regulatory and litigation imperatives with respect to risk and valuation models. She concludes the article by listing some of the ways to mitigate risk. These include, but are not limited to the following:

  • Hire knowledgeable programmers with capital market experience;
  • Create and follow a set of policies and procedures that govern how and who will validate financial models over time and what will trigger revisions in a model(s);
  • Avoid conflicts of interest that would reward managers for ignoring problems and would potentially preclude an independent and objective assessment of problems and related corrective action(s);
  • Test assumptions for validity in stable markets as well as extreme circumstances;
  • Stress a model using a sufficient number of economic scenarios to gauge its predictive power and whether results can be relied upon in both good or bad times;
  • Educate personnel about how a particular model is supposed to work;
  • Establish a response strategy should a problem occur and investors need to be informed before things get out hand;
  • Scrap models that are overly complex and expensive to replicate;
  • Don't be afraid to ask questions about inputs, data quality, results, and concerns; and
  • Invite informed outsiders to offer an independent and regular critique on a confidential basis.

 

Model Risk Costs One Asset Manager $242 Million

According to a February 3, 2011 document released by the U.S. Securities and Exchange Commission ("SEC"), AXA Rosenberg Group ("AXA") and various related entities have settled a matter relating to model risk for $242 million in economic damages and penalties. In a company letter dated April 15, 2010, several AXA executives describe an error with an investment model as having been "discovered in late June 2009" and "corrected between September and mid-November." While there are issues about the disclosure of said problems, the official message to investors at that time was a continued commitment to risk management.

Investor fallout has occurred nevertheless with various press accounts reporting the withdrawal of monies from AXA by pension plans such as the School Employees' Retirement System of Ohio, Los Angeles Fire and Police Pensions, the City of Fresno Retirement System, Florida State Board of Administration, the Marin County Employees' Retirement Association and the Montana Board of Investments. 

As I've written before, valuation (and by extension, model risk assessment) is a key element of the due diligence of asset managers. For a list of some of the "must ask" questions about model reviews, click to read "Asset Valuation: Not a Trivial Pursuit" by Susan Mangiero, PhD, CFA, FRM (FSA Times, The Institute of Internal Auditors, Q1-2004).

Email contact@fiduciaryleadership.com if you want to further discuss model review best practices.