Recent Readers
view all
  • john-logan
1 year ago
A Random Walk, A Sequential Game, Part 3
A Random Walk, A Sequential Game, Part 3

A Random Walk, A Sequential Game, Part 3

In A Model of Retirement Planning, Part 1, I wrote that the challenge of retirement income planning is to best position ourselves to maintain our desired standard of living throughout an unpredictable length of retirement with somewhat-predictable future income but largely unpredictable future expenses. A mighty challenge.

By Dirk Cotton

In Adding Risk to the Model, Part 2, I added to the model tolerance toward the risk of losing standard of living, because within a fairly small range of expected income and expenses, some households will choose to spend more early in retirement at the risk of having less to spend late in retirement, and some households will choose the opposite. Some can live with more risk than others.

We need to add one last important characteristic to the top-level model of retirement finance, its “chained state” nature. Retirement finance is not a “set-and-forget” decision that we implement and never revisit. It's a series of moves in a sequential game.

Retirement finance is not a “set-and-forget” decision that we implement and never revisit. It's a series of moves in a sequential game.

[Tweet this]
I often use the sailing metaphor. At the end of a day of sailing – or a year of retirement – we will find that we have drifted off course and we need to correct our heading. We can't just continue using the heading we set at the start.

Game theorists refer to this as a sequential game against nature, meaning that the game is a series of alternating moves in which Player 1 (your household) makes a move and nature (defined in game theory as "a fictitious player having no known objective and no known strategy") responds. 

Although personal finances are practically time-continuous, it is easier to think of them as a series of years, or “discrete-time states”, so that’s how we plan. The age of death for a healthy person is unpredictable, but we often think of people retiring around age 65 and living until age 100, or so. In that case, retirement would consist of one to 36 discrete time states representing ages 65 through 100. 

 Following is a simple state diagram for a retiree who retires at age 65 and turns out to live to age 76. Of course, life span is unpredictable for a healthy retiree, so we don’t know beforehand if our own chain will contain one state or dozens.

An individual state can be identified by the age of the retiree, so we can use the terms “state” and “age” synonymously in this example. Each state has associated with it information about income, expenses, net worth, remaining lifetime, portfolio balance, desired standard of living, risk tolerance and other critical financial information.

This information is known with the most certainty in the state that is current, in other words, at our present age. For example, we can know our current portfolio balance, interest rates, current desired standard of living, and current risk tolerance fairly well. We can't know with as much confidence what these values will be for next year, and the uncertainty increases every future year.

For example, if state zero represented 2007, the market crash in October of that year might significantly change all future expectations for portfolio balance, portfolio spending, and net worth and it might even affect our decision to delay Social Security benefits. For some households, it postponed the planned retirement date. 

The following table illustrates some of the plan's forecasted financial data for each year in the diagram above as of the starting state (age 65). Age 66 data is less certain when predicted at age 65, age 67 data predicted at age 65 is even less certain, etc. (Click to enlarge.)

Large changes in expectations might also result from out-sized market gains, unexpected medical expenses or the loss of a spouse. Our view of the future can change significantly in a short time. In 2006, our forecast for 2008 would not have included a 55% market crash and a housing crash.

Also, note that the state data we are forecasting are moving targets. Income changes when we claim Social Security benefits. Life expectancy decreases at each new state. Spending, our desired standard of living, tends to decline with age. The sustainable withdrawal percentage from our savings portfolio increases with age. The purchasing power of a dollar changes. Our forecasts constantly change, but so do our targets. We can't simply say we're going to spend $50,000 a year in retirement or receive $50,000 of income annually in retirement because those numbers change over time.

What about the past?

This series or “chain” of discrete states (ages) has the characteristic that the values of next year's state are dependent only upon the information provided in the current state and what happens this year. Anything that happened before reaching the current state is no longer relevant. (Mathematicians refer to this as a discrete-time Markov chain.)

A Monopoly board provides a simpler example of a Markov chain. If your race car or thimble is currently parked on Illinois Avenue, where you will end up next depends solely on where your thimble or race car currently sits and the next roll of the dice. It doesn't matter if you got to Illinois Avenue by sitting on New York Avenue and rolling a five or States Avenue and rolling eleven. That won't affect where you will move next.

This is an important concept that points out, for example, the absurdity of a fixed sustainable withdrawal strategy basing how much you can spend in year 12 of retirement on how much savings you had at the beginning of retirement. If you reach year 12 of retirement with a half million dollars in your savings portfolio, it doesn't matter if you got there by starting retirement with $1M and depleting half of it, or by starting retirement with $250,000 and doubling it. All that matters is where you are now and what happens next.

This is also an important concept in retirement planning because the states you “land on” will be a random walk through retirement-wealth “state space” resulting from those unpredictable incomes, expenses, market returns, and lifetimes, etc.

(State-space is simply the set of all possible future states of a dynamic system – or all possible states of retiree wealth in this explanation. In the simple game of tic-tac-toe, for instance, there are 765 essentially different states that can be reached. The state space for a coin-toss consists of only a head and a tail. There are only two possible future states. In reality, there are an infinite number of possible wealth states for a retiree and time is continuous. It simplifies the explanation, however, if we imagine time in discrete years (snapshots) and a finite number of essentially-different wealth states.) 

The state diagram above shows the path moving forward in a straight line, but your path will actually wander through wealth “state space” depending on the draws from those random variables, incomes, expenses, market returns, etc., as illustrated in the following diagram.

When you reach the darker-blue state at age 67 in the above diagram, for example, it won't matter how much or how little wealth you had at ages 65 or 66. Those gray states and the information they contained will no longer be relevant. At age 67, we can only guess the future positions of the light blue states and when we reach age 68 and gray-out age 67, our predictions of the position of future light blue states may change then, perhaps dramatically.

This Markov-chain, or "Markovian", nature of retirement finance has a number of implications for the retirement model. First, since year three's finances depend solely on year two's financial state plus some unpredictable events, and year two's finances are also unpredictable, predicting our future finances with any accuracy quickly becomes untenable. We are trying to predict where we will be in the future by moving an unpredictable distance and direction from an unknown starting point.

Our ability to predict future states decays quickly. We can perhaps predict a year in advance with a little accuracy, but this foresight decreases with each year beyond that and quickly becomes unpredictable. No one predicted the 2008 financial disaster in 2006.

Our ability to predict our financial future decays quickly. No one predicted the 2008 financial disaster in 2006.

[Tweet this]
Second, thinking of retirement as a Markov chain that renders past information irrelevant means each new year of retirement becomes a new puzzle to solve, possibly quite different than the one we faced the previous year, so dynamically updating our plans becomes an obvious necessity. It also rids us of the notion that our financial situation years ago remains relevant.

The top-level model for retirement finance, then, should look something like this.

"Retirement finance is a random walk of unpredictable length ranging from one year to several decades. At a given age, only the present financial data are known with any certainty. Data from previous years can be known but are irrelevant. The reliability of forecasts of data for future states decays rapidly with time and forecasts beyond five years are probably sheer conjecture. The key determinants of retirement wealth are random variables: income, expenses, life span, and risk tolerance. Retirees can choose to spend more or less, within a reasonable range, depending on their risk tolerance. Retirees with high risk tolerance can increase spending early in retirement and consequently increase the risk of a lower standard of living in late retirement while more risk-averse retirees can decrease spending early in retirement and consequently decrease the risk of a lower standard of living in late retirement.”

Retirement finance is a random walk along a Markov chain, or to a game theorist, a sequential game against nature. Each year we make forecasts based on what we know (our current financial status and the financial environment), what we expect to happen in the future, and what unexpected outcomes we believe we might experience in the future (risks). We make our move based on this analysis and our risk tolerance. Then nature takes its turn and we repeat.

Once we have a high-level model of retirement finance, we can start to think about how to plan for it. Surprisingly, I have been able to find very little literature that addresses the best way to develop a plan. A good place to start, I think, would be to answer this question: How can you know a good plan when you see one?

About the Author:

Dirk Cotton

Dirk Cotton is a retired executive of a Fortune 500 technology company. Since retiring in 2005, he has researched and published papers on retirement finance, spoken at retirement industry conferences and events, and regularly posted on retirement finance issues at his blog, The Retirement Cafe. He is currently a Thought Leader at APViewpoint, Advisor Perspectives' online community of investment advisors and financial planners. He provides retirement planning advice as a fee-only financial planner. Click "Full Bio" for more. . .

This article first appeared on The Retirement Cafe´ (James Dirk Cotton) / CC BY-NC-SA 4.0 on April 29, 2016

Please sign in to comment