tag:blogger.com,1999:blog-17232051.post7048112430696931785..comments2024-03-18T22:32:52.802-04:00Comments on Noahpinion: Why doesn't the finance industry use DSGE models? (cont.)Noah Smithhttp://www.blogger.com/profile/09093917601641588575noreply@blogger.comBlogger32125tag:blogger.com,1999:blog-17232051.post-36996194397127034962014-08-17T01:40:55.394-04:002014-08-17T01:40:55.394-04:00Noah, maybe this will help you answer your questio...Noah, maybe this will help you answer your question:<br /><br />Read: MACROECONOMICS AFTER THE CRISIS:<br />TIME TO DEAL WITH THE PRETENSE-OF-KNOWLEDGE SYNDROME<br />by MIT Prof. Ricardo J. Caballero<br /><br />Here's the abstract:<br /><br />In this paper I argue that the current core of macroeconomics—by which I mainly mean the so-called dynamic stochastic general equilibrium approach—has become so mesmerized with its own internal logic that it has begun to confuse the precision it has achieved about its own world with the precision that it has about the real one. This is dangerous for both methodological and policy reasons. On the methodology front, macroeconomic research has been in “fine-tuning” mode within the local-maximum of the dynamic stochastic general equilibrium world, when we should be in “broad-exploration” mode. We are too far from absolute truth to be so specialized and to make the kind of confident quantitative claims that often emerge from the core. On the policy front, this confused precision creates the illusion that a minor adjustment in the standard policy framework will prevent future crises, and by doing so it leaves us overly exposed to the new and unexpected.Charles Martineauhttps://www.blogger.com/profile/16534621855465862079noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-27708172894686395872014-08-04T11:28:27.137-04:002014-08-04T11:28:27.137-04:00"Everyone, and I mean everyone in academia, a..."Everyone, and I mean everyone in academia, abandoned SEMs in a very short period of time, and many switched over to DSGEs." Noah Smith, 25 July 2014<br /><br />This comment is not historically correct, as evidenced by the extensive body of work referenced and abstracted at the following site:<br /><br />Agent-Based Macroeconomics<br />http://www.econ.iastate.edu/tesfatsi/amulmark.htm<br /><br />The above website starts by setting out the following five "Basic Issues," which it would be wonderful to see considered and addressed in a serious thoughtful manner by macroeconomists in general and by the macroeconomic bloggers at Noah's blogsite in particular:<br /><br /> (1) "Is it too much to ask of anyone building a model with `microfoundations' that the microfoundations be `true'? I mean, climatologists have models with microfoundations, but their assumptions about heat transfer actually work…" (Chris Dillow)<br /><br />(2) Should macroeconomists adhere a priori to the "discipline of equilibrium," regardless of empirical reality? Or should the existence of equilibria be treated as a testable hypothesis, considered in conjunction with basins of attraction?<br /><br />(3) If you had to specify goals and decision rules for economic agents trying to survive and prosper in a macroeconomy, where these goals and rules can only depend on information and computational capabilities that the agents could reasonably be assumed to possess, and you are not permitted to impose coordination on the agents' activities a priori, e.g., through global market clearing or rational expectations restrictions, how would you go about it?<br /><br />(4) If the above exercise stumps someone, to what extent can that person be said to possess a scientific understanding of real-world macroeconomic systems?<br /><br />(5) To gain a constructive understanding of real-world economic processes (e.g., expectation formation, intertemporal planning, production, price discovery, buyer-seller matching, payment settlements, firm entry/exit, longer-term contractual relationships), should not macroeconomists engage more fully with the real-world entities who carry out these processes? <br /><br />LTLeigh Tesfatsionhttp://www.econ.iastate.edu/tesfatsi/noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-65306620736568730452014-07-29T12:07:36.999-04:002014-07-29T12:07:36.999-04:00It's not very complicated. DSGE models are not...It's not very complicated. DSGE models are nothing more than models of the pace of reversion to an (unexplained) trend. And they're not very good at predicting that. So people don't use them.JBhttps://www.blogger.com/profile/02900465024382591965noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-49270487035468940652014-07-29T11:53:44.090-04:002014-07-29T11:53:44.090-04:00Yup, Anon - every time we repeat a failed experime...Yup, Anon - every time we repeat a failed experiment over and over, I find myself exclaiming "This is f'in' nuts!". Of course, usually we figure out why it didn't work all those times and then we get the different result we expected.JohnRnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-72010081784418320312014-07-28T14:33:39.543-04:002014-07-28T14:33:39.543-04:00Insanity: doing the same thing over and over again...Insanity: doing the same thing over and over again and expecting different results.<br /> Albert Einstein<br /><br /><br />Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-854747263346270732014-07-28T13:23:34.235-04:002014-07-28T13:23:34.235-04:00Robert's comment is silly. He is saying that w...Robert's comment is silly. He is saying that we could have saved the SEMs by abandoning them in favor of new SEMs (notice the contradiction) that instead of a trade-off between inflation and unemployment would favor a trade-off between the change in inflation and unemployment. Well, sure, we can keep doing this every time there is a structural change but, especially if this structural change is the result of a change in the policy regime, it is a self-defeating exercise. This was the whole point of the Lucas critique!<br /><br />By the way, Robert conveniently forgets that in the 1970s self-proclaimed Keynesian economists like Tobin were arguing that inflation was a cost-push phenomenon while Friedman and the monetarists were arguing that it was demand-pull and driven by monetary policy. We all know who won that one!CAnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-45460934296358298552014-07-28T13:05:45.456-04:002014-07-28T13:05:45.456-04:00This doesn't really resolve Noah's "w...This doesn't really resolve Noah's "why SEM not DSGE" question, but:<br /><br />After ~20 years on the buy-side, I have to echo Tom. Macro forecasting on the Street is (in my experience) viewed mostly as entertainment (gives us something to write about each Q), not as a useful input. Most forecasts seem to be t+1 = t + small random, with some sort of hand-waved story tacked on. My impression (again, echoing Tom) is that forecast accuracy is a coin toss. <br /><br />Personally, the only macro issues I spend any time thinking about are tail events. That seems to be where you can materially lose/win.<br /><br />Also, to the "debate" on inflation prediction post 09 above, there's a claim that the "top macro analysts" were not prediction inflation. That feels circular to me. The "top analysts" looking back from 2014 are inevitably those that were right in retrospect. Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-9549942645844211492014-07-27T22:28:27.932-04:002014-07-27T22:28:27.932-04:00I don't know who is more right about the histo...I don't know who is more right about the history (I strongly suspect Dr. Waldman is) so I would very much like to see a reply from Dr. Smith. It seems to me the history should be available to be cited, pro or con.JimVhttps://www.blogger.com/profile/10198704789965278981noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-89542848431050815362014-07-26T23:14:44.938-04:002014-07-26T23:14:44.938-04:00It is my understanding that the majority of people...It is my understanding that the majority of people on Fed (and other major central bank) research staffs are fans of DSGE. However, at least the Fed, and probably most other central banks, keep Keynesian-style structural models and also VAR-type models around for actual forecasting, keeping a few people around to tend to those. What has not picked up much, except in a few places, is any sort of serious agent-based modeling.rosserjb@jmu.eduhttps://www.blogger.com/profile/09300046915843554101noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-79716030111195481592014-07-26T21:20:31.491-04:002014-07-26T21:20:31.491-04:00What I find remarkable about that Lucas quote, BTW...What I find remarkable about that Lucas quote, BTW, is that there's no sense of changing circumstance there. I wonder if he were standing on the moon and somebody suggested the measure the acceleration of gravity there, if he would respond: "Dang it to heck, we already measured (dog gone) gravity back on Earth! Why should we friggin' do it again!"Tom Brownhttp://www.google.comnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-67471026274832495192014-07-26T21:10:03.609-04:002014-07-26T21:10:03.609-04:00Noah writes, (quoting?) Lucas: “We tried (stupid)...Noah writes, (quoting?) Lucas: “We tried (stupid) inflation! It didn’t (dang) work!”<br /><br />Nick Rowe points out that the lower the inflation target, the closer you get to communism:<br /><br /><a href="http://worthwhile.typepad.com/worthwhile_canadian_initi/2014/07/the-soft-fade-from-monetary-to-fiscal.html" rel="nofollow">Too dedicated a pursuit of low inflation and the optimum quantity of money leads to communism, with government ownership of everything.</a><br /><br />Scott Sumner agrees:<br /><br /><a href="http://worthwhile.typepad.com/worthwhile_canadian_initi/2014/01/monetary-policy-fiscal-policy-the-target-and-the-size-of-the-central-bank.html?cid=6a00d83451688169e201a3fc03a88a970b#comment-6a00d83451688169e201a3fc03a88a970b" rel="nofollow">"I like to sometimes tease conservatives who want really low inflation by pointing out that that they are advocating socialism."</a><br /><br />Tom Brownhttp://www.google.comnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-75271218258858735112014-07-26T21:07:43.924-04:002014-07-26T21:07:43.924-04:00PS You (Peter) seem to have a strange notion that ...PS You (Peter) seem to have a strange notion that using models somehow protects from errant ideology. Any ideology, including the simplistic monetarism that says any base money expansion will cause a proportional amount of inflation, can and probably has been incorporated into a model. Actually expectations of a moderate pick-up in inflation were widespread in 2009-2011 and indeed CPI did go over 3 for a spell in what proved to be a China-driven headfake. I think those in finance who correctly predicted low inflation were looking at the low to negative private net credit issuance, not DSGE or any other kind of models.Tomnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-44591888202673741842014-07-26T20:48:33.285-04:002014-07-26T20:48:33.285-04:00Bloomberg doesn't appear to have any such prev...Bloomberg doesn't appear to have any such preview story ahead of the April 30 GDP release on its web archive. I'm afraid if you demand proof you'll need a friend with a Bloomberg terminal. I'll bet you anything the success record of the consensus of Bloomberg-surveyed top analysts in predicting the direction of GDP growth relative to previous quarter since the survey was started till now is no higher than 52%.Tomnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-1784544860901385512014-07-26T17:35:58.078-04:002014-07-26T17:35:58.078-04:00Oh heck I garbled that post. Those three middle gr...Oh heck I garbled that post. Those three middle graphs were meant to be deleted.Tomnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-38513906767581471362014-07-26T17:34:30.818-04:002014-07-26T17:34:30.818-04:00Peter, what exactly is your complaint about my his...Peter, what exactly is your complaint about my history? It sounds like you misread me. Maybe I was unclear and should reiterate my points as simply as possible.<br /><br />- The top macro analysts in finance are not basing their forecasts mainly on models. The bigger the institution, the more likely it is that somebody, usually a junior analyst, is doing some formal modeling. But mainly analysts guesstimate based on recent performance and their assessments of the impacts of important trends and events. <br /><br />- My personal opinion is that an experienced macro analyst is better than any model. But objectively, top macro analysts as a group are no better than a coin toss. If you don't believe my claim, look it up. Bloomberg at least used to publish the success record of their survey group every quarter, in their article reporting the consensus GDP forecast, published just ahead of the first print. It was always 50 or 51. I remember well because it always gave me a chuckle the way they reported it, absolutely deadpan in the last graph.<br /><br />As for maverick predictions of accelerating inflation, that is not what I mean by trusting your gut. That's ideology, and I think you'll find that even the funds that sell with that line don't much follow it in their investment strategy.<br /><br />Likewise, the Fed governors in 2007-2008 were believing in their hopes, not trusting their gut. Finance professionals also are gullible to their own hopes, but being so is more likely to end their careers. Indeed that's what killed the small hedge fund I worked for.<br /><br /><br /><br /> I'm telling you to go look up how often the "consensus" GDP prediction, as calculated by Bloomberg or Reuters in their regular surveys of top analysts, has been correct about the direction of quarterly GDP versus previous quarter. Bloomberg at least used to regularly publish the figure, and as far as I recall it was always 50% or 51%.<br /><br />Some particular analysts I'm sure had better performance, but in general, the top financial industry macro analysts as a group are no more likely to correctly predict an acceleration or deceleration of GDP growth than a coin toss.<br /><br />Your characterization of FOMC '07 seems about right, except, the Fed probably had multiple models taking different sides, and the Fed weren't so much trusting their gut as believing in what they wished to be true. That kind of thing also happens a lot in finance and indeed was the death of the small hedge fund I worked for. That might seem like I'm a distinction where no objective distinction exists, but in my mind there's a big difference between trusting your gut and betting on your hopes.<br /><br /><br /> <br />I don't know how JP Morgan modeled the housing market, but modeling a specific situation like that does not fall under what most people mean when they say macro modeling. <br />Tomnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-37789627645422437762014-07-26T13:29:50.239-04:002014-07-26T13:29:50.239-04:00Also, I think "policy-conditional forecasting...Also, I think "policy-conditional forecasting" is different, as well. As a commenter alludes to above, a well-identified qualitative impact (i.e., getting the sign right) of policy on macro variables is probably more valuable/relevant to macroeconomists.ZCnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-23646644931385681922014-07-26T13:25:12.467-04:002014-07-26T13:25:12.467-04:00>The standard answer to this is that the "...>The standard answer to this is that the "Keynesian" models are OK at unconditional forecasting, but not at policy-conditional forecasting. But since DSGE models should, in theory, be the best models for policy-conditional forecasting, Heckman's question leads naturally to mine...<br /><br />I'm not sure this is quite right. I can build a really detailed model that perfectly predicts a person's income from details of their lives, but that doesn't matter if all I care about is the causal impact of an extra year of education. Models that fit/predict well aren't necessarily identified, and a lot of models that are well identified still have very low R-squared. Once you scale this problem up to DSGE I'd imagine the identification issues are even stronger.ZCnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-24845374194319392282014-07-26T10:55:52.394-04:002014-07-26T10:55:52.394-04:00What would finance people use DSGE models for, giv...What would finance people use DSGE models for, given that practitioners do not vouch for their predictive accuracy?Anonymoushttps://www.blogger.com/profile/02977684524676621423noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-55827180340780185802014-07-26T10:28:18.266-04:002014-07-26T10:28:18.266-04:00You'd be more convincing if you gave specific ...You'd be more convincing if you gave specific examples, like say how JP Morgan modeled that the housing market was turning. Some banks did better than others in their macro predictions and I doubt they were using academic DSGE models.<br /><br />The Fed's models did alright in predicting growth was slowing in 2007, but the FOMC ignored their staff probably going off "gut feelings." They were worried that inflation wouldn't moderate when in fact growth fell off a cliff. Even private markets were pricing in slower growth but the FOMC ignored them too since they had a gut feeling inflation wouldn't moderate. Plus there was anecdotal evidence that inflation wasn't moderating. Just read the FOMC minutes.<br /><br />Basically I think's Tom's history is BS. "All that said, look up Bloomberg's or Reuters' history of surveys of top macro analysts and how often they've predicted correctly the direction of GDP growth. You'd do just as well consulting a coin toss."<br /><br />Just look at all the stopped-clock predictions of imminent accelerating inflation these past 6 years. The top macro analysts weren't predicting that.<br />So their models served them well in that instance.<br /><br />"I've been on the buy and sell side.." He drank the Kool Aid too.<br />Peterhttps://www.blogger.com/profile/08272747870634233567noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-445446878945294292014-07-26T10:18:15.958-04:002014-07-26T10:18:15.958-04:00I agree with Robert's blog post. I'd softe...I agree with Robert's blog post. I'd soften the tone by pointing out that the Fed staffers and business sector forecasters who don't use DSGE and who are rejecting academia's ivory tower economics don't really defend themselves or engage with the false history. They leave it to bloggers like Robert. <br /><br />Again it's an instance where ideas are warped by money and ideology. Private business forecasters have better things to do than take on academia and correct the historical record. The Fed doesn't want to provoke half of Congress, the institution it reports to on a regular basis.<br /><br />Peterhttps://www.blogger.com/profile/08272747870634233567noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-56561624782243866992014-07-26T09:59:15.230-04:002014-07-26T09:59:15.230-04:00It may not be that analysts care less than the Fed...It may not be that analysts care less than the Fed about the consequences of policy, inasmuch as policy decisions have implications for the forecast, but that they don't care about whether those consequences are good or not. In which case when macroeconomists defend DSGE by saying, "we're not in the business of weather forecasting, we're interested in the consequences of policy" what they're really saying is whether the consequences are good or not. Since financial analysts don't have to worry about that, they don't have to waste time with microfoundations, and have a much more flexible class of models to choose from.Ramnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-23433360480174184662014-07-26T05:14:52.072-04:002014-07-26T05:14:52.072-04:00I doubt that I am surprised that I object to your ...I doubt that I am surprised that I object to your intellectual history.<br /><br />I moved my comment over to my personal blog where no one will read it, because the tone is rude.<br /><br /><br />Roberthttps://www.blogger.com/profile/14455788499385673507noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-5218142634399744522014-07-26T03:45:17.318-04:002014-07-26T03:45:17.318-04:00I think there's a good reason that finance onl...I think there's a good reason that finance only cares about unconditional forecasts:<br />When we make investment decisions, all we care about is what the state of the world will be tomorrow, NOT the optimal state. In academia/central banks we evaluate what would make for a good policy. What does an investment banker care whether there's a wealth effect in people's investment decisions or what the deep parameters of a DSGE look like? All she cares about is GDP up, GDP down, stock prices up, stock prices down.<br /><br />- LukasAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-17232051.post-11293165683426709142014-07-26T02:45:54.469-04:002014-07-26T02:45:54.469-04:00This is consistent with everything I've seen a...This is consistent with everything I've seen and heard!Noah Smithhttps://www.blogger.com/profile/09093917601641588575noreply@blogger.comtag:blogger.com,1999:blog-17232051.post-12345986575560249842014-07-26T02:44:25.800-04:002014-07-26T02:44:25.800-04:00...But why does the finance industry care less abo......But why does the finance industry care less about forecasting the effects of a policy change than the Fed does? It just doesn't make sense.<br /><br />...Not that the Fed relies exclusively or even primarily on DSGE models, either.Noah Smithhttps://www.blogger.com/profile/09093917601641588575noreply@blogger.com