Friday, November 1, 2013

Citation Counts and Influence and Tenure


Citation counts are quite unreliable, since they can be jiggered (you get credit for papers with your famous professor, having worked in his lab or project, but you really don't want to count those citations unless you did most of the work). But at the extremes, they may well be useful.  As for influence in the field, for assistant professors, letters are likely to be more informative. You’d need to award tenure at 9 years, rather than 6, to have good data for citations that would be worth attending to. Many fields have long gestation times.

But letters have their own problems, and only 1/3 at best really tell you what you would want to know about quality and influence, and again letters too may not be reliable even from strong scholars. But if you have several, they are likely to reveal the problems among them and so as a whole they are quite informative.

For Assoc to Full, the citation data is likely to be helpful. Again, it can be jiggered. Letters are still the best information, with the proviso that very high or low citation counts are flags.  h-indexes are popular with scientists, and they check them weekly in some cases. Warshel of recent Nobel Prize in Chemistry is one who said he did so.

As for whether papers are influential in policy, wow! It helps to have a stream of papers by many authors. Single papers, like "broken windows," may appeal to prejudices and so be influential, but even there others took up the challenge. In general single papers are quite unreliable unless explored by many folks in follow-up studies. And there is a lag between paper and influence, many years often, in part because interests that do not want the paper's ideas to dominate will work against that, and may well generate counter evidence. Think of tobacco use and decades between good evidence and changes in policy.
It also helps to do lecturing, testifying, and lots of people-work.

Real Options and Finance Ideas in our Teaching (not only in Business School).


I know that we teach decision analysis in some of our courses in our policy school at USC, and perhaps ideas like Black-Scholes. But in thinking about a lecture in my defense policy course, where uncertainty and consequences are high and costs are constrained, I realized that the general idea of finance and more concretely, real options, would be useful to convey to our students, undergrads and masters, more generally. In an econ course, two weeks could be devoted to finance ideas (namely, volatility and random walks, options, no-arbitrage). And in public policy courses or real estate development, the notions of an option must already be conveyed, at least implicitly.  I see that Richard deNeufville and David Geltner of MIT and Yongheng Deng of Singapore recently gave a paper at a real options conference on real estate design and development planning

 I have noticed that my colleagues in law may well be economics literate and law-and-econ practitioners, but finance and options are not part of their everyday discourse. When someone gave a paper on options, the finance notion was in the author's  mind but not much in the paper or in the audience’s minds.  And option for them was some sort of future choice, but not what finance calls options.

I may well be years behind in what we teach. So please excuse this back-seat-driving.

-------People have written me that the math and formulas may be too difficult for many students. I am not concerned about that. The basic ideas are straightforward, and you could always make a decision tree with a few branchings. The difference from most decision analysis is that you pay now for the chance to make a choice later, and you don't have to know which choice you will make until then.