« Coin flips and super bowls | Main | Predicting elections »
February 14, 2007
Here's a paragraph from a recent referee report that I could really attach to just about every review I ever do
Finally, I'd like to see some graphs of the raw data, along with replicated datasets from the model. The paper admirably connects the underlying problem to the statistical model; however, the Bayesian approach requires a lot of modeling assumptions, and I'd be a lot more convinced if I could (a) see some of the data and (b) see that the fitted model would produce simulations that look somewhat like the actual data. Otherwise we're taking it all on faith.
Posted by Andrew at February 14, 2007 12:53 PM
Trackback Pings
TrackBack URL for this entry:
http://www.stat.columbia.edu/~cook/movabletype/mt-tb.cgi/812
Comments
I believe all reviewers would prefer to have access to well documented data and programs. Some are working on technology to make this less onerous on both authors and reviewers. In the R group it get referred to as reproducible research, compendiums and or vignettes.
Keith
Posted by: Keith O'Rourke at February 19, 2007 9:08 AM.
Keith,
Being able to access the data would be fine, too, but usually I don't want to replicate the research myself. What I want is for the researchers to put some fraction of the effort they've put in fitting the model, into displaying the data and exploring the aspects in which the model fits (and doesn't).
Posted by: Andrew ![[TypeKey Profile Page]](http://www.stat.columbia.edu/~cook/movabletype/mlm/nav-commenters.gif)
at February 20, 2007 7:39 AM.