Bill Jefferys pointed me to this note by Bob O’Hara on difficulties with DIC (the deviance information criterion for evaluating predictive model fit). I’d also point out that DIC can be numerically unstable. But I think it’s basically a good idea.

Also here’s some discussion of DIC from Brad Carlin, Nicky Best, and Angelika van der Linde.