Nice provocative title, eh? I'm still thinking about Chris Anderson's discussion of free (see previous post). As he remarks there, when the cost of memory, bandwidth, and processing speed drops so low as to be essentially free then there is no reason to worry about scarcity or waste. He notes that when things that are so fundamental to how we communicate become free, we are bound to see some significant changes.
Take our own disciplines for example. Peer review in humanities scholarship is kind of a curious thing. First of all it's about reputation: a journal can't have a good reputation unless submissions are peer-reviewed. Second, it's about scarcity, and in some senses an enforced scarcity. That is, paper journals and book publishers have material limits to what can be published. This is both in terms of each issue of a journal and what kinds of journals or books make sense in the marketplace. There is also an enforced scarcity in that peer-reviewed publications only have academic value if some people have them and others don't. If everyone can publish easily then the value of the publication as a unit of currency goes down. Third, it's a mechanism for controlling disciplinary discourses. I don't mean this in a conspiratorial way. It's just simply the case that if you limit the places where scholars can publish articles that "count" then you automatically create a mechanism for controlling the discourse.
Of course the primary argument for peer-review and limiting scholarship is quality. Enforced scarcity and peer review result in better, or at least more disciplinary, scholarship. Without it, it become increasingly difficult to find quality work awash in a sea of "lower quality" publications. There's no doubt though that quality is a loaded term. This may be different in other fields, but in the humanities, a lot of scholarship really just amounts to an interpretation or argument or point of view. It's not so much that you'd get rejected for making an argument reviewers disagree with as you would for making the wrong kind of argument. Or for citing a, b, and c when you ought to have cited x, y, and z. Different reviews at a different journal might have the opposite opinion. And all that's fine, but it just indicates that "quality" is quite relative when it comes to humanities scholarship.
Like everyone else I've read articles that I thought were dull or unimaginative or obvious or even "deeply problematic" (to summon my inner grad student) in the top journals in rhet/comp, and I've read really interesting and thoughtful pieces in backwater online journals--to say nothing of what I've read on people's blogs. And obviously the opposite is also true. I imagine that my evaluation of pieces is different from many others in rhet/comp, but I'm sure we've all experienced this.
The point is that there's no reason not to "waste" memory and bandwidth by publishing every scholarly article, essay, monograph, and multimedia production. Of course we would have to develop new practices for developing our scholarship as there are certainly aspects to the reviewing and editing process that are very valuable. I wouldn't want to do away with those! In a way we have those with listservs and conferences, as well as in the blogosphere. We would have to intensify those. Over time, it would become clear which scholarship has lasting value, and that would happen in the same way it has in the past: people will make references to it; there will be links to the pieces; there will be discussions here and there. We've always had these post-filters, and they've always ultimately been more important than the pre-filters anyway.
this is fantastic. I spend most of my time teaching new students to navigate through information -- and it seems to me that so man y of these technology changes push us to do what we should have been doing already anyway. Peer review has never been a guarantee of quality, and to tell students that the equation is that simple has always been a disservice. I know this is obvious - but I help so many students who are looking for a "peer reviewed" article to fulfill an assignment's requirements - who have no idea why or even what they're looking for. I love the idea of pushing beyond that to more complex analyses of quality and utility.
Posted by: Anne-Marie | February 27, 2008 at 07:51 PM
What's interesting is that the Internets have already figured out ways to assure quality: reviews, ratings, rankings, Diggs, all that. Comments, even. And I'm still struck by the genius of the extra layer of review on sites like Amazon and IMDB where you can RATE THE RATING. Genius. I'm past understanding why we don't, as you say, just put all the scholarship out there and let people rank it. And rank the rankings.
I especially think that every university should take responsibility for publishing all its own faculty's content. An institutional repository, if you will, but with the explicit purpose of distribution. Harvard made an important first step the other day.
Posted by: Amanda French | February 27, 2008 at 08:12 PM
These are good points. I do think there are some models for reputation systems, like that at slashdot, that might be customized for use in evaluating scholarly work. I think the most interesting thing and the most challenging thing is that we will have to change the way that we work somewhat, especially in the humanities.
We are so accustomed to doing solo research, and this approach will ask us to work more socially. I think we will still write individual articles but we might be called upon more to respond to one another and evaluate one another. We do these things in one way or another, even if we do them just in our heads as we read articles, but here you would have to evaluate in a more active way.
Posted by: Alex Reid | February 28, 2008 at 08:35 PM