After five pages of debate, I think it's appropriate to revisit the start of it all. Here's the original post in full with comments added.
richlyon wrote:
In
Paul Smith and Safe Speed - the Self-Exposure of a Crank (22/12/2005), George Monbiot wonders about Paul Smith's reluctance to comply with the request by the field's leading journal
("Accident Analysis & Prevention") and submit his analyis to independent academic review.
Let's get that part exactly in perspective. On 17th January 2005 I sent this email:
-------- Original Message --------
Subject: Accident Analysis and Prevention
Date: Mon, 17 Jan 2005 07:43:54 +0000
From: Paul Smith <psmith@safespeed.org.uk>
Organization: Safe Speed
To:
re@toi.noDear Rune,
I understand you are editor of Accident Analysis and Prevention. I'm a UK road
safety campaigner with an engineering background. I have carried out thousands
of hours of work on road safety science, originally investigating the UK
government's case for the widespread introduction of speed cameras. You may
have come across my work via contact with Professor Mervyn Stone.
I have identified dozens of serious inadequacies in the current state of road
safety science. Much of my work is already published on the Safe Speed web
site, but I believe that the time has come to bring it directly to the
attention of the scientific community.
Can you provide any guidance or assistance for articles to be submitted for
publication in AA&P? Would you accept articles from me?
I have had no previous involvement in academic publication.
--
Best Regards,
Paul Smith
Safe Speed
web:
http://www.safespeed.org.uk---------------------------------
promoting intelligent road safety
And I got this reply:
-------- Original Message --------
Subject: SV: Accident Analysis and Prevention
Date: Wed, 19 Jan 2005 06:31:31 +0100
From: "Rune Elvik" <re@toi.no>
To: "Paul Smith" <psmith@safespeed.org.uk>
Dear Paul Smith,
Accident Analysis and Prevention welcomes any paper that takes a critical look
at road safety research. I believe myself that much of it is inadequate and in
need of improvement.
I attach some guidelines for authors that I hope may be of interest.
If you wish to submit a paper, please go to the following website, register as
a user, and then, following the assigment of a password, login as author and
follow the instructions given:
http://ees.elsevier.com/aap/Kind regards
Rune Elvik
I examined the requirements for publication and recognised that the expected format was significantly demanding in terms of hours. Since then I have cast about for assistance and agreed on 8th December 2005 to work with two other people to create papers for scientific publication based on Safe Speed work.
richlyon wrote:
As Monbiot points out, independent review is carried out by experts which are chosen, not by the researcher whose work is in question, but by the editors of a journal whose reputation depends on the scientific accuracy of its contents. As such, it is the only recognised method available to us for deciding whether claims - such as those advanced by 'safespeed' - can be taken seriously.
No, Richard, it is not. Neither acceptance not rejection for publication would prove anything at all. Being 'taken seriously' arises when information proves robust to wide ranging challenges. And I am being taken seriously.
richlyon wrote:
In his radio interview of 20th December, Mr Smith attributed his refusal to submit his data for peer review to lack of time. The front page of SafeSpeed is currently asserting an 'open review' policy as being 'far superior' to conventional scientific publication 'peer review' - such as that proposed by Monbiot. It also advises it is working with experts chosen by SafeSpeed to prepare scientific publications.
'Lack of time' is a somewhat light statement of the true position. In truth, I suppose, like any activity, it's a question of balancing opportunities against benefits, and urgency against importance. It's been my judgement that I should not abandon day to day work to prepare papers for publication because other things have been more urgent and important to the campaign objectives. And so it remains.
richlyon wrote:
Clearly, whether or not we believe the case set out by Mr Smith, his actions leave him open to the charge that he fears exposure and - unneccessarily, if his arguments have merit - strengthen the case against him.
I give you my word - here and now - that I'm not in the least little bit 'fearful of exposure'. If I was I wouldn't be throwing out 'debate challenges' to all and sundry. If I was I wouldn't have given up well paid work to do this thing. And I wouldn't have emailed AA&P asking about publication. The 'fearful of exposure' claim is libel because it is false.
richlyon wrote:
Question for general debate: even if 'open review' is superior to scientific peer review, why not do both? If safespeed is under threat of closure, as its appeals page asserts, wouldn't an excellent course of action it could take right now be to secure independent endorsement by the leading journal in this field, irrespective of whether it meets what SafeSpeed believes to be more rigorous tests? Even if such a review were to be critical, isn't SafeSpeed's 'open review' process capable of falsifying those criticisms and further strengthen SafeSpeed's case?
The threat of closure passed when some amount of money - £10k? - was raised.
The point about scientific publication has been answered above.
richlyon wrote:
Conversely, if it continues to refuse, how can it best defend the assertion that it has simply started with with the conclusion it wants to reach, and devised statistical methods to support it that it knows won't survive independent scrutiny?
I have never 'refused'. The methods are entirely open to independent scrutiny.
And the general point is that scientific publication is still far from the top position in the list of daily priorities - and rightly so. The whole argument surrounding peer review is both a dead duck and a red herring.