Dear Professor van Dijck,

In November 2017, Professor Jeffrey Harvey of the Netherlands Institute of Ecology, a KNAW institute, was the lead author on a paper published in the journal BioScience.

I requested the data behind the paper, and was pointed to the data archive. Unfortunately, the data released was incomplete.

The paper classifies blogs as “yellow” or “blue”. This classification is hardwired into the R code used to analyse the data. The paper only vaguely describes the procedure for classification: The content of the blogs is compared to the reports of the Intergovernmental Panel on Climate Change (IPCC). Unfortunately, the data released only contain the home page of the blogs investigated, rather than the specific blog posts examined. Some of these blogs consists of hundreds if not thousands of posts. Similarly, the IPCC has published many reports running to thousands of pages, with positions that change over time and chapters that contradict one another. Agreement or disagreement with the IPCC is therefore a meaningless concept, unless chapter and verse are specified.

I have repeatedly asked Professor Harvey and his co-authors to be more explicit, but to no avail. Specifically, I have asked, in vain, for the list of blogposts examined, for the IPCC statements assessed, and for the score per post and statement.

This may appear to be a detail, but it is a key contribution of the paper. Professor Harvey argues that a blog’s position on the IPCC predicts its position on polar bears. However, not knowing how the IPCC position is derived, it cannot be excluded that Harvey fitted the data to match the conclusion.

In the same paper, Professor Harvey and colleagues analyse the contents of a list of published papers. The released data specify the list of papers, but replicating their query to the Web of Science obtains a different list of papers. I have asked Professor Harvey, in vain, to specify the criteria by which certain papers were excluded; and to specify the query through which papers were added.

This point may seem mundane, but it is the other main conclusion of the paper. Professor Harvey claims that blue blogs agree with “the literature”, and yellow blogs do not. Unfortunately, as Professor Harvey will not explain how “the literature” was delineated, the validity of this conclusion is unknown.

As indicated above, I have repeatedly asked Professor Harvey and his co-authors to release the full dataset. They have refused to do, suggesting that they have something to hide.

I have contacted Mr Melle de Vries, the head of information policy at the KNAW. KNAW data policy is clear: All data should be released, and exceptions specified. My experience with Mr de Vries was frustrating. He kept blandly repeating that all data had been released, which is not true as described above and repeatedly explained to Mr de Vries.

I apologize to have to bring this to your attention. KNAW data policy sets a good example: Scientific data should be open to outside scrutiny. Unfortunately, KNAW researchers do not follow this policy, and KNAW officers do not enforce it.

I would be grateful for your intervention in this specific case, and for your efforts to make sure that KNAW data policy is maintained.

I look forward to your reply.


Yours sincerely,



Richard Tol


A detailed commentary on the paper is available here.
Peer review in scientific authority and media visibility
Peer review in scientific authority and media visibility
2
NRC checkt
NRC checkt
Open Access does not remove the market power of academic publishers
Open Access does not remove the market power of academic publishers
2
KNAW data policy
KNAW data policy
1
Lipstick on a bear
3
The Ladybird Book on Climate Change
The Ladybird Book on Climate Change
Task Force on Climate-Related Financial Disclosures
Task Force on Climate-Related Financial Disclosures
An odd exchange on Brexit
An odd exchange on Brexit
1
A modest proposal for Brexit
A modest proposal for Brexit
1
Erratum, IPCC WG2 AR5 Ch10
Erratum, IPCC WG2 AR5 Ch10
Another ill-conceived Stern Review
Another ill-conceived Stern Review
2
Consensus on consensus?
Nonsensus on nonsensus
1
Misrepresentation and the consensus
Misrepresentation and the consensus
1
Ackerman and Munitz revisited
Ackerman and Munitz revisited
1
Cook replies
Cook replies
That other consensus study in ERL
That other consensus study in ERL
1
The Climate Spectator is no more
The Climate Spectator is no more
Nonsensus is endless
Nonsensus is endless
2
Mr Ward's misplaced critique on Fankhauser and Stern
Mr Ward's misplaced critique on Fankhauser and Stern
More nonsenus
3
Ten years without Pearce
1
The Pope on Climate
The Pope on Climate
6
Klimaatbubbel is een broodje aap
Klimaatbubbel is een broodje aap
2
Denial101x
Denial101x
PPPS: Cook's missing papers
PPPS: Cook's missing papers
12
Global warming consensus claim does not stand up (author's cut)
Global warming consensus claim does not stand up (author's cut)
25
PPS: Cohen's kappa and Cook's 97%
PPS: Cohen's kappa and Cook's 97%
1
The Guardian rules that the Guardian is almost flawless
The Guardian rules that the Guardian is almost flawless
Postscript: More data quality issues with the 97% nonsensus
97% Nonsensus: An Epilogue
97% Nonsensus: An Epilogue
Bob Ward's smear campaign
8
Radical greens
Radical greens
12
The Guardian
1
ERL does not want you to read this
ERL does not want you to read this
1
Stern on Hardtalk
Stern on Hardtalk
3
Stern2.0 takes climate policy analysis to a new level of exaggeration
Stern2.0 takes climate policy analysis to a new level of exaggeration
Ackerman's latest red herrings
Ackerman's latest red herrings
1
Another chapter on the 97% nonsensus
8
Days of rater bias (ctd)
Days of rater bias
More Cook data released
Open letter to Peter Sutherland
Open letter to Peter Sutherland
24 errors?
24 errors?
4
The Guardian and the right to reply
The Guardian and the right to reply
5
A new contribution to the consensus debate
A new contribution to the consensus debate
9
My First Audioslide
My First Audioslide
IPCC wiki
IPCC wiki
1
The 97% consensus
The 97% consensus
4
John Abraham's Wild Imaginations
John Abraham's Wild Imaginations
1
IPCC again
IPCC again
16
The Lomborg man behind the IPCC mutiny
The Lomborg man behind the IPCC mutiny
Mr Ward's fantastical claims
Mr Ward's fantastical claims
4
The Ward Effect
2
Policy Not Pylons
Policy Not Pylons
1
UK Parliamentary Inquiry into the IPCC
UK Parliamentary Inquiry into the IPCC
Bootstrap results for initial ratings by the Consensus Project
Open letter to the Vice-chancellor of the University of Queensland
Open letter to the Vice-chancellor of the University of Queensland
More irregularities in the consensus data
Biases in consensus data
1
The Consensus Project: An update
9
Tol Poll (ctd)
The Tol Poll
The Tol Poll
Draft comment on 97% consensus paper
Draft comment on 97% consensus paper
18
Blowing carbon bubbles
Blowing carbon bubbles
6
A crisis wasted
A crisis wasted
Een ezel stoot zich geen 18 keer
Een ezel stoot zich geen 18 keer
Ackerman-Munitz petition
Ackerman-Munitz petition
Pay peanuts and you get monkeys
Pay peanuts and you get monkeys
Revised letter for PNAS
Revised letter for PNAS
Irish universities need reform, not money
Irish universities need reform, not money
2
PNAS response
PNAS response
Interdisciplinary research should meet disciplinary standards
Interdisciplinary research should meet disciplinary standards
Windenergie brengt zijn geld nooit op
Windenergie brengt zijn geld nooit op
4
Hoe groen zijn de verkiezingen?
Hoe groen zijn de verkiezingen?
1
The economics of nuclear power and climate change mitigation policies: A comment
The economics of nuclear power and climate change mitigation policies: A comment
1
Groene groei is een loze belofte
Groene groei is een loze belofte
The cost of working in Ireland
The cost of working in Ireland
1
Climate damages in the FUND model: Comment as accepted
Climate damages in the FUND model: Comment as accepted
1
Climate damages in the FUND model: A comment
Climate damages in the FUND model: A comment
Vliegtaks helpt klimaat voor geen meter
Vliegtaks helpt klimaat voor geen meter
Het klimaatcircus moet nu maar eens ophouden
Het klimaatcircus moet nu maar eens ophouden
The Geek Manifesto
Blog roll
Blog roll
Translate
Translate
Blog Archive
About Me
About Me
Subscribe
Subscribe
Loading
Dynamic Views theme. Powered by Blogger. Report Abuse.