That the results of research papers can be easily replicated is commonly regarded as being of central importance and as an integral and essential part of any and all scientific investigation. In 2018, both of the Society''s journals – The Economic Journal (EJ) and The Econometrics Journal (EctJ) – will be implementing a new replication check for empirical and experimental papers. This follows a successful pilot that EctJ has been running since August 2017.
The new policy introduces rigorous checks of the replication packages for accepted papers before publication. These checks focus on verifying that the packages are well documented, can be run with some reasonable effort on typical academic computing platforms and replicate the reported results.
The checks limit the publication of glaring mistakes by forcing authors to double check their data, code and results before publication. They also ensure that empirical and computational results are replicable and that proposed methods can easily be used, thus increasing the credibility and usefulness of the journals.
Note that the journals'' editors do not intend to check for robustness, whether methods are appropriate, etc. Rather, they will simply check whether the submitted software and data are consistent with the results reported in the papers.
Details on the journals'' replication policies can be found here:
Current debates on the replicability of scientific research suggest that many replication packages do not deliver and that the ''market'' is unlikely to sort this out by dutifully replicating published papers. The Society believes that the EJ and EctJ should become leaders in assuring replicability of scientific research in economics.
