What Are the Benefits of Publishing in a Peer-reviewed Journal?
EJIFCC. 2014 October; 25(3): 227–243.
Published online 2014 Oct 24.
Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide
Jacalyn Kelly
oneClinical Biochemistry, Department of Pediatric Laboratory Medicine, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
Tara Sadeghieh
1Clinical Biochemistry, Department of Pediatric Laboratory Medicine, The Hospital for Ill Children, University of Toronto, Toronto, Ontario, Canada
Khosrow Adeli
1Clinical Biochemistry, Department of Pediatric Laboratory Medicine, The Infirmary for Ill Children, University of Toronto, Toronto, Ontario, Canada
2Department of Laboratory Medicine and Pathobiology, Academy of Toronto, Toronto, Canada
threeChair, Communications and Publications Division (CPD), International Federation for Sick Clinical Chemistry (IFCC), Milan, Italy
Abstract
Peer review has been defined as a process of subjecting an author's scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to see the accepted high standards of their subject and to command the broadcasting of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are non published without prior skilful review. Despite its wide-spread use by virtually journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Inside the scientific customs, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful inquiry questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific noesis is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts equally a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the identify of peer review, however, researchers have been looking into electronic means of improving the peer review procedure. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a big number of scientific manufactures with footling or no peer review. This poses significant risk to advances in scientific noesis and its future potential. The current article summarizes the peer review procedure, highlights the pros and cons associated with unlike types of peer review, and describes new methods for improving peer review.
Key words: peer review, manuscript, publication, journal, open access
WHAT IS PEER REVIEW AND WHAT IS ITS PURPOSE?
Peer Review is defined as "a procedure of subjecting an author's scholarly work, research or ideas to the scrutiny of others who are experts in the same field" (1). Peer review is intended to serve ii primary purposes. Firstly, it acts as a filter to ensure that only high quality research is published, especially in reputable journals, past determining the validity, significance and originality of the study. Secondly, peer review is intended to meliorate the quality of manuscripts that are deemed suitable for publication. Peer reviewers provide suggestions to authors on how to improve the quality of their manuscripts, and besides identify any errors that need correcting before publication.
HISTORY OF PEER REVIEW
The concept of peer review was developed long earlier the scholarly periodical. In fact, the peer review process is thought to take been used as a method of evaluating written work since ancient Greece (2). The peer review process was first described by a md named Ishaq bin Ali al-Rahwi of Syrian arab republic, who lived from 854-931 CE, in his volume Ethics of the Md (two). At that place, he stated that physicians must take notes describing the state of their patients' medical conditions upon each visit. Post-obit treatment, the notes were scrutinized by a local medical council to decide whether the physician had met the required standards of medical intendance. If the medical council deemed that the appropriate standards were non met, the physician in question could receive a lawsuit from the maltreated patient (2).
The invention of the printing press in 1453 allowed written documents to be distributed to the full general public (3). At this time, it became more important to regulate the quality of the written material that became publicly bachelor, and editing by peers increased in prevalence. In 1620, Francis Bacon wrote the piece of work Novum Organum, where he described what eventually became known every bit the first universal method for generating and assessing new science (3). His work was instrumental in shaping the Scientific Method (3). In 1665, the French Journal des sçavans and the English Philosophical Transactions of the Regal Society were the outset scientific journals to systematically publish enquiry results (iv). Philosophical Transactions of the Regal Society is thought to be the first journal to formalize the peer review process in 1665 (v), however, it is important to annotation that peer review was initially introduced to assistance editors decide which manuscripts to publish in their journals, and at that time information technology did non serve to ensure the validity of the inquiry (vi). It did not take long for the peer review procedure to evolve, and shortly thereafter papers were distributed to reviewers with the intent of authenticating the integrity of the inquiry written report before publication. The Regal Society of Edinburgh adhered to the post-obit peer review process, published in their Medical Essays and Observations in 1731: "Memoirs sent past correspondence are distributed according to the subject matter to those members who are near versed in these matters. The report of their identity is non known to the author." (7). The Royal Club of London adopted this review process in 1752 and adult the "Commission on Papers" to review manuscripts before they were published in Philosophical Transactions (6).
Peer review in the systematized and institutionalized class has adult immensely since the Second World State of war, at least partly due to the large increase in scientific research during this period (7). Information technology is now used not only to ensure that a scientific manuscript is experimentally and ethically audio, only also to determine which papers sufficiently see the periodical'south standards of quality and originality earlier publication. Peer review is now standard practice by nearly credible scientific journals, and is an essential part of determining the credibility and quality of work submitted.
IMPACT OF THE PEER REVIEW Procedure
Peer review has become the foundation of the scholarly publication organisation because it effectively subjects an author's work to the scrutiny of other experts in the field. Thus, it encourages authors to strive to produce high quality inquiry that will advance the field. Peer review also supports and maintains integrity and authenticity in the advancement of science. A scientific hypothesis or statement is generally not accepted by the bookish community unless it has been published in a peer-reviewed journal (8). The Institute for Scientific Information (ISI) but considers journals that are peer-reviewed equally candidates to receive Bear on Factors. Peer review is a well-established process which has been a formal office of scientific communication for over 300 years.
OVERVIEW OF THE PEER REVIEW Procedure
The peer review process begins when a scientist completes a research report and writes a manuscript that describes the purpose, experimental design, results, and conclusions of the study. The scientist then submits this paper to a suitable journal that specializes in a relevant research field, a step referred to equally pre-submission. The editors of the periodical volition review the paper to ensure that the subject matter is in line with that of the journal, and that it fits with the editorial platform. Very few papers laissez passer this initial evaluation. If the journal editors feel the newspaper sufficiently meets these requirements and is written past a credible source, they will send the paper to accomplished researchers in the field for a formal peer review. Peer reviewers are also known as referees (this process is summarized in Figure 1). The role of the editor is to select the most advisable manuscripts for the journal, and to implement and monitor the peer review procedure. Editors must ensure that peer reviews are conducted fairly, and in an effective and timely style. They must also ensure that at that place are no conflicts of involvement involved in the peer review process.
Overview of the review process
When a reviewer is provided with a paper, he or she reads information technology carefully and scrutinizes information technology to evaluate the validity of the science, the quality of the experimental pattern, and the appropriateness of the methods used. The reviewer likewise assesses the significance of the research, and judges whether the work will contribute to advancement in the field by evaluating the importance of the findings, and determining the originality of the research. Additionally, reviewers place any scientific errors and references that are missing or incorrect. Peer reviewers requite recommendations to the editor regarding whether the newspaper should be accepted, rejected, or improved before publication in the journal. The editor volition mediate author-referee discussion in social club to clarify the priority of certain referee requests, suggest areas that can be strengthened, and overrule reviewer recommendations that are across the study's scope (9). If the paper is accepted, equally per suggestion by the peer reviewer, the paper goes into the production stage, where it is tweaked and formatted by the editors, and finally published in the scientific journal. An overview of the review process is presented in Figure 1.
WHO CONDUCTS REVIEWS?
Peer reviews are conducted past scientific experts with specialized cognition on the content of the manuscript, too as past scientists with a more than general cognition base. Peer reviewers tin can be anyone who has competence and expertise in the subject areas that the journal covers. Reviewers can range from young and upwards-and-coming researchers to erstwhile masters in the field. Often, the young reviewers are the most responsive and deliver the best quality reviews, though this is non always the example. On average, a reviewer will conduct approximately eight reviews per year, according to a report on peer review by the Publishing Research Consortium (PRC) (7). Journals will oft have a puddle of reviewers with various backgrounds to let for many unlike perspectives. They will too keep a rather large reviewer bank, then that reviewers do not get burnt out, overwhelmed or time constrained from reviewing multiple manufactures simultaneously.
WHY Practise REVIEWERS REVIEW?
Referees are typically not paid to conduct peer reviews and the process takes considerable attempt, then the question is raised as to what incentive referees have to review at all. Some feel an bookish duty to perform reviews, and are of the mentality that if their peers are expected to review their papers, then they should review the work of their peers as well. Reviewers may also have personal contacts with editors, and may want to assist as much as possible. Others review to keep upwards-to-date with the latest developments in their field, and reading new scientific papers is an constructive way to do so. Some scientists use peer review as an opportunity to advance their own research as it stimulates new ideas and allows them to read about new experimental techniques. Other reviewers are neat on building associations with prestigious journals and editors and becoming office of their community, equally sometimes reviewers who show dedication to the periodical are later hired as editors. Some scientists see peer review equally a chance to get aware of the latest research before their peers, and thus exist first to develop new insights from the material. Finally, in terms of career evolution, peer reviewing can be desirable as information technology is often noted on one's resume or CV. Many institutions consider a researcher'south involvement in peer review when assessing their performance for promotions (11). Peer reviewing can likewise exist an effective manner for a scientist to show their superiors that they are committed to their scientific field (5).
ARE REVIEWERS Great TO REVIEW?
A 2009 international survey of 4000 peer reviewers conducted past the charity Sense About Science at the British Science Festival at the University of Surrey, plant that xc% of reviewers were keen to peer review (12). Ane third of respondents to the survey said they were happy to review up to five papers per year, and an additional one third of respondents were happy to review up to 10.
HOW LONG DOES IT Take TO REVIEW ONE Paper?
On average, it takes approximately six hours to review 1 paper (12), however, this number may vary greatly depending on the content of the newspaper and the nature of the peer reviewer. One in every 100 participants in the "Sense Nearly Science" survey claims to have taken more than 100 hours to review their last paper (12).
HOW TO DETERMINE IF A JOURNAL IS PEER REVIEWED
Ulrichsweb is a directory that provides information on over 300,000 periodicals, including information regarding which journals are peer reviewed (13). Later on logging into the organisation using an institutional login (eg. from the University of Toronto), search terms, journal titles or ISSN numbers tin be entered into the search bar. The database provides the title, publisher, and state of origin of the journal, and indicates whether the journal is still actively publishing. The black book symbol (labelled 'refereed') reveals that the journal is peer reviewed.
THE EVALUATION CRITERIA FOR PEER REVIEW OF SCIENTIFIC PAPERS
As previously mentioned, when a reviewer receives a scientific manuscript, he/she will first make up one's mind if the subject field matter is well suited for the content of the periodical. The reviewer will then consider whether the research question is of import and original, a process which may be aided past a literature browse of review articles.
Scientific papers submitted for peer review normally follow a specific structure that begins with the title, followed by the abstract, introduction, methodology, results, discussion, conclusions, and references. The title must be descriptive and include the concept and organism investigated, and potentially the variable manipulated and the systems used in the study. The peer reviewer evaluates if the title is descriptive enough, and ensures that it is articulate and concise. A study past the National Clan of Realtors (NAR) published by the Oxford Academy Press in 2006 indicated that the championship of a manuscript plays a significant role in determining reader interest, as 72% of respondents said they could usually judge whether an article will be of interest to them based on the championship and the author, while 13% of respondents claimed to always be able to do so (14).
The abstruse is a summary of the paper, which briefly mentions the groundwork or purpose, methods, key results, and major conclusions of the study. The peer reviewer assesses whether the abstract is sufficiently informative and if the content of the abstract is consistent with the rest of the paper. The NAR study indicated that 40% of respondents could determine whether an article would be of interest to them based on the abstract solitary 60-80% of the time, while 32% could judge an article based on the abstract 80-100% of the fourth dimension (xiv). This demonstrates that the abstract alone is often used to assess the value of an commodity.
The introduction of a scientific paper presents the inquiry question in the context of what is already known about the topic, in lodge to identify why the question being studied is of interest to the scientific community, and what gap in cognition the written report aims to fill (fifteen). The introduction identifies the written report's purpose and scope, briefly describes the general methods of investigation, and outlines the hypothesis and predictions (15). The peer reviewer determines whether the introduction provides sufficient background data on the inquiry topic, and ensures that the research question and hypothesis are conspicuously identifiable.
The methods section describes the experimental procedures, and explains why each experiment was conducted. The methods department also includes the equipment and reagents used in the investigation. The methods department should be detailed enough that it can be used it to repeat the experiment (fifteen). Methods are written in the by tense and in the active voice. The peer reviewer assesses whether the appropriate methods were used to answer the research question, and if they were written with sufficient detail. If information is missing from the methods section, it is the peer reviewer'south job to place what details need to be added.
The results section is where the outcomes of the experiment and trends in the data are explained without judgement, bias or interpretation (xv). This section tin can include statistical tests performed on the data, equally well as figures and tables in addition to the text. The peer reviewer ensures that the results are described with sufficient detail, and determines their brownie. Reviewers also confirm that the text is consistent with the information presented in tables and figures, and that all figures and tables included are important and relevant (15). The peer reviewer will also make certain that tabular array and figure captions are appropriate both contextually and in length, and that tables and figures nowadays the data accurately.
The discussion section is where the data is analyzed. Here, the results are interpreted and related to past studies (15). The discussion describes the meaning and significance of the results in terms of the research question and hypothesis, and states whether the hypothesis was supported or rejected. This section may also provide possible explanations for unusual results and suggestions for future research (fifteen). The word should end with a conclusions department that summarizes the major findings of the investigation. The peer reviewer determines whether the discussion is clear and focused, and whether the conclusions are an appropriate estimation of the results. Reviewers also ensure that the give-and-take addresses the limitations of the written report, any anomalies in the results, the relationship of the written report to previous research, and the theoretical implications and practical applications of the study.
The references are found at the stop of the paper, and list all of the data sources cited in the text to describe the background, methods, and/or translate results. Depending on the commendation method used, the references are listed in alphabetical lodge according to author last proper name, or numbered co-ordinate to the gild in which they appear in the newspaper. The peer reviewer ensures that references are used appropriately, cited accurately, formatted correctly, and that none are missing.
Finally, the peer reviewer determines whether the paper is conspicuously written and if the content seems logical. Later on thoroughly reading through the entire manuscript, they decide whether information technology meets the periodical's standards for publication,
and whether it falls within the top 25% of papers in its field (xvi) to determine priority for publication. An overview of what a peer reviewer looks for when evaluating a manuscript, in order of importance, is presented in Figure two.
How a peer review evaluates a manuscript
To increase the chance of success in the peer review process, the writer must ensure that the paper fully complies with the journal guidelines before submission. The author must as well exist open to criticism and suggested revisions, and learn from mistakes made in previous submissions.
ADVANTAGES AND DISADVANTAGES OF THE Unlike TYPES OF PEER REVIEW
The peer review procedure is generally conducted in one of iii means: open up review, single-blind review, or double-blind review. In an open review, both the author of the newspaper and the peer reviewer know i another's identity. Alternatively, in single-bullheaded review, the reviewer'south identity is kept private, but the author'south identity is revealed to the reviewer. In double-blind review, the identities of both the reviewer and author are kept bearding. Open up peer review is advantageous in that information technology prevents the reviewer from leaving malicious comments, existence devil-may-care, or procrastinating completion of the review (two). It encourages reviewers to be open up and honest without being disrespectful. Open reviewing also discourages plagiarism amid authors (two). On the other hand, open peer review tin can also prevent reviewers from being honest for fear of developing bad rapport with the author. The reviewer may withhold or tone downwards their criticisms in order to be polite (2). This is especially true when younger reviewers are given a more esteemed author'due south work, in which case the reviewer may be hesitant to provide criticism for fear that it will damper their human relationship with a superior (2). According to the Sense Nearly Science survey, editors discover that completely open reviewing decreases the number of people willing to participate, and leads to reviews of little value (12). In the same study by the China, only 23% of authors surveyed had experience with open peer review (vii).
Single-blind peer review is past far the most common. In the Red china study, 85% of authors surveyed had experience with single-blind peer review (7). This method is advantageous as the reviewer is more than likely to provide honest feedback when their identity is curtained (two). This allows the reviewer to make independent decisions without the influence of the writer (2). The main disadvantage of reviewer anonymity, however, is that reviewers who receive manuscripts on subjects similar to their ain research may be tempted to delay completing the review in lodge to publish their own data first (2).
Double-bullheaded peer review is advantageous equally information technology prevents the reviewer from being biased against the writer based on their country of origin or previous work (ii). This allows the paper to be judged based on the quality of the content, rather than the reputation of the writer. The Sense Nigh Science survey indicates that 76% of researchers think double-blind peer review is a good thought (12), and the Prc survey indicates that 45% of authors have had experience with double-bullheaded peer review (7). The disadvantage of double-blind peer review is that, especially in niche areas of research, it can sometimes be easy for the reviewer to decide the identity of the author based on writing style, subject matter or self-citation, and thus, impart bias (2).
Masking the writer's identity from peer reviewers, as is the instance in double-blind review, is by and large thought to minimize bias and maintain review quality. A written report by Justice et al. in 1998 investigated whether masking author identity affected the quality of the review (17). One hundred and eighteen manuscripts were randomized; 26 were peer reviewed as normal, and 92 were moved into the 'intervention' arm, where editor quality assessments were completed for 77 manuscripts and writer quality assessments were completed for forty manuscripts (17). There was no perceived difference in quality between the masked and unmasked reviews. Additionally, the masking itself was often unsuccessful, especially with well-known authors (17). However, a previous report conducted by McNutt et al. had different results (xviii). In this example, blinding was successful 73% of the time, and they found that when author identity was masked, the quality of review was slightly higher (18). Although Justice et al. argued that this difference was too small-scale to be consequential, their study targeted only biomedical journals, and the results cannot exist generalized to journals of a dissimilar subject field matter (17). Additionally, there were issues masking the identities of well-known authors, introducing a flaw in the methods. Regardless, Justice et al. concluded that masking author identity from reviewers may not meliorate review quality (17).
In addition to open up, single-blind and double-bullheaded peer review, there are two experimental forms of peer review. In some cases, following publication, papers may be subjected to post-publication peer review. Equally many papers are now published online, the scientific community has the opportunity to comment on these papers, engage in online discussions and post a formal review. For case, online publishers PLOS and BioMed Central have enabled scientists to postal service comments on published papers if they are registered users of the site (ten). Philica is another journal launched with this experimental form of peer review. Simply 8% of authors surveyed in the China written report had feel with post-publication review (7). Another experimental grade of peer review called Dynamic Peer Review has also emerged. Dynamic peer review is conducted on websites such as Naboj, which permit scientists to bear peer reviews on articles in the preprint media (19). The peer review is conducted on repositories and is a continuous process, which allows the public to see both the commodity and the reviews as the article is being developed (nineteen). Dynamic peer review helps forbid plagiarism as the scientific community will already be familiar with the work before the peer reviewed version appears in print (19). Dynamic review also reduces the time lag between manuscript submission and publishing. An example of a preprint server is the 'arXiv' adult by Paul Ginsparg in 1991, which is used primarily past physicists (xix). These alternative forms of peer review are still un-established and experimental. Traditional peer review is time-tested and however highly utilized. All methods of peer review take their advantages and deficiencies, and all are prone to error.
PEER REVIEW OF Open up ACCESS JOURNALS
Open access (OA) journals are becoming increasingly popular as they allow the potential for widespread distribution of publications in a timely manner (20). Still, there can be problems regarding the peer review process of open admission journals. In a study published in Scientific discipline in 2013, John Bohannon submitted 304 slightly different versions of a fictional scientific paper (written by a false author, working out of a non-real institution) to a selected group of OA journals. This study was performed in lodge to make up one's mind whether papers submitted to OA journals are properly reviewed earlier publication in comparison to subscription-based journals. The journals in this study were selected from the Directory of Open Access Journals (DOAJ) and Biall's List, a listing of journals which are potentially predatory, and all required a fee for publishing (21). Of the 304 journals, 157 accepted a fake paper, suggesting that acceptance was based on financial interest rather than the quality of article itself, while 98 journals promptly rejected the fakes (21). Although this study highlights useful data on the problems associated with lower quality publishers that do not have an effective peer review arrangement in place, the commodity also generalizes the study results to all OA journals, which can be detrimental to the general perception of OA journals. There were two limitations of the study that made it impossible to accurately determine the relationship between peer review and OA journals: ane) there was no control group (subscription-based journals), and 2) the fake papers were sent to a non-randomized option of journals, resulting in bias.
Journal Credence RATES
Based on a recent survey, the boilerplate acceptance rate for papers submitted to scientific journals is about 50% (7). 20 percent of the submitted manuscripts that are not accepted are rejected prior to review, and 30% are rejected following review (7). Of the 50% accepted, 41% are accepted with the condition of revision, while simply nine% are accepted without the request for revision (seven).
SATISFACTION WITH THE PEER REVIEW SYSTEM
Based on a recent survey past the PRC, 64% of academics are satisfied with the current system of peer review, and only 12% claimed to be 'dissatisfied' (7). The big majority, 85%, agreed with the statement that 'scientific advice is greatly helped by peer review' (seven). In that location was a similarly loftier level of back up (83%) for the idea that peer review 'provides control in scientific advice' (seven).
HOW TO PEER REVIEW EFFECTIVELY
The following are ten tips on how to be an constructive peer reviewer as indicated by Brian Lucey, an expert on the subject (22):
1) Exist professional
Peer review is a mutual responsibility among young man scientists, and scientists are expected, equally part of the academic customs, to take part in peer review. If one is to expect others to review their piece of work, they should commit to reviewing the work of others as well, and put effort into information technology.
2) Be pleasant
If the paper is of low quality, suggest that it be rejected, only do not leave ad hominem comments. There is no benefit to being ruthless.
3) Read the invite
When emailing a scientist to inquire them to conduct a peer review, the majority of journals will provide a link to either accept or reject. Do non reply to the e-mail, respond to the link.
4) Be helpful
Suggest how the authors tin can overcome the shortcomings in their newspaper. A review should guide the author on what is good and what needs work from the reviewer's perspective.
5) Exist scientific
The peer reviewer plays the part of a scientific peer, not an editor for proofreading or controlling. Don't fill a review with comments on editorial and typographic issues. Instead, focus on adding value with scientific knowledge and commenting on the brownie of the research conducted and conclusions drawn. If the paper has a lot of typographical errors, suggest that it be professionally proof edited as part of the review.
vi) Be timely
Stick to the timeline given when conducting a peer review. Editors rails who is reviewing what and when and volition know if someone is late on completing a review. Information technology is important to be timely both out of respect for the periodical and the writer, likewise as to non develop a reputation of being late for review deadlines.
seven) Exist realistic
The peer reviewer must exist realistic almost the work presented, the changes they suggest and their function. Peer reviewers may prepare the bar too loftier for the newspaper they are editing past proposing changes that are likewise aggressive and editors must override them.
8) Be empathetic
Ensure that the review is scientific, helpful and courteous. Exist sensitive and respectful with word selection and tone in a review.
9) Be open
Remember that both specialists and generalists can provide valuable insight when peer reviewing. Editors volition endeavour to go both specialised and general reviewers for any particular paper to allow for different perspectives. If someone is asked to review, the editor has determined they have a valid and useful role to play, even if the newspaper is not in their area of expertise.
ten) Be organised
A review requires structure and logical flow. A reviewer should proofread their review before submitting it for structural, grammatical and spelling errors too as for clarity. Most publishers provide curt guides on structuring a peer review on their website. Begin with an overview of the proposed improvements; then provide feedback on the paper construction, the quality of information sources and methods of investigation used, the logical flow of argument, and the validity of conclusions drawn. Then provide feedback on style, vox and lexical concerns, with suggestions on how to ameliorate.
In addition, the American Physiology Guild (APS) recommends in its Peer Review 101 Handout that peer reviewers should put themselves in both the editor'south and writer'south shoes to ensure that they provide what both the editor and the writer need and expect (xi). To delight the editor, the reviewer should ensure that the peer review is completed on fourth dimension, and that information technology provides articulate explanations to dorsum up recommendations. To exist helpful to the author, the reviewer must ensure that their feedback is constructive. It is suggested that the reviewer have fourth dimension to recollect well-nigh the paper; they should read information technology one time, wait at least a day, and so re-read it before writing the review (11). The APS also suggests that Graduate students and researchers pay attention to how peer reviewers edit their piece of work, besides equally to what edits they notice helpful, in order to learn how to peer review finer (eleven). Additionally, it is suggested that Graduate students practice reviewing by editing their peers' papers and asking a faculty member for feedback on their efforts. It is recommended that young scientists offer to peer review as often every bit possible in social club to become skilled at the process (11). The majority of students, fellows and trainees do non get formal grooming in peer review, simply rather acquire by observing their mentors. According to the APS, ane acquires experience through networking and referrals, and should therefore try to strengthen relationships with journal editors by offering to review manuscripts (11). The APS besides suggests that experienced reviewers provide constructive feedback to students and inferior colleagues on their peer review efforts, and encourages them to peer review to demonstrate the importance of this process in improving science (11).
The peer reviewer should but comment on areas of the manuscript that they are knowledgeable virtually (23). If there is any section of the manuscript they feel they are not qualified to review, they should mention this in their comments and not provide further feedback on that department. The peer reviewer is non permitted to share whatever function of the manuscript with a colleague (fifty-fifty if they may be more knowledgeable in the subject matter) without first obtaining permission from the editor (23). If a peer reviewer comes across something they are unsure of in the paper, they can consult the literature to endeavor and gain insight. Information technology is important for scientists to retrieve that if a newspaper tin can be improved past the expertise of one of their colleagues, the journal must be informed of the colleague'due south help, and approval must exist obtained for their colleague to read the protected certificate. Additionally, the colleague must exist identified in the confidential comments to the editor, in social club to ensure that he/she is appropriately credited for whatsoever contributions (23). It is the job of the reviewer to make sure that the colleague assisting is aware of the confidentiality of the peer review process (23). Once the review is consummate, the manuscript must be destroyed and cannot be saved electronically by the reviewers (23).
Common ERRORS IN SCIENTIFIC PAPERS
When performing a peer review, there are some common scientific errors to wait out for. Most of these errors are violations of logic and common sense: these may include contradicting statements, unwarranted conclusions, suggestion of causation when there is only back up for correlation, inappropriate extrapolation, round reasoning, or pursuit of a trivial question (24). Information technology is likewise common for authors to propose that ii variables are different because the effects of 1 variable are statistically significant while the effects of the other variable are not, rather than directly comparing the two variables (24). Authors sometimes oversee a confounding variable and do not control for information technology, or forget to include important details on how their experiments were controlled or the concrete state of the organisms studied (24). Another common fault is the writer's failure to define terms or use words with precision, as these practices can mislead readers (24). Jargon and/or misused terms can be a serious problem in papers. Inaccurate statements about specific citations are also a common occurrence (24). Additionally, many studies produce noesis that tin be applied to areas of science outside the scope of the original written report, therefore information technology is better for reviewers to await at the novelty of the idea, conclusions, information, and methodology, rather than scrutinize whether or not the paper answered the specific question at hand (24). Although information technology is important to recognize these points, when performing a review information technology is by and large better do for the peer reviewer to not focus on a checklist of things that could be wrong, simply rather carefully place the bug specific to each paper and continuously ask themselves if annihilation is missing (24). An extremely detailed description of how to acquit peer review finer is presented in the newspaper How I Review an Original Scientific Article written by Frederic G. Hoppin, Jr. It tin can be accessed through the American Physiological Society website under the Peer Review Resources department.
CRITICISM OF PEER REVIEW
A major criticism of peer review is that there is piddling evidence that the procedure actually works, that it is really an constructive screen for good quality scientific work, and that information technology really improves the quality of scientific literature. As a 2002 report published in the Periodical of the American Medical Association concluded, 'Editorial peer review, although widely used, is largely untested and its effects are uncertain' (25). Critics likewise argue that peer review is not effective at detecting errors. Highlighting this point, an experiment by Godlee et al. published in the British Medical Periodical (BMJ) inserted viii deliberate errors into a newspaper that was nearly fix for publication, so sent the paper to 420 potential reviewers (vii). Of the 420 reviewers that received the paper, 221 (53%) responded, the average number of errors spotted by reviewers was two, no reviewer spotted more than than five errors, and 35 reviewers (sixteen%) did not spot whatever.
Another criticism of peer review is that the process is non conducted thoroughly by scientific conferences with the goal of obtaining large numbers of submitted papers. Such conferences often accept any paper sent in, regardless of its credibility or the prevalence of errors, because the more papers they accept, the more money they can make from writer registration fees (26). This misconduct was exposed in 2014 past three MIT graduate students by the names of Jeremy Stribling, Dan Aguayo and Maxwell Krohn, who developed a uncomplicated figurer program called SCIgen that generates nonsense papers and presents them as scientific papers (26). Subsequently, a nonsense SCIgen paper submitted to a conference was promptly accustomed. Nature recently reported that French researcher Cyril Labbé discovered that sixteen SCIgen nonsense papers had been used by the German academic publisher Springer (26). Over 100 nonsense papers generated by SCIgen were published past the US Institute of Electrical and Electronic Engineers (IEEE) (26). Both organisations have been working to remove the papers. Labbé developed a program to detect SCIgen papers and has fabricated it freely available to ensure publishers and conference organizers do not accept nonsense work in the future. It is available at this link: http://scigendetect.on.imag.fr/main.php (26).
Additionally, peer review is ofttimes criticized for being unable to accurately detect plagiarism. Withal, many believe that detecting plagiarism cannot practically be included as a component of peer review. As explained past Alice Tuff, evolution manager at Sense About Science, 'The vast bulk of authors and reviewers think peer review should detect plagiarism (81%) but only a minority (38%) think it is capable. The academic fourth dimension involved in detecting plagiarism through peer review would cause the system to grind to a halt' (27). Publishing house Elsevier began developing electronic plagiarism tools with the help of journal editors in 2009 to help improve this event (27).
It has likewise been argued that peer review has lowered inquiry quality by limiting creativity amongst researchers. Proponents of this view claim that peer review has repressed scientists from pursuing innovative research ideas and bold research questions that take the potential to make major advances and paradigm shifts in the field, every bit they believe that this work will likely be rejected by their peers upon review (28). Indeed, in some cases peer review may result in rejection of innovative research, equally some studies may not seem peculiarly strong initially, all the same may be capable of yielding very interesting and useful developments when examined nether different circumstances, or in the light of new information (28). Scientists that exercise non believe in peer review argue that the process stifles the development of ingenious ideas, and thus the release of fresh cognition and new developments into the scientific community.
Another issue that peer review is criticized for, is that at that place are a limited number of people that are competent to bear peer review compared to the vast number of papers that demand reviewing. An enormous number of papers published (1.iii million papers in 23,750 journals in 2006), simply the number of competent peer reviewers available could not have reviewed them all (29). Thus, people who lack the required expertise to analyze the quality of a enquiry paper are conducting reviews, and weak papers are being accepted every bit a result. Information technology is now possible to publish any newspaper in an obscure journal that claims to exist peer-reviewed, though the paper or journal itself could be substandard (29). On a similar note, the Usa National Library of Medicine indexes 39 journals that specialize in alternative medicine, and though they all identify themselves as "peer-reviewed", they rarely publish whatsoever high quality research (29). This highlights the fact that peer review of more controversial or specialized work is typically performed by people who are interested and hold similar views or opinions as the author, which can cause bias in their review. For instance, a paper on homeopathy is likely to exist reviewed by fellow practicing homeopaths, and thus is likely to be accepted as credible, though other scientists may find the newspaper to be nonsense (29). In some cases, papers are initially published, but their credibility is challenged at a after date and they are subsequently retracted. Retraction Watch is a website defended to revealing papers that have been retracted after publishing, potentially due to improper peer review (thirty).
Additionally, despite its many positive outcomes, peer review is besides criticized for being a delay to the dissemination of new knowledge into the scientific community, and as an unpaid-activity that takes scientists' time away from activities that they would otherwise prioritize, such as research and educational activity, for which they are paid (31). As described past Eva Amsen, Outreach Director for F1000Research, peer review was originally developed as a means of helping editors cull which papers to publish when journals had to limit the number of papers they could print in 1 result (32). However, nowadays most journals are bachelor online, either exclusively or in addition to print, and many journals take very limited press runs (32). Since there are no longer folio limits to journals, whatever good work tin and should be published. Consequently, being selective for the purpose of saving space in a journal is no longer a valid alibi that peer reviewers tin employ to pass up a paper (32). However, some reviewers have used this excuse when they have personal ulterior motives, such as getting their own inquiry published first.
Contempo INITIATIVES TOWARDS IMPROVING PEER REVIEW
F1000Research was launched in January 2013 past Faculty of k equally an open access journal that immediately publishes papers (after an initial check to ensure that the newspaper is in fact produced past a scientist and has not been plagiarised), and and so conducts transparent post-publication peer review (32). F1000Research aims to prevent delays in new scientific discipline reaching the academic community that are caused past prolonged publication times (32). It as well aims to make peer reviewing more fair past eliminating any anonymity, which prevents reviewers from delaying the completion of a review so they can publish their own similar piece of work first (32). F1000Research offers completely open peer review, where everything is published, including the proper name of the reviewers, their review reports, and the editorial decision letters (32).
PeerJ was founded past Jason Hoyt and Peter Binfield in June 2012 as an open access, peer reviewed scholarly journal for the Biological and Medical Sciences (33). PeerJ selects articles to publish based only on scientific and methodological soundness, not on subjective determinants of 'impact', 'novelty' or 'involvement' (34). It works on a "lifetime publishing programme" model which charges scientists for publishing plans that requite them lifetime rights to publish with PeerJ, rather than charging them per publication (34). PeerJ also encourages open peer review, and authors are given the option to post the full peer review history of their submission with their published article (34). PeerJ besides offers a pre-print review service called PeerJ Pre-prints, in which paper drafts are reviewed before being sent to PeerJ to publish (34).
Rubriq is an independent peer review service designed by Shashi Mudunuri and Keith Collier to improve the peer review organization (35). Rubriq is intended to decrease back-up in the peer review process and then that the time lost in redundant reviewing can be put back into enquiry (35). According to Keith Collier, over 15 million hours are lost each year to redundant peer review, equally papers become rejected from one periodical and are subsequently submitted to a less prestigious journal where they are reviewed again (35). Authors often have to submit their manuscript to multiple journals, and are ofttimes rejected multiple times before they observe the correct lucifer. This process could take months or even years (35). Rubriq makes peer review portable in society to aid authors choose the journal that is all-time suited for their manuscript from the start, thus reducing the time before their paper is published (35). Rubriq operates under an writer-pay model, in which the author pays a fee and their manuscript undergoes double-bullheaded peer review by 3 good academic reviewers using a standardized scorecard (35). The majority of the author'southward fee goes towards a reviewer honorarium (35). The papers are also screened for plagiarism using iThenticate (35). Once the manuscript has been reviewed by the three experts, the almost appropriate periodical for submission is determined based on the topic and quality of the paper (35). The paper is returned to the author in 1-2 weeks with the Rubriq Report (35). The author tin can then submit their paper to the suggested periodical with the Rubriq Report attached. The Rubriq Study will give the journal editors a much stronger incentive to consider the newspaper as it shows that three experts have recommended the newspaper to them (35). Rubriq also has its benefits for reviewers; the Rubriq scorecard gives structure to the peer review procedure, and thus makes it consequent and efficient, which decreases fourth dimension and stress for the reviewer. Reviewers as well receive feedback on their reviews and virtually significantly, they are compensated for their time (35). Journals also benefit, as they receive pre-screened papers, reducing the number of papers sent to their own reviewers, which oftentimes end up rejected (35). This can reduce reviewer fatigue, and allow just higher-quality articles to exist sent to their peer reviewers (35).
According to Eva Amsen, peer review and scientific publishing are moving in a new direction, in which all papers will be posted online, and a postal service-publication peer review will take place that is independent of specific journal criteria and solely focused on improving newspaper quality (32). Journals will then choose papers that they find relevant based on the peer reviews and publish those papers as a drove (32). In this process, peer review and individual journals are uncoupled (32). In Keith Collier'south opinion, post-publication peer review is likely to get more than prevalent as a complement to pre-publication peer review, but not as a replacement (35). Mail-publication peer review will not serve to place errors and fraud just will provide an additional measurement of impact (35). Collier also believes that as journals and publishers consolidate into larger systems, in that location will be stronger potential for "cascading" and shared peer review (35).
CONCLUDING REMARKS
Peer review has become key in assisting editors in selecting credible, high quality, novel and interesting research papers to publish in scientific journals and to ensure the correction of any errors or issues present in submitted papers. Though the peer review process nonetheless has some flaws and deficiencies, a more than suitable screening method for scientific papers has not yet been proposed or developed. Researchers have begun and must continue to look for means of addressing the current issues with peer review to ensure that information technology is a full-proof organisation that ensures only quality research papers are released into the scientific community.
REFERENCES
three. Spier R. (2002). "The History of the Peer-review Process." Trends Biotechnol, 20(8): 357-358. [PubMed] [Google Scholar]
iv. Liumbruno GM., Velati C., Pasaualetti P., Franchini M. (2012). "How to Write a Scientific Manuscript for Publica-tíon." Claret Transfus, 11(2): 217-226. [PMC gratuitous article] [PubMed] [Google Scholar]
7. Ware K. (2008). "Peer Review: Benefits, Perceptions and Alternatives." China Summary Papers, 4:four-20. [Google Scholar]
eight. Mulligan A. (2005). "Is Peer Review in Crisis?" Oral On-col. 41(two): 135-141. [PubMed] [Google Scholar]
9. Simons-Morton B., Abraido-Lanza AF., Bernhardt JM., Schoenthaler A., Schnitzer A., Allegerante JP. (2012). "Demystifying Peer Review.", 39(1): three-7. [PubMed] [Google Scholar]
17. Justice AC., Cho MK., Winker MA., Berlin JA., Rennie D. (1998)."Does Masking Author Identity Amend Peer Review Quality?" JAMA, 280(3):240-242. [PubMed] [Google Scholar]
18. McNutt RA, Evans AT., Fletcher RH., Fletcher SW. (1990). "The Effects of Blinding on the Quality of Peer Review." JAMA, 263(10):1371-1376. [PubMed] [Google Scholar]
19. Kumar One thousand. (2009). "A Review of the Review Process: Manuscript Peer-review in Biomedical Enquiry." Biology and Medicine, 1(4): 1-16. [Google Scholar]
xx. Falagas ME. (2007). "Peer Review in Open Access Scientific Journals." Open Medicine, 1(1): 49-51. [PMC gratis article] [PubMed] [Google Scholar]
21. Bohannon J. (2013). "Who's Afraid of Peer Review?" Scientific discipline, 342(6154):lx-65. [PubMed] [Google Scholar]
23. Nichols NL, Sasser JM. (2014). "The Other Side of the Submit Button: How to Go a Reviewer for Scientific Journals." The Physiologist, 57(2): 88-91. [PubMed] [Google Scholar]
24. Hoppin FG., Jr. (2002). "How I Review an Original Scientific Article." Am J Respir Crit Care Med, 166(8): 1019-1023. [PubMed] [Google Scholar]
25. Jefferson T, Alderson P, Wager E, Davidoff F. (2002). "Effects of Editorial Peer Review: A Systematic Review." JAMA, 287(21): 2784-2786. [PubMed] [Google Scholar]
Manufactures from EJIFCC are provided here courtesy of International Federation of Clinical Chemistry and Laboratory Medicine
Source: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4975196/
0 Response to "What Are the Benefits of Publishing in a Peer-reviewed Journal?"
Post a Comment