Assessing the quality of open access journals suzhou presentation
-
Upload
directory-of-open-access-journals-doaj -
Category
Education
-
view
309 -
download
0
Transcript of Assessing the quality of open access journals suzhou presentation
ASSESSING THE QUALITY OF OPEN ACCESS JOURNALS审核开放获取期刊的质量
SEMINAR AT CHINA OPEN ACCESS WEEK
OCTOBER 24, 2016, [email protected]
EDITOR-IN-CHIEF DOAJDOAJ 官方微信公众号正式发布欢迎扫描二维码加入我们
You are free to:Copy, share, adapt, or re-mix;
Blog, live-blog, or post video of;
This presentation. Provided that:You attribute the work to its author and respect the rights and licenses associated with its components.
Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;http://www.thisismyurl.com/free-downloads/15-free-speech-bubble-icons-for-popular-websites
• PROOF? 证据• MISBELIEFS 误解• THE REALITY OF OPEN ACCESS 真正的开放获取
Are Open Access Journals of Low Quality? 开放获取期刊的质量差吗?
S U P P O S E•S C O P U S A S M E A S U R E F O R T O L L A C C E S S Q U A L I T Y J O U R N A L S• D O A J A S M E A S U R E F O R O P E N A C C E S S Q U A L I T Y J O U R N A L S
F A C T S• N O T A L L S U B S C R I P T I O N J O U R N A L S A R E I N S C O P U S O N L Y 1 0 - 2 0 , 0 0 0 O F 1 0 0 . 0 0 0• N O T A L L O P E N A C C E S S J O U R N A L S A R E I N D O A J O N L Y 8 - 1 0 , 0 0 0 O F 3 5 , 0 0 0
•C O N C LU S I O N • P E R C E N T A G E Q U A L I T Y J O U R N A L S I S A B O U T T H E S A M E
Open Access versus Toll Access 开放获取 vs. 订购访问
OPEN ACCESS.....• A RT IC L E S R E C E I V E M O R E C I TAT I O N S• R E A C H E S A B I G G E R AU DI E N C E• L E A DS T O B E T T E R E DU C AT IO N• AVO ID S D U P L IC AT E S T U D I E S• A RT IC L E S C AN B E M O R E E A S I LY C H E C K E D• D ATA L E SS P R O NE T O M A N IPU L AT I O N• I S B E T T E R F O R A DVA N C I NG S C IE N C E• L E A DS T O M O R E I N NOVAT I O N
The Reality of Open Access真正的开放获取
• QUALITY OF PUBLISHING (出版的质量)• QUALITY OF THE SCIENCE (科学的质量)
Assessing the Quality of a Journal审核期刊的质量
• CRITERIA FOR PUBLISHING• Principles of transparency and Best Practice in Scholarly Publishing• DOAJ criteria for Quality Open Access Publishing
Quality of Publishing(出版的质量)
• D i r e c t o r y o f O p e n A c c e s s J o u r n a l s
• L a u n c h e d i n M a y 2 0 0 3 , L u n d U n i v e r s i t y, S w e d e n – l i s t o f 3 0 0 t i t l e s
• C e n t r a l l y, p u b l i c l y a n d i n t e r n a t i o n a l l y a v a i l a b l e c o m m u n i t y - c u r a t e d l i s t o f h i g h q u a l i t y o p e n a c c e s s j o u r n a l t i t l e s a c r o s s a l l d i s c i p l i n e s
• A i m : t o b e t h e s t a r t i n g p o i n t f o r a l l i n f o r m a t i o n s e a r c h e s f o r q u a l i t y, p e e r - r e v i e w e d o p e n a c c e s s m a t e r i a l
What is the DOAJ?DOAJ 是什么?
Required information for inclusion in the
DOAJ收录DOAJ所需的信息*Basic requirement (*为基本要求)
https://doaj.org/publishers
Journal Web Site (1)* 期刊网站• Dedicated web site per journal – journal specific web
address*• All journal content centrally available – not spread
over various pages• Do not mimic other journal web sites• Web site clear, concise, easy to navigate, transparent,
up to date and correct content – high ethical and professional standards• Language & grammar usage correct, spell check
Journal Web Site (2)* 期刊网站• Visible links to business information• Avoid distracting, offensive, irrelevant, moving, blinking
advertisements• Unique identifier (web address) *:
• Journal level• Article metadata level (also DOI)• Full text article level (pdf, html, xml, epub)
• ISSN (International Standard Serial Number) *• Print ISSN and/or• Online ISSN
Journal Content 期刊内容• Clear journal structure for easier navigation, indexing, discoverability• Publication date for each article• Publication year per volume/issue• Volumes & issues; 5 articles per year• Start & end page number• Authors, affiliations, countries, ORCIDs• Articles arranged in Table of Contents• Search/Browse option• Links to Current, Archive/Past Issues
Impact Factors 影响因子• Thomson Reuters IF against ethics and principles of
OA• DOAJ is IF agnostic• Display of IF information on journal web page
discouraged
Ownership & Management 归属权 & 管理• Journal title unique – not confusing/misleading• Avoid using misleading information• Each journal unique, journal specific policies• All business information about journal available from
central web site for journal* - not generic web site for publisher
Business Information* 商业信息• About• Aims and Scope• Editorial Board• Instructions for Authors• Quality control system• Open Access system• Plagiarism policy• Licensing terms• Contact info
Editorial Office & Editorial Team 编辑部 & 编辑团队• Editor*/Editor-in-Chief/Associate Editor/Co-Editor• Full names, Affiliations, Countries, Emails*• Postal address of office• Contact information: email/telephone
Governing Body 主管部门• Editorial Board*/Editorial Advisory Board• Arts & Humanities allowed editorial review, 2 editors,
no editorial board• Members to be experts in field/journal scope• Full names, Affiliations, Countries, Emails*
Aims & Scope 期刊的内容和范围
Author Fees 作者费用• Article Processing Charges (APCs)• Article Submission Charges (APCs)• Manuscript Handling Fees• Galley Fees, page charges, colour charges, etc.• Per article (incl. any taxes if applicable) – not per page• Waiver policy• Clearly visible for prospective authors – also if
no charges apply*
Peer Review Process* 同行评议• Advice on individual manuscripts from reviewers/
experts in the field who are not part of the journal's editorial staff• Quality control rigorous• Process & policies clearly described on journal's web
site• Editorial/Peer - Blind/Double blind/Open*
Instructions for Authors* 投稿须知• Detailed style guide• Description of quality control process (review)• Copyright information• Licensing information• Plagiarism policy• Instructions on how to submit an article• Contact email address
Access & Usage 获取 & 使用• Full text of all content available as Open Access, no
delay/embargo*• How accessible is journal to the rest of the world,
harvesters• Open Access or Subscription Access or Pay per view• Journal specific OA statement/policy*• Differentiate between OA statement – Copyright -
Licensing
Rights 权利• Recommend: author retains copyright• Recommend: no exclusive publishing rights• Recommend: no transfer of commercial rights
https://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/
Content Licensing 内容许可• Clearly described on web site• Licensing terms on all articles, all versions (html, pdf,
xml etc.)• Embedded in article level metadata
Depositing Policy 存储政策
http://www.sherpa.ac.uk/romeo/index.php
Ethics & Malpractice 伦理 & 不端行为• Indicate steps to identify & prevent papers where
research misconduct occurred• Unethical• Plagiarism (statement & similarity check tool)• Citation manipulation• Data falsification/fabrication
• See COPE Guidelines in dealing with allegations
Conflict of Interest 利益冲突• Policy on handling potential conflict of interest -
editors, authors, reviewers
Financial Sustainability 财务可持续• Revenue sources (eg author fees, subscriptions,
advertising, reprints, institutional support, organizational support)• Advertising policy, types of ads, decision making on
ads, ads linked to content or reader behavior/displayed at random• Marketing: appropriate, well targeted, unobtrusive
Publishing Schedule 刊发计划• Clearly indicate periodicity• No interruptions• Annually, bi-annually, monthly, bi-monthly, continuos,
etc.• Number of volumes, issues
Accessibility & Availability 可访问性 & 可用性
Digital Archiving & Preservation 电子存储 &保存• Electronic backup• Cloud, disk, server, tapes, etc
• Preservation – Keepers’ Registry & PubMed Central• Portico• Open Journal Systems (OJS) – PKP Private LOCKSS network
deposited in CLOCKSS
DOAJ Seal 印章
JOU R N A L LE V EL•P E E R - R E V I E W, E D I T O R I A L B O A R D, P R O O F- R E A D I N G ( D O A J C R I T E R I A )
•T H O M S O N R E U T E R S - J I F ( T H O M S O N - R E U T E R )
• J O U R N A L C I TAT I O N D I S T R I B U T I O N S R E P L A C I N G T H E J I F ( P U B L I S H E R S )
A RT I C L E L E V E L
• A R T I C L E L E V E L M E T R I C S ( A L T M E T R I C , I M P A C T S T O R Y )
• R E L AT I V E C I TAT I O N I N D I C E S ( I C I T E T O O L )
Assessing Quality of the Science审核科学的质量
oTHE SCIENTIFIC QUALITY OF A JOURNAL CAN NOT BE ASSESSED BY THE AVERAGE CITATION SCORES OF ARTICLES
oTHE SCIENTIFIC QUALITY OF ARTICLES CANNOT BE ASSESSED BY WHERE THEY ARE PUBLISHED
oSCIENTIFIC QUALITY CAN ONLY BE ASSESSED ON ARTICLE LEVEL
Assessing Quality of the Science审核科学的质量
H E A D L I N E S I N , S C I E N C E , N A T U R E , T H E S C I E N T I S T, P L O S T H I S Y E A R 2 0 1 6 What is wrong with the JIF?期刊影响因子有错吗?
• WEAK RELATION WIT H JOURNAL QUALITY•NO RELATION WITH INDIVIDUAL ARTICLE QUALITY IN A GIVEN JOURNAL• NO RELATION W ITH SCIENTIST QUALITY
• INAPPROPRIAT E USE OF J IF FOR ALL THE AB OVE!
•IN ADDIT ION THE J IF IS H IGHLY BIASED TOWARDS ENGLISH LANGUAGE ST M JOURNALS
What is wrong with the JIF?期刊影响因子有错吗?
THE JIF I S C A L C U L A T E D I N A P P R O P R I A T E L Y A S T H E A R I T H M E T I C M E A N O F A
H I G H L Y S K E W E D D I S T R I B U T I O N O F C I T A T I O N S
IT CONTAINS NO MEASURE OF THE SPREAD OF THE DISTRIBUTION; IT OBSCURES THE HIGH DEGREE OF OVERLAP BETWEEN THE
CITATION DISTRIBUTIONS OF MOST JOURNALS
IT IS NOT REPRODUCIBLE AND THE DATA THAT SUPPORT IT ARE NOT PUBLICLY
AVAILABLE
What is wrong with the JIF?期刊影响因子有错吗?
Source :doi:http://dx.doi.org/10.1101/062109.
Table 2: Percentage of papers published in 2013-2014 with
number of citations below the value of the 2015 JIF.
Larivière et al. (2016)
eLife 8.3 71.2%EMBO J. 9.6 66.9%J. Informetrics 2.4 68.4%Nature 38.1 74.8%Nature Comm. 11.3 74.1%PLOS Biol. 8.7 66.8%PLOS Genet. 6.7 65.3%PLOS ONE 3.1 72.2%Proc. R. Soc. B 4.8 65.7%Science 34.7 75.5%Sci. Rep. 5.2 73.2%
Journal JIF% citable items
below JIF
0
10
20
30
40
50
60
70
80
90
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
eLife
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
EMBO J.
0
10
20
30
40
50
60
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
J. Informetrics
0
10
20
30
40
50
60
70
80
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
Nature
0
50
100
150
200
250
300
350
400
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
Nature Comm.
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
PLOS Biol.
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
PLOS Genet.
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
PLOS ONE
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
Proc. R. Soc. B
0
10
20
30
40
50
60
70
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
Science
0
200
400
600
800
1,000
1,200
0 10 20 30 40 50 60 70 80 90 100+
Num
ber o
f pap
ers
Number of citations
Sci. Rep.
highly skewed distribution of citations高度不平衡的文献引用分布
doi: http://dx.doi.org/10.1101/062109
FOR PUBLISHERS:DO NOT USE IF FOR THE PROMOTION OF YOUR
JOURNAL
FOR AUTHORS:IT IS NOT IMPORTANT WHERE YOU PUBLISH BUT
WHAT YOU PUBLISH
FOR FUNDERS:DO NOT JUDGE SCIENTISTS ON WHERE THEY
PUBLISH OR HOW MUCH THEY PUBLISH
Too much is wrong with the JIF期刊影响因子有太多的错误
Replacing the Impact Factor取代影响因子
this analysis helps to expose the exaggerated value attributed to the JIF and strengthens the contention that it is an inappropriate indicator for the evaluation of research or researchers," the team concludes in a preprint paper posted to bioRxiv.
doi: http://dx.doi.org/10.1101/062109
ALTMETRICSTAKING INTO ACCOUNT CITATIONS, SOCIAL MEDIA,
CONVENTIAL MEDIA (NEWSPAPERS, TV, VIDEO)
RELATIVE CITATION SCORESCITATION INDICES ADJUSTED FOR SCIENTIFIC FIELD
Article Level Impact Assessment基于文献的影响力评估
LEIDEN MANIFESTOdoi:http://dx.doi.org/10.1101/062109
DORAThe San Francisco Declaration on Research Assessmentdoi: 10.1242/dmm.012955
San Francisco Declaration on Research Impact关于科研影响力的旧金山声明
http://www.ascb.org/dora/
Leiden Manifesto for Research Metrics关于科研指标的莱顿宣言
TEN PRINCIPLESAmong which6. Account for variation by field in publication and citation practices8. the journal impact factor is published to three decimal places to avoid ties. it makes no sense to distinguishbetween journals on the basis of very small impact factor differences. Avoid false precision
Relative Citation Ratios相对引用率
https://icite.od.nih.gov/
•
Relative Citation Ratios相对引用率
The must haves!Journals must have: 必须有• An Open Access statement• Comply with the BOAI definition• A peer-review process, and describe the kind of process• An editor/editorial board with clearly identifiable
members• Licensing and copyright information• Aims and scope• Published a least 5 articles per year to qualify (DOAJ
criteria)• Impact Factor (any) IRRELEVANT
Quality Open Access Journals高质量的开放获取期刊
Journals are strongly recommended to have• Unrestricted copyright for the author• No exclusive publishing rights• No transfer of commercial rights• Clear licensing conditions• Preferably use of Creative commons licensing• Embedded licensing information with articles• Link to underlying data• No mention of IF, instead use journal citation distribution
plots
Quality Open Access Journals高质量的开放获取期刊Recommendations推荐
Thanks to all the Library Consortia, Universities and Publishers and our Sponsors for the financial support to DOAJ!感谢我们所有的图书馆联盟,大学,出版商和赞助商对 DOAJ的财政支持!
We have vacancies here!