Prof Corey J. A. Bradshaw
Global Ecology, Flinders University, Adelaide, Australia
September 2021
e-mail
Existing citation-based indices used to rank research performance do not permit a fair comparison of researchers among career stages or disciplines, nor do they treat women and men equally. We designed the ε-index, which is simple to calculate, based on open-access data, corrects for disciplinary variation, can be adjusted for career breaks, and sets a sample-specific threshold above and below which a researcher is deemed to be performing above or below expectation.
This R Shiny app can be accessed via shinyapps.io using the URL cjabradshaw.shinyapps.io/epsilonIndex. The app is an online interface of the original R code for calculating the the ε-index manually (see this Github repository).
Because third-party scraping of Google Scholar data violates their terms of service, the automatic interface part of the original code using the scholar library is disabled in the app.
This app accompanies the article:
BRADSHAW, CJA, JM CHALKER, SA CRABTREE, BA EIJKELKAMP, JA LONG, JR SMITH, K TRINAJSTIC, V WEISBECKER. 2021. A fairer way to compare researchers at any career stage and in any discipline using open-access citation data. PLoS One 16(9): e0257141. doi:10.1371/journal.pone.0257141
--
DIRECTIONS
- Create a delimited text file of exactly the same format as the example file in this repository ('datasample.csv'):
- COLUMN 1: personID — any character identification of an individual researcher (can be a name)
- COLUMN 2: gender — researcher's gender ("F" or "M")
- COLUMN 3: i10 — researcher's i10 index (# papers with ≥ 10 citations); must be > 0
- COLUMN 4: h — researcher's h-index
- COLUMN 5: maxcit — number of citations of researcher's most cited peer-reviewed paper
- COLUMN 6: firstyrpub — the year of the researcher's first published peer-reviewed paper (for instructions on how to adjust this value for career breaks, see item #4 in the 'index variants: explainer' tab)
-
Access the app at cjabradshaw.shinyapps.io/epsilonIndex.
-
Load your delimited text file in the app by clicking the choose file button.
-
Select whether you want the index to be calculated for women and men separately as well as pooled ('include gender split?'). If there are too few researchers in any gender category, the algorithm will fail.
-
Choose how you want the output file to be ordered by selecting one of the four choices in the drop-down menu:
ε-index, gender-debiased ε-index, ε′-index, or gender-debiased ε′-index
If there are insufficient individuals per gender to estimate a gender-specific index, we recommmend not using or sorting based on the gender-debiased index. If the individuals in the sample are not all in the same approximate discipline, we recommend not using or sorting based on either of the two normalised (ε′) indices.
-
Click the calculate button.
-
Download the results table as a .csv file by clicking the clicking the download button
The output .csv file includes the following columns:
- person: researcher's ID (specified by user)
- gender: F=female; M=male
- yrs.publ: number of years since first peer-reviewed article
- cM: citation mass (or, cMs = normalised citation mass if you select gender split)
- gender.eindex: ε-index relative to others of the same gender in the sample (not included if you select no gender split)
- expectation: whether above or below expectation based on chosen index (default is 'e' = pooled index)
- m-quotient: h-index ÷ yrs.publ
- h-index: h-index
- debiased.e.prime.index: scaled gender.eindex (gender ε′-index) (not included if you select no gender split)
- gender.rank: rank from gender.eindex (1 = highest) (not included if you select no gender split)
- rnk.debiased: gender-debiased rank (1 = highest) (not included if you select no gender split)
- cM: citation mass (COLUMN 4 if you select no gender split)
- pooled.eindex: ε-index generated from the entire sample (not gender-specific)
- e.prime.index: scaled pooled.eindex (ε′-index)
- pooled.rnk: rank from pooled.eindex (1 = highest)
and
if you sorted based on ε′-index:
- ePRnk: rank from scaled pooled.eindex (ε′-index)
or if you sorte base on gender-debiased ε′-index:
- ePddebRnk: rank from scaled gender.eindex (gender ε′-index)