Office of Portfolio Analysis

The Office of Portfolio Analysis was established in the Division of Program Coordination, Planning, and Strategic Initiatives in 2011 to assist NIH Institutes and Centers with scientific portfolio analysis.[1] Per the Federal Register, the Office of Portfolio Analysis serves the following goals:

  1. Prepare and analyze data on NIH sponsored biomedical research to inform trans-NIH planning and coordination;
  2. Serve as a resource for portfolio management at the programmatic level;
  3. Employ databases, analytic tools, methodologies and other resources to conduct assessments in support of portfolio analyses and priority setting in scientific areas of interest across NIH;
  4. Research and develop new analytic tools, support systems, and specifications for new resources in coordination with other NIH organizations to enhance the management of the NIH's scientific portfolio; and
  5. Provide, in coordination with other NIH organizations, training on portfolio analysis tools, procedures, and methodology.

After its establishment in 2011, George Santangelo was appointed as the first Director of the Office of Portfolio Analysis.

Analytic tools

NIH COVID-19 Portfolio

In response to the COVID-19 pandemic, the Office of Portfolio Analysis developed the NIH COVID-19 Portfolio to index and track ongoing COVID-19 research and disseminate it to the public.[2] This portfolio is curated by scientific experts for COVID-19 relevance, and includes both peer-reviewed publications indexed in PubMed and preprints from bioRxiv, medRxiv, chemRxiv, arXiv, SSRN, and Research Square.

iCite

The NIH developed iCite as a bibliometrics dashboard to freely disseminate article-level citation metrics for scientific publications that are indexed in PubMed. One stated purpose of this analytic tool was to replace the use of journal level metrics like the Journal Impact Factor in research assessment and portfolio analysis.[3] Bulk data are made available through database snapshots and an API[1].As of 2020, iCite hosts three modules focusing on different types of citation metrics:

Influence

The research community called for the use of article-level citation metrics for research assessment instead of journal-level metrics, in the San Francisco Declaration on Research Assessment. The influence module of iCite disseminates field- and time-normalized article-level citation metrics like the Relative Citation Ratio.[4]

Translation

Because the NIH is particularly focused on science that improves human health, it developed article-level metrics that track the dissemination of basic research findings into clinical research, a process known as bench to bedside translation. The Translation module of iCite shows which clinical research articles have cited a given publication. For those publications that are not yet cited by a clinical research article, the Translation module shows the Approximate Potential to Translate,[5] which is a machine learning estimate of the probability that the publication will be cited by a clinical research article in the future.

Citations

In order to maximize transparency, the Office of Portfolio Analysis generated a public-domain citation graph named the NIH Open Citation Collection.[6] This citation graph underpins all citation metrics disseminated in iCite, and sources citation data from several sources, as well as extracting references from the PDFs of open access articles.

References

  1. ^ "National Institutes of Health Statement of Organization, Functions, and Delegations of Authority". Federal Register. U.S. National Archives. 9 February 2011. Retrieved 12 August 2020.
  2. ^ Santangelo, George (15 April 2020). "New NIH Resource to Analyze COVID-19 Literature: The COVID-19 Portfolio Tool". Open Mike. U.S. National Institutes of Health. Retrieved 12 August 2020.
  3. ^ Santangelo, George (2017). "Article-level assessment of influence and translation in biomedical research". Mol Biol Cell. 28 (11): 1401–1408. doi:10.1091/mbc.E16-01-0037. PMC 5449139. PMID 28559438.
  4. ^ Hutchins, B. Ian; Yuan, Xin; Anderson, James M.; Santangelo, George (2016). "Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level". PLOS Biol. 14 (9): e1002541. doi:10.1371/journal.pbio.1002541. PMC 5012559. PMID 27599104.
  5. ^ Hutchins, B. Ian; Davis, Matthew; Meseroll, Rebecca; Santangelo, George (2019). "Predicting translational progress in biomedical research". PLOS Biol. 17 (10): e3000416. doi:10.1371/journal.pbio.3000416. PMC 6786525. PMID 31600189.
  6. ^ Hutchins, B. Ian; Baker, Kirk; Davis, Matthew; Diwersy, Mario; Haque, Ehsanul; Harriman, Robert; Hoppe, Travis; Leicht, Stephen; Meyer, Payam; Santangelo, George (2019). "The NIH Open Citation Collection: A public access, broad coverage resource". PLOS Biol. 17 (10): e3000385. doi:10.1371/journal.pbio.3000385. PMC 6786512. PMID 31600197.