In this study, two indicators derived from references in papers were proposed to characterize the papers regarding technological relevance: (1) the number of reference papers that obtained citations from patents by the time of observation, i.e., the publication years of papers to be assessed (NR-PCP), and (2) the number of reference papers authored by the firms’ researchers (NR-FP). Next, the two indicators were applied to papers published in 2001 to assess their performance. The results obtained by the two indicators were evaluated by citations from patents until 2016 in various conditions: scientific field, institutional sector, and period of measurement. Results showed a robustness of both indicators in many conditions. NR-PCP showed better results in most cases than NR-FP, although its recall was inferior to NR-FP for papers in which all references were newer than 1996. Based on the result that NR-PCP was preferred as an indicator, the rationale of using reference papers cited in the patent by the period of observation (R-PCP) as an indicator was considered based on the papers’ potential distances from the border between science and technology, which was obtained from an extended version of the citation network originally proposed by Ahmadpoor and Jones (Science 357:583–587, 2017. https://doi.org/10.1126/science.aam9527 ). Finally, issues to be addressed were discussed.

中文翻译：

---

尝试根据参考文献确定与技术相关的论文

在本研究中，提出了从论文中的参考文献衍生的两个指标来表征论文的技术相关性：（1）在观察时获得专利引用的参考论文数量，即待评估论文的发表年份(NR-PCP) 和 (2) 公司研究人员撰写的参考论文数量 (NR-FP)。接下来，将这两个指标应用于 2001 年发表的论文，以评估其表现。这两个指标获得的结果是通过截至 2016 年的专利在不同条件下的引用来评估的：科学领域、机构部门和测量周期。结果表明，这两个指标在许多条件下都具有稳健性。NR-PCP 在大多数情况下显示出比 NR-FP 更好的结果，尽管对于所有参考文献都比 1996 年更新的论文，其召回率不如 NR-FP。基于首选 NR-PCP 作为指标的结果，在观察期使用专利中引用的参考文献的基本原理（ R-PCP) 作为一个指标是基于论文与科学和技术边界的潜在距离而考虑的，该距离是从 Ahmadpoor 和 Jones 最初提出的引文网络的扩展版本中获得的 (Science 357:583–587, 2017 . https://doi.org/10.1126/science.aam9527 ）。最后，讨论了需要解决的问题。根据论文与科学和技术边界的潜在距离（从引文的扩展版本中获得），考虑使用以观察期 (R-PCP) 为指标的专利中引用的参考论文的基本原理网络最初由 Ahmadpoor 和 Jones 提出（Science 357:583–587, 2017. https://doi.org/10.1126/science.aam9527）。最后，讨论了需要解决的问题。根据论文与科学和技术边界的潜在距离（从引文的扩展版本中获得），考虑使用以观察期 (R-PCP) 为指标的专利中引用的参考论文的基本原理网络最初由 Ahmadpoor 和 Jones 提出（Science 357:583–587, 2017. https://doi.org/10.1126/science.aam9527）。最后，讨论了需要解决的问题。