Context: Quality Assessment (QA) of reviewed literature is paramount to a Systematic Literature Review (SLR) as the quality of conclusions completely depends on the quality of selected literature. A number of researchers in Software Engineering (SE) have developed a variety of QA instruments and also reported their challenges. We previously conducted a tertiary study on SLRs with QA from 2004 to 2013, and reported the findings in 2015.

Objective: With the widespread use of SLRs in SE and the increasing adoption of QA in these SLRs in recent years, it is necessary to empirically investigate whether the previous conclusions are still valid and whether there are new insights to the subject in question using a larger and a more up-to-date SLR set. More importantly, we aim to depict a clear picture of QA used in SLRs in SE by aggregating and distilling good practices, including the commonly used QA instruments as well as the major roles and aspects of QA in research.

Method: An extended tertiary study was conducted with the newly collected SLRs from 2014 to 2018 and the original SLRs from 2004 to 2013 to systematically review the QA used by SLRs in SE during the 15-year period from 2004 to 2018. In addition, this extended study also compared and contrasted the findings of the previous study conducted in 2015.

Results: A total of 241 SLRs between 2004 and 2018 were included, from which we identified a number of QA instruments. These instruments are generally designed to focus on the rationality of study design, the rigor of study execution and analysis, and the credibility and contribution of study findings and conclusions, with the emphasis largely placed on its rigor. The quality data is mainly used for literature selection or as evidence to support conclusions.

Conclusions: QA has received much attention in SE in more recent years and the improvement is evident since the last study in 2015. New findings show that the aims are more concise, the instruments are more diverse and rigorous, and the criteria are more thoughtful.

背景：综述文献的质量评估（QA）对于系统文献综述（SLR）至关重要，因为结论的质量完全取决于所选文献的质量。软件工程（SE）的许多研究人员已经开发了各种质量保证工具，并报告了它们的挑战。我们之前曾于2004年至2013年对具有质量保证措施的SLR进行了三次研究，并于2015年报告了研究结果。

目的：随着近年来SLR在SE中的广泛使用以及QA在这些SLR中的采用日益广泛，有必要通过经验调查先前的结论是否仍然有效，以及是否有较大的使用该问题的新见解。以及最新的单反相机。更重要的是，我们旨在通过汇总和提炼良好实践（包括常用的质量保证工具以及质量保证在研究中的主要作用和方面），描绘出东南地区单反相机中使用的质量保证的清晰图景。

方法：对2014年至2018年新收集的SLR和2004年至2013年的原始SLR进行了扩展的第三级研究，系统地回顾了2004年至2018年的15年中SE在东南地区使用的QA。扩展研究还比较并对比了2015年进行的先前研究的结果。

结果：包括2004年至2018年之间的241个SLR，我们从中确定了许多QA工具。这些工具通常旨在关注研究设计的合理性，研究执行和分析的严谨性以及研究结果和结论的可信度和贡献，重点主要放在其严谨性上。质量数据主要用于文献选择或作为支持结论的证据。

结论：质量检查在近几年受到了SE的广泛关注，并且自2015年进行上一次研究以来，这种改进是显而易见的。新发现表明，目标更加简洁，工具更加多样化和严格，标准也更加周到。