Peer review for the evaluation of the academic research: the Italian experience

Peer review, that is the evaluation process based on judgments formulated by independent experts, is generally used for different goals: the allocation of research funding, the review of the research results submitted for publication in scientific journals, and the assessment of the quality of research conducted by Universities and university-related Institutes. The paper deals with the latter type of peer review. The aim is to understand how the characteristics of the Italian experience provide useful lessons for improving peer review effectiveness for evaluating the academic research. More specifically, the paper investigates the peer review process developed within the Three-Year Research Assessment Exercise (VTR) in Italy. Our analysis covers four disciplinary sectors: chemistry, biology, humanities and economics. Thus, the choice includes two “hard science” sectors, which have similar type of research output submitted for the three-year evaluation process, and two sectors with different types of output. The results provide evidences, which highlight the important role played by peer review for judging the quality of the academic research in different fields of science, and for comparing different institutions’ performance. Moreover, some basic features of the evaluation process are discussed, in order to understand their usefulness for reinforcing the effectiveness of the peers’ final outcome.Scientific research, Evaluation, Peer review, University, Academic institutions

Training Program at Medical School of Chieti, Italy

We describe the changes in medical training program offered at the G. D’Annunzio University Medical School in Chieti-Pescara, Italy, which took place over the last decade. The new curriculum differs from the previous one in several important aspects, including limited number of students admitted to school depending on the estimated needs for physicians, obligatory class attendance, student attendance in preclinical laboratories, formative credits as a measure of student activity, and elective subjects. Furthermore, all medical graduates are allowed to take the State exam to obtain the license to practice, which was not the case previously. As a result of these major changes, a higher number of students graduates in due time. The changes made in the medical education curriculum in Italy have enabled Italian medical graduates to work in European Community Hospitals, because their medical degree is recognized in other EU countries. The main motif that drives the Medical School in Chieti-Pescara is the achievement of high quality in medical education and biomedical research by creating as strong a relationship between education and research as possible

Peer review for the evaluation of the academic research. The Italian experience (Paper presented at the Platform FTEval International Conference, New Frontiers in Evaluation, Vienna, April 24-25 2006)

WP 15/2006; Peer review, that is the evaluation process based on judgments formulated by independent experts, is generally used for different goals: the allocation of research funding, the review of the research results submitted for publication in scientific journals, and the assessment of the quality of research conducted by Universities and university-related Institutes. The paper deals with the latter type of peer review. The aim is to understand how the characteristics of the Italian experience provide useful lessons for improving peer review effectiveness for evaluating the academic research. More specifically, the paper investigates the peer review process developed within the Three-Year Research Assessment Exercise (VTR) in Italy. Our analysis covers four disciplinary sectors: chemistry, biology, humanities and economics. Thus, the choice includes two 'hard science' sectors, which have similar type of research output submitted for the three-year evaluation process, and two sectors with different types of output. The results provide evidences, which highlight the important role played by peer review for judging the quality of the academic research in different fields of science, and for comparing different institutions’ performance. Moreover, some basic features of the evaluation process are discussed, in order to understand their usefulness for reinforcing the effectiveness of the peers’ final outcome

Integrative taxonomy approach to detect spatial and temporal variability of the Mediterranean benthic communities through artificial substrate units (ASUs)

Monitoring spatial and temporal changes of marine benthic communities using standardized procedures is essential to take necessary steps towards conservation of marine ecosystems. In this study we combined Artificial Substrate Units (ASUs) for sampling of benthic communities, with integrative taxonomy approach that incorporated morphological identification of organisms and COI DNA metabarcoding, to characterize the diversity of communities at three locations across the Central Mediterranean Sea (Livorno and Palinuro, Italy; Rovinj, Croatia) in 2019 and 2020. Significant differences in the communities’ structure were observed both at large spatial scale between sampled locations, and at small spatial scale (less than ten kilometers) between sites. Moreover, significant temporal variability in species richness and structure of benthic assemblages was detected, with higher richness in 2020. Revealed variability can probably be attributed to the peculiar geomorphological, oceanographical, and ecological features of locations, but also to the influence of interplaying local chemical and physical factors and biological processes such as species settlement, competition, and migration that can act at small spatial and temporal scales. The similarity in the species composition and community structure accessed by morphological and metabarcoding approaches was low,with only 16% of the species (out of 133 species identified overall) commonly detected by both approaches. This is mostly both due to a lack of data on COI sequences of numerous benthic invertebrates in the public barcoding databases on the one hand, and difficulties in detecting small and cryptic taxa through morphological analyses on the other. This suggests that combining of two approaches is required to fully describe the biodiversity of benthic assemblages. Finally, comparison of the spatial variability of the benthic communities’ structure with two approaches at different taxonomic levels, indicated that genus and family levels give results that are consistent to those obtained by the species level. This suggests that family level might be satisfactory in monitoring the spatial-temporal variability of Mediterranean hard bottom benthic communities

Quality of life in patients with advanced ovarian cancer after primary debulking surgery versus neoadjuvant chemotherapy: Results from the randomised SCORPION trial (NCT01461850)

Objective To investigate the effect of treatment with neoadjuvant chemotherapy (NACT) followed by interval debulking surgery (IDS), versus primary debulking surgery (PDS), on quality of life (QoL) in patients with advanced epithelial ovarian cancer (EOC).Design Randomised trial conducted in a single institution.Setting Division of Gynaecologic Oncology, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.Sample Patients with stage-IIIC/IV EOC and high tumour load.Methods Patients were randomised (1:1) to undergo either PDS (PDS group) or NACT followed by IDS (NACT/IDS group).Main outcome measures Quality-of-life (QoL) data, assessed using the European Organization for Research and Treatment of Cancer core QoL questionnaire (QLQ-C30) and ovarian cancer module (OV28); co-primary outcomes were the QLQ-C30 global health score at 12 months (cross-sectional analysis) and the difference in mean QLQ-C30 global health score over time between treatment groups (longitudinal analysis).Results From October 2011 to May 2016, 171 patients were enrolled (PDS = 84; NACT/IDS = 87). We observed no clinical or statistically significant difference between treatment groups in any of the QoL functioning scales at 12 months, including QLQ-C30 global health score (NACT/IDS group vs PDS group, mean difference 4.7, 95% CI -4.99 to 14.4, p = 0.340). Over time, we found lower global health scores for those undergoing PDS than for those receiving NACT (difference in mean score 6.27, 95% CI 0.440-12.11, p = 0.035), albeit this was not clinically relevant.Conclusions We found no difference in global QoL related to treatment approach at 12 months, even though patients in the NACT/IDS group reported better global health scores across the 12-month period compared with the PDS group; these findings further confirm that NACT/IDS might be a feasible option for patients unsuitable for PDS

Upfront HIPEC and bevacizumab-containing adjuvant chemotherapy in advanced epithelial ovarian cancer

Introduction: In advanced epithelial ovarian cancer patients, the standard of care is primary debulking surgery, followed by first-line chemotherapy often with bevacizumab addiction. In this context, some experiences have shown that a comprehensive treatment approach to surgery combined with hyperthermic intraperitoneal chemotherapy (HIPEC) could improve the prognosis. Objective: This is a study aimed to explore the feasibility of primary debulking surgery and HIPEC upfront followed by first-line therapy with bevacizumab. Study Design: Phase II monocentric, open label, non-randomised and single-arm study. Forty patients affected by advanced ovarian cancer submitted to primary debulking surgery with HIPEC were enrolled in the study. After surgery, all patients underwent systemic chemotherapy with bevacizumab addiction. Results: Complete cytoreduction (RT = 0) was achieved in all cases. Treatment-related early complications were observed in 23 patients and in 15 cases were G1–G2. Major complications were reported in 8 patients. No postoperative death was recorded. Subsequent chemotherapy was administered in all cases. Median time between surgery and first cycle of chemotherapy was 42 days (range 30–76). Concomitant bevacizumab was administered in 34 patients (85%). Maintenance with bevacizumab was feasible in 33 patients (82.5%) and its withdrawal was necessary for 1 patient (2.5%) due to G3 hypertension. Conclusion: Our data suggest that HIPEC can be safely introduced in the upfront therapy of advanced ovarian cancer

Integrative taxonomy approach to detect spatial and temporal variability of the Mediterranean benthic communities through artificial substrate units (ASUs)

Monitoring spatial and temporal changes of marine benthic communities using standardized procedures is essential to take necessary steps towards conservation of marine ecosystems. In this study we combined Artificial Substrate Units (ASUs) for sampling of benthic communities, with integrative taxonomy approach that incorporated morphological identification of organisms and COI DNA metabarcoding, to characterize the diversity of communities at three locations across the Central Mediterranean Sea (Livorno and Palinuro, Italy; Rovinj, Croatia) in 2019 and 2020. Significant differences in the communities’ structure were observed both at large spatial scale between sampled locations, and at small spatial scale (less than ten kilometers) between sites. Moreover, significant temporal variability in species richness and structure of benthic assemblages was detected, with higher richness in 2020. Revealed variability can probably be attributed to the peculiar geomorphological, oceanographical, and ecological features of locations, but also to the influence of interplaying local chemical and physical factors and biological processes such as species settlement, competition, and migration that can act at small spatial and temporal scales. The similarity in the species composition and community structure accessed by morphological and metabarcoding approaches was low, with only 16% of the species (out of 133 species identified overall) commonly detected by both approaches. This is mostly both due to a lack of data on COI sequences of numerous benthic invertebrates in the public barcoding databases on the one hand, and difficulties in detecting small and cryptic taxa through morphological analyses on the other. This suggests that combining of two approaches is required to fully describe the biodiversity of benthic assemblages. Finally, comparison of the spatial variability of the benthic communities’ structure with two approaches at different taxonomic levels, indicated that genus and family levels give results that are consistent to those obtained by the species level. This suggests that family level might be satisfactory in monitoring the spatial-temporal variability of Mediterranean hard bottom benthic communities

Delay in cutaneous squamous cell carcinoma diagnosis due to interrupted services is associated with worse prognoses and modified surgical approaches

Background: The delayed diagnosis of skin tumors is associated with a worsened prognosis. The impact of the interruption of clinical and surgical health services during the COVID-19 pandemic lockdowns has been documented among many pathologies. The impact of delayed diagnoses on patients with cutaneous squamous cell carcinomas (cSCCs) is poorly defined. Objective: To compare patient and lesion characteristics and the surgical management of excised cSCCs prior to the pandemic shutdown of services (2018–2019) with the phase following the pandemic’s second wave (2021–2022). Methods: An observational, single-center, cross-sectional study of 416 surgically excised cSCCs over the course of two years was performed. Only patients with histologically confirmed cSCC were enrolled. Data collection included patient demographics and lesion characteristics, time to surgery, surgical approach, and histological data. Results: More cSCC lesions were excised prior to the interruption of services (n = 312 vs. n = 186). Lesions were significantly larger (1.7 ± 1.2 vs. 2.1 ± 1.5 cm; p = 0.006) and more invasive (52% vs. 89%; p < 0.001), in the period 2021–2022. Surgical reconstructive techniques were significantly different (p = 0.001). Metastatic involvement was confirmed in three subjects (one in 2018–2019 and two in 2021–2022). There were no significant differences in the time to surgery or patient characteristics. Multivariable regression analysis identified a 4.7-times higher risk of tumor invasion (OR 4.69, 95%CI 2.55–8.16, p < 0.001), a two-times higher chance of dermo-epidermal grafts (OR 2.06, 95%CI 1.09–3.88, p = 0.025), and a 3.2-times higher risk of positive surgical margins (OR 3.21, 95%CI 1.44–7.17, p = 0.004). Conclusions: Diagnostic delays of cutaneous SCCs associated with reduced patient access to clinical and diagnostic services are associated with a 4.7-times increased risk of more severe invasion, a three-times increased risk of positive surgical margins, and a significant impact on surgical management, compared to the pre-pandemic period. Comparable patient cohort characteristics and time to surgery remained unchanged