18 research outputs found
Fundamentals of Laparoscopic Surgery: A Surgical Skills Assessment Tool in Gynecology
This analysis suggests that the fundamentals of laparoscopic surgery skills test may be a valuable assessment tool for gynecology residents; however, the cognitive test may need further adaptation for application to gynecologists
Validity and Reliability of the Robotic Objective Structured Assessment of Technical Skills
Objective structured assessments of technical skills (OSATS) have been developed to measure the skill of surgical trainees. Our aim was to develop an OSATS specifically for trainees learning robotic surgery
Surgical Outcomes in Benign Gynecologic Surgery Patients during the COVID-19 Pandemic (SOCOVID study)
Study Objective
To determine the incidence of perioperative coronavirus disease (COVID-19) in women undergoing benign gynecologic surgery and to evaluate perioperative complication rates in patients with active, previous, or no previous severe acute respiratory syndrome coronavirus 2 infection.
Design
A multicenter prospective cohort study.
Setting
Ten institutions in the United States.
Patients
Patients aged >18 years who underwent benign gynecologic surgery from July 1, 2020, to December 31, 2020, were included. All patients were followed up from the time of surgery to 10 weeks postoperatively. Those with intrauterine pregnancy or known gynecologic malignancy were excluded.
Interventions
Benign gynecologic surgery.
Measurements and Main Results
The primary outcome was the incidence of perioperative COVID-19 infections, which was stratified as (1) previous COVID-19 infection, (2) preoperative COVID-19 infection, and (3) postoperative COVID-19 infection. Secondary outcomes included adverse events and mortality after surgery and predictors for postoperative COVID-19 infection. If surgery was delayed because of the COVID-19 pandemic, the reason for postponement and any subsequent adverse event was recorded. Of 3423 patients included for final analysis, 189 (5.5%) postponed their gynecologic surgery during the pandemic. Forty-three patients (1.3% of total cases) had a history of COVID-19. The majority (182, 96.3%) had no sequelae attributed to surgical postponement. After hospital discharge to 10 weeks postoperatively, 39 patients (1.1%) became infected with severe acute respiratory syndrome coronavirus 2. The mean duration of time between hospital discharge and the follow-up positive COVID-19 test was 22.1 ± 12.3 days (range, 4–50 days). Eleven (31.4% of postoperative COVID-19 infections, 0.3% of total cases) of the newly diagnosed COVID-19 infections occurred within 14 days of hospital discharge. On multivariable logistic regression, living in the Southwest (adjusted odds ratio, 6.8) and single-unit increase in age-adjusted Charlson comorbidity index (adjusted odds ratio, 1.2) increased the odds of postoperative COVID-19 infection. Perioperative complications were not significantly higher in patients with a history of positive COVID-19 than those without a history of COVID-19, although the mean duration of time between previous COVID-19 diagnosis and surgery was 97 days (14 weeks).
Conclusion
In this large multicenter prospective cohort study of benign gynecologic surgeries, only 1.1% of patients developed a postoperative COVID-19 infection, with 0.3% of infection in the immediate 14 days after surgery. The incidence of postoperative complications was not different in those with and without previous COVID-19 infections
Validity and Reliability of the Robotic Objective Structured Assessment of Technical Skills
OBJECTIVE: Objective Structured Assessments of Technical Skills have been developed to measure the skill of surgical trainees. Our aim was to develop an Objective Structured Assessments of Technical Skills specifically for trainees learning robotic surgery.
METHODS: This is a multiinstitutional study conducted in eight academic training programs. We created an assessment form to evaluate robotic surgical skill through five inanimate exercises. Gynecology, general surgery, and urology residents, Fellows, and faculty completed five robotic exercises on a standard training model. Study sessions were recorded and randomly assigned to three blinded judges who scored performance using the assessment form. Construct validity was evaluated by comparing scores between participants with different levels of surgical experience; interrater and intrarater reliability were also assessed.
RESULTS: We evaluated 83 residents, nine Fellows, and 13 faculty totaling 105 participants; 88 (84%) were from gynecology. Our assessment form demonstrated construct validity with faculty and Fellows performing significantly better than residents (mean scores 89±8 faculty, 74±17 Fellows, 59±22 residents; P\u3c.01). In addition, participants with more robotic console experience scored significantly higher than those with fewer prior console surgeries (P\u3c.01). Robotic Objective Structured Assessments of Technical Skills demonstrated good interrater reliability across all five drills (mean Cronbach\u27s α 0.79±0.02). Intrarater reliability was also high (mean Spearman\u27s correlation 0.91±0.11).
CONCLUSION: We developed a valid and reliable assessment form for robotic surgical skill. When paired with standardized robotic skill drills, this form may be useful to distinguish between levels of trainee performance
Validity and Reliability of the Robotic Objective Structured Assessment of Technical Skills
OBJECTIVE: Objective Structured Assessments of Technical Skills have been developed to measure the skill of surgical trainees. Our aim was to develop an Objective Structured Assessments of Technical Skills specifically for trainees learning robotic surgery.
METHODS: This is a multiinstitutional study conducted in eight academic training programs. We created an assessment form to evaluate robotic surgical skill through five inanimate exercises. Gynecology, general surgery, and urology residents, Fellows, and faculty completed five robotic exercises on a standard training model. Study sessions were recorded and randomly assigned to three blinded judges who scored performance using the assessment form. Construct validity was evaluated by comparing scores between participants with different levels of surgical experience; interrater and intrarater reliability were also assessed.
RESULTS: We evaluated 83 residents, nine Fellows, and 13 faculty totaling 105 participants; 88 (84%) were from gynecology. Our assessment form demonstrated construct validity with faculty and Fellows performing significantly better than residents (mean scores 89±8 faculty, 74±17 Fellows, 59±22 residents; P\u3c.01). In addition, participants with more robotic console experience scored significantly higher than those with fewer prior console surgeries (P\u3c.01). Robotic Objective Structured Assessments of Technical Skills demonstrated good interrater reliability across all five drills (mean Cronbach\u27s α 0.79±0.02). Intrarater reliability was also high (mean Spearman\u27s correlation 0.91±0.11).
CONCLUSION: We developed a valid and reliable assessment form for robotic surgical skill. When paired with standardized robotic skill drills, this form may be useful to distinguish between levels of trainee performance
Validity and Reliability of the Robotic Objective Structured Assessment of Technical Skills
OBJECTIVE: Objective Structured Assessments of Technical Skills have been developed to measure the skill of surgical trainees. Our aim was to develop an Objective Structured Assessments of Technical Skills specifically for trainees learning robotic surgery.
METHODS: This is a multiinstitutional study conducted in eight academic training programs. We created an assessment form to evaluate robotic surgical skill through five inanimate exercises. Gynecology, general surgery, and urology residents, Fellows, and faculty completed five robotic exercises on a standard training model. Study sessions were recorded and randomly assigned to three blinded judges who scored performance using the assessment form. Construct validity was evaluated by comparing scores between participants with different levels of surgical experience; interrater and intrarater reliability were also assessed.
RESULTS: We evaluated 83 residents, nine Fellows, and 13 faculty totaling 105 participants; 88 (84%) were from gynecology. Our assessment form demonstrated construct validity with faculty and Fellows performing significantly better than residents (mean scores 89±8 faculty, 74±17 Fellows, 59±22 residents; P
CONCLUSION: We developed a valid and reliable assessment form for robotic surgical skill. When paired with standardized robotic skill drills, this form may be useful to distinguish between levels of trainee performance.
LEVEL OF EVIDENCE: : II
Establishing benchmarks for minimum competence with dry lab robotic surgery drills.
The robotic objective structured assessment of technical skills (R-OSATS) is a previously validated assessment tool that is used to assess five standardized inanimate robotic surgery drills. R-OSATS is used to evaluate performance on surgical drills, with scores of 0-20 for each drill. Our objective was to establish the minimum threshold score that denotes competence on these drills. Thus, we performed a standard-setting study using data from surgeons and trainees in eight academic medical centers. Cutoff scores for the minimal level of competence using R-OSATS were established using two techniques: 1) the Modified Angoff; and 2) the Contrasting Groups methods. For the Modified Angoff method, eight content experts met, and in an iterative process, derived the scores that a minimally competent trainee should receive. After two iterative rounds of scoring and discussion with the Modified Angoff method, we established a minimum competence score per drill with high agreement (rWG range 0.92 - 0.98). There was unanimous consensus that a trainee needs to achieve competence on each independent drill. A second method, the Contrasting Groups method, was used to verify our results. In this method, we compared R-OSATS scores from inexperienced (34 PGY-1 and 2 trainees) versus experienced (22 faculty and fellow) robotic surgeons. The distributions of scores from both groups were plotted and a cutoff score for each drill was determined from the intersection of the two curves. Using this method, the minimum score for competence would be 14 per drill, which is slightly more stringent but confirms the results obtained from the Modified Angoff approach. In conclusion, using two well described standard-setting techniques, we have established minimum benchmarks designating trainee competence for five dry-lab robotic surgery drills