Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery

OBJECTIVE: Surgical performance evaluation was first described with the OSATS (Objective Structured Assessment of Technical Skills) and modified for aneurysm microsurgery simulation with the OSAACS (Objective Structured Assessment of Aneurysm Clipping Skills). These methods rely on the subjective opinions of evaluators, however, and there is a lack of objective evaluation for proficiency in the microsurgical treatment of brain aneurysms. The authors present a new instrument, the Skill Assessment in Microsurgery for Brain Aneurysms (SAMBA) scale, which can be used similarly in a simulation model and in the treatment of unruptured middle cerebral artery (MCA) aneurysms to predict surgical performance; the authors also report on its validation. METHODS: The SAMBA scale was created by consensus among 5 vascular neurosurgeons from 2 different neurosurgical departments. SAMBA results were analyzed using descriptive statistics, Cronbach's alpha indexes, and multivariate ANOVA analyses (p < 0.05). RESULTS: Expert, intermediate-level, and novice surgeons scored, respectively, an average of 33.9, 27.1, and 16.4 points in the real surgery and 33.3, 27.3, and 19.4 points in the simulation. The SAMBA interrater reliability index was 0.995 for the real surgery and 0.996 for the simulated surgery; the intrarater reliability was 0.983 (Cronbach's alpha). In both the simulation and the real surgery settings, the average scores achieved by members of each group (expert, intermediate level, and novice) were significantly different (p < 0.001). Scores among novice surgeons were more diverse (coefficient of variation = 12.4). CONCLUSIONS: Predictive validation of the placenta brain aneurysm model has been previously reported, but the SAMBA scale adds an objective scoring system to verify microsurgical ability in this complex operation, stratifying proficiency by points. The SAMBA scale can be used as an interface between learning and practicing, as it can be applied in a safe and controlled environment, such as is provided by a placenta model, with similar results obtained in real surgery, predicting real surgical performance.