There is sometimes more demand for the attention of healthcare providers than there is supply to go around. This study evaluates a way to make expert mental health social workers more efficient at the task of moderating controlled access social network discussion boards. Sometimes, moderators need to make authoritative posts on these boards known as interventions. These are useful when needed but unnecessary interventions may degrade the benefits of organic discussion. For this study an automated decision aiding system (ADAS) tool was developed which provided the automated analysis and visualization of messages and message sentiment. This tool was designed as a means to make the expert moderators more efficient so more individuals could utilize a discussion board without proportional increase in expert moderators and the associated expense. This study determined that the custom designed automated decision-aiding system had no significant effect on participants determining if messages from such a discussion board are deserving of an intervention response for the measures of accuracy, elapsed time, or judgement confidence. The abstraction of context provided by the ADAS in this study is suspected to explain the lack of significant results, and future work would focus on identifying the level of context supply humans would require for the ADAS to have an effect
