Three mathematical software types: black-box (no steps shown), glass-box (steps shown) and open-box (interactive steps) were used by 32 students to solve conceptual and procedural tasks on the computer via remote observation. Comparison of the three software types suggests that there is no difference in the scores that students receive for conceptual understanding tasks. Students using the black-box are more likely to explore answers than students using the glass and open-box software