In the past, remote user testing has offered promising results when compared to its local counterpart. Nonetheless, the comparison studies conducted insofar have relied on small independent samples, measuring key metrics and have not focused on the qualitative objectives of user testing. The current study addresses these issues in order to reinforce the efficiency of the remote method in the key metrics but to also examine its ability to reveal qualitative data. Mainly, our data suggests that remote user testing requires more time to complete, remote users adhere more strictly to the think aloud protocol application and online post-test questionnaires yield higher quantity and quality responses. In addition to attaining the previous two objectives, our analysis also accounts for the effect of website difficulty during user testing. Our results indicate that remote and local user testing yield similar results during the assessment of an easy or difficult website.