Testing in relevant environments is key to exploration mission hardware development. This is true on both the component level (in early development) and system level (in late development stages). During ISRU missions the hardware will interface with the soil (digging, roving, etc) in a vacuum environment. A relevant test environment will therefore involve a vacuum chamber with a controlled, conditioned simulant bed. However, in earth-based granular media, such as lunar soil simulant, gases trapped within the material pore structures and water adsorbed to all particle surfaces will release when exposed to vacuum. Early vacuum testing has shown that this gas release can occur violently, which loosens and weakens the simulant, altering the consolidation state. The Vacuum Facility #13, a mid-size chamber (3.66m tall, 1.5m inner diameter) at the NASA Glenn Research Center has been modified to create a soil mechanics test facility. A 0.64m deep by 0.914m square metric ton bed of lunar simulant was placed under vacuum using a variety of pumping techniques. Both GRC-3 and LHT-3M simulant types have been used. An electric cone penetrometer was used to measure simulant strength properties at vacuum including: cohesion, friction angle, bulk density and shear modulus. Simulant disruptions, caused by off gassing, affected the strength properties, but could be mitigated by reducing pump rate. No disruptions were observed at pressures below 2.5Torr, regardless of the pump rate. However, slow off gassing of the soil lead to long test times, a full week, to reach 10-5Torr. This work highlights the need for robotic machine-simulant hardware and operations in vacuum to expeditiously perform (sub-)systems tests