This paper describes an AFOSR-supported basic research program that focuses on developing a new framework for combining hard with soft data in order to improve space situational awareness. The goal is to provide, in an automatic and near real-time fashion, a ranking of possible threats to blue assets (assets trying to be protected) from red assets (assets with hostile intentions). The approach is based on Conceptual Spaces models, which combine features from traditional associative and symbolic cognitive models. While Conceptual Spaces are revolutionary, they lack an underlying mathematical framework. Several such frameworks have attempted to represent Conceptual Spaces, but by far the most robust is the model developed by Holender. His model utilizes integer linear programming in order to obtain an overall similarity value between observations and concepts that support the formation of hypotheses. This paper will describe a method for building Conceptual Spaces models for threats that utilizes ontologies as a means to provide a clear semantic foundation for this inferencing process; in particular threat ontologies and space domain ontologies are developed and employed in this approach. A space situational awareness use-case is presented involving a kinetic kill scenario and results are shown to assess the performance of this fusion-based inferencing framework