Enhancing geographical information systems capabilities with multi-criteria evaluation functions

ou

An Overview of Multi-Attribute Decision Making (MADM) Vertical Handover Using Systematic Mapping

The evolution of infotainment industries yet the advancement of cellular gadgets such as smartphones, tablets, and laptop had increased the request on cellular traffic demands. As a result, a Heterogeneous Wireless Network (HWN) has been introduced to fulfil users requests in having seamless mobility and better Quality of Services (QoS) for the users. A lot of research works have been done in order to provide a seamless connection to the users. Even though a lot of methods have been proposed, a Multi-Attribute Decision Making (MADM) has been seemed like a promising way due to its ability to evaluate many attributes simultaneously. Previously, many reviews based on MADM methods in a Heterogeneous Wireless Network provides a details review which required researchers time in order to determine the possible potential areas to be explored. Therefore, in this study, we present an overview of the MADM method in performing vertical handover via a systematic mapping method. This will enable future researchers to identify the trends and research opportunities within this area. This mapping study analysed 30 papers. Results from the study show eight main potential research issues can be explored by researchers, including normalisation, criteria weighting, ranking abnormality, network selection, and performance comparison between MADM algorithms, network selection for a group of calls, mobility patterns and handover triggering

Context-aware multi-attribute decision multi - attribute decision making for radio access technology selection in ultra dense network

Ultra Dense Network (UDN) is the extreme densification of heterogeneous Radio Access Technology (RAT) that is deployed closely in coordinated or uncoordinated manner. The densification of RAT forms an overlapping zone of signal coverage leading to the frequent service handovers among the RAT, thus degrading overall system performance. The current RAT selection approach is biased towards network-centric criteria pertaining to signal strength. However, the paradigm shift from network-centric to user-centric approach necessitates a multi-criteria selection process, with methodology relating to both network and user preferences in the context of future generation networks. Hence, an effective selection approach is required to avoid unnecessary handovers in RAT. The main aim of this study is to propose the Context-aware Multiattribute decision making for RAT (CMRAT) selection for investigating the need to choose a new RAT and further determine the best amongst the available methods. The CMRAT consists of two mechanisms, namely the Context-aware Analytical Hierarchy Process (CAHP) and Context-aware Technique for Order Preference by Similarity to an Ideal Solution (CTOPSIS). The CAHP mechanism measures the need to switch from the current RAT, while CTOPSIS aids in decision making to choose the best target RAT. A series of experimental studies were conducted to validate the effectiveness of CMRAT for achieving improved system performance. The investigation utilises shopping mall and urban dense network scenarios to evaluate the performance of RAT selection through simulation. The findings demonstrated that the CMRAT approach reduces delay and the number of handovers leading to an improvement of throughput and packet delivery ratio when compared to that of the commonly used A2A4-RSRQ approach. The CMRAT approach is effective in the RAT selection within UDN environment, thus supporting heterogeneous RAT deployment in future 5G networks. With context-aware selection, the user-centric feature is also emphasized

Conceptual design of fuzzy TOPSIS DSS for building information modeling (BIM)

Building Information Modeling (BIM) is playing a significant role in the development of Construction industry.Evaluation of BIM software selection is one of the key roles in successfully BIM adoption.Currently, there is limited study on BIM software selection. With a great potential for integration of MADM and the current Web 2.0 technology, the development of Web DSS based on TOPSIS is desired to solve this problem. In order to develop an effective DSS, the development of subsystem which is TOPSIS would be integrated with fuzzy element.The proposed of this integration is to deal with the vagueness of decision makers in order to evaluate and rating the software and attributes of BIM software selection.Inteads of use crips value, the decision maker will asked to weight and rating through linguistics.For example Very Low (VL), Low (L), Medium Low (ML), Medium (M), Medium High (MH), High (H) and Very High (VH) will used for wighting asessement in BIM software selection.In order to demostrade this proposed DSS, a real construction project which UTHM Multipurpose hall will be deploy

Decision support system for building information modeling (BIM) software selection: A case study in construction feasibility stage

The adoption of Building Information Modelling (BIM) software has proven to be beneficial to the construction industry to improve the design, analysis, construction, operation and data management. Due to the variety of BIM software on the market, choosing the right BIM software in construction projects is deemed to be a complicated decision making process. Previous studies revealed that software selection is mainly made based on popularity and recommendation from other companies. Consequently, inaccurate selection would lead to the underutilised features and negative effect the investment on the BIM software. Based on literature, there is a lack of systematic approach to select the right BIM software for specific project requirements. This highlights the needs for decision making tools to select the appropriate BIM software. This research aims to develop a Decision Support System (DSS) named topsis4BIM which integrates graphical user interfaces, BIM features database, Fuzzy TOPSIS and Web 2.0 tools. A real construction project was used as a case study for demonstrating and validating the DSS framework. The findings indicate that the use of topsis4BIM improves the BIM software selection process compared to the current practice. In addition, it also produce a new framework for the next generation DSS using Web 2.0 tools. The study introduces an innovative and economical decision making approach that can guide construction practitioners towards the betterment of BIM adoption

Supplier evaluation and selection in fuzzy environments: a review of MADM approaches

In past years, the multi-attribute decision-making (MADM) approaches have been extensively applied by researchers to the supplier evaluation and selection problem. Many of these studies were performed in an uncertain environment described by fuzzy sets. This study provides a review of applications of MADM approaches for evaluation and selection of suppliers in a fuzzy environment. To this aim, a total of 339 publications were examined, including papers in peer-reviewed journals and reputable conferences and also some book chapters over the period of 2001 to 2016. These publications were extracted from many online databases and classified in some categories and subcategories according to the MADM approaches, and then they were analysed based on the frequency of approaches, number of citations, year of publication, country of origin and publishing journals. The results of this study show that the AHP and TOPSIS methods are the most popular approaches. Moreover, China and Taiwan are the top countries in terms of number of publications and number of citations, respectively. The top three journals with highest number of publications were: Expert Systems with Applications, International Journal of Production Research and The International Journal of Advanced Manufacturing Technology

Optimisation et évaluation des performances des communications mobiles dans un environnement réseaux multi-accès

The next generation of networks represents a heterogeneous wireless environement,characterized by the coexistence of multiple technologies. In this environement, the users havethe privilege to stay connected to the Internet by using mobile terminals equiped with multipleinterfaces. Additionaly, the users have the ability to use different services at any time andany where. In this context, the most important aim is to manage the terminal mobility whileensuring the best continuity of services. In order to acheive this task, the design and the de-veloppement of architecture for the vertical handover management becomes an indispensable.This is focusing on vertical handover management and mainly on network selection decisionstep within heterogeneous wireless networks. In this context, our first contribution proposes anew architecture for network selection, based on multi attribut decision making (MADM). Thissolution is based on the IEEE 802.21 standard, contains two modules : the first one is usedto weigh the criteria. While the second is applied to rank the networks. Then, we consider theproblem of optimizing the weighiting algorithms of our architecture. Specifically, we first developpe a new validation approach which can take into account different weighting methods. Our approach is based on group MADM and it allows to determine a suitable weighting algorithmwhich can be used for the network selection. We then improve our architecture by introducingcomponent based on differentiated weight which can be integrated into wieghting module ofour architecture. This component allows to find the differentiate weights of available networksby considering each criterion. Finally, due to the variety of vertical handoff algorithms, we pro-vide a new evaluation model to reach an optimal network selection algorithm and to validateour architecture. This new model is based on multi attribut decision making and criticalityanalysis.Les réseaux de la future génération représentent un environnement hétérogène sans fil,dans lequel de nombreuses technologies d’accès peuvent cohabiter. Au sein de cet environne-ment, les utilisateurs ont le privilège de rester connectés à l’Internet à travers des terminauxmulti-interfaces. De plus, ils ont la possibilité de se doter de différents services, peu importele lieu et le temps. Afin de gérer la mobilité du terminal tout en assurant une meilleure conti-nuité de service, la mise en oeuvre d’une architecture pour la gestion du handover vertical estdevenue indispensable. Cette thèse se focalise sur le handover vertical, plus précisément sur laphase de la sélection du réseau dans un environnement de réseaux hétérogènes sans fil. Dansce contexte, notre première contribution propose une nouvelle architecture pour la sélectiondu réseau reposant sur les méthodes d’aide à la décision multi-attributs (MADM). Cette solu-tion, simple à intégrer dans la norme IEEE 802.21, comporte deux modules : le premier pourpondérer les critères et le deuxième pour classer les réseaux. Ensuite, nous nous intéressonsà la résolution de différents problèmes relatifs à la pondération des critères afin d’améliorerdavantage notre architecture. Pour ce faire, nous avons développé dans un premier temps, unenouvelle approche de la validation des algorithmes du handover en utilisant la théorie de laprise de décision collective. Cette nouvelle approche nous a permis d’identifier l’algorithme depondération qu’il faut intégrer dans notre architecture. Dans un deuxième temps, nous avonsintégré une nouvelle unité de différenciation de poids au niveau du module de pondérationde notre architecture. Le rôle de cette unité est de calculer le degré d’importance relatif àchaque critère en fonction de l’interface réseau. Finalement, nous proposons un nouveau mo-dèle d’évaluation de performances qui repose sur l’approche MADM et l’analyse de criticité.L’efficacité de ce modèle se manifeste dans sa capacité de valider notre architecture en termesde performances par rapport aux autres algorithmes existants. De plus, son second avantageest le fait de pallier le problème du choix de critères qu’il faut utiliser dans le contexte de lasélection du réseau

TOPSIS-RTCID for range target-based criteria and interval data

[EN] The Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) is receiving considerable attention as an essential decision analysis technique and becoming a leading method. This paper describes a new version of TOPSIS with interval data and capability to deal with all types of criteria. An improved structure of the TOPSIS is presented to deal with high uncertainty in engineering and engineering decision-making. The proposed Range Target-based Criteria and Interval Data model of TOPSIS (TOPSIS-RTCID) achieves the core contribution in decision making theories through a distinct normalization formula for cost and benefits criteria in scale of point and range target-based values. It is important to notice a very interesting property of the proposed normalization formula being opposite to the usual one. This property can explain why the rank reversal problem is limited. The applicability of the proposed TOPSIS-RTCID method is examined with several empirical litreture’s examples with comparisons, sensitivity analysis, and simulation. The authors have developed a new tool with more efficient, reliable and robust outcomes compared to that from other available tools. The complexity of an engineering design decision problem can be resolved through the development of a well-structured decision making method with multiple attributes. Various decision approches developed for engineering design have neglected elements that should have been taken into account. Through this study, engineering design problems can be resolved with greater reliability and confidence.Jahan, A.; Yazdani, M.; Edwards, K. (2021). TOPSIS-RTCID for range target-based criteria and interval data. International Journal of Production Management and Engineering. 9(1):1-14. https://doi.org/10.4995/ijpme.2021.13323OJS11491Ahn, B.S. (2017). The analytic hierarchy process with interval preference statements. Omega, 67, 177-185. https://doi.org/10.1016/j.omega.2016.05.004Alemi-Ardakani, M., Milani, A.S., Yannacopoulos, S., Shokouhi, G. (2016). On the effect of subjective, objective and combinative weighting in multiple criteria decision making: A case study on impact optimization of composites. Expert Systems With Applications, 46, 426-438. https://doi.org/10.1016/j.eswa.2015.11.003Amiri, M., Nosratian, N.E., Jamshidi, A., Kazemi, A. (2008). Developing a new ELECTRE method with interval data in multiple attribute decision making problems. Journal of Applied Sciences, 8, 4017-4028. https://doi.org/10.3923/jas.2008.4017.4028Bahraminasab, M., Jahan, A. (2011). Material selection for femoral component of total knee replacement using comprehensive VIKOR. Materials & Design, 32, 4471-4477. https://doi.org/10.1016/j.matdes.2011.03.046Baradaran, V., Azarnia, S. (2013). An Approach to Test Consistency and Generate Weights from Grey Pairwise Matrices in Grey Analytical Hierarchy Process. Journal of Grey System, 25.Behzadian, M., Otaghsara, S.K., Yazdani, M., Ignatius, J. (2012). A state-of the-art survey of TOPSIS applications. Expert Systems with Applications, 39, 13051-13069. https://doi.org/10.1016/j.eswa.2012.05.056Cables, E., Lamata, M.T., Verdegay, J.L. (2018). FRIM-Fuzzy Reference Ideal Method in Multicriteria Decision Making. In Collan, M. & Kacprzyk, J. (Eds.) Soft Computing Applications for Group Decision-making and Consensus Modeling. Cham, Springer International Publishing. https://doi.org/10.1007/978-3-319-60207-3_19Çakır, S. (2016). An integrated approach to machine selection problem using fuzzy SMART-fuzzy weighted axiomatic design. Journal of Intelligent Manufacturing, 1-13. https://doi.org/10.1007/s10845-015-1189-3Celen, A. (2014). Comparative analysis of normalization procedures in TOPSIS method: with an application to Turkish deposit banking market. Informatica, 25, 185-208. https://doi.org/10.15388/Informatica.2014.10Celik, E., Erdogan, M., Gumus, A. (2016). An extended fuzzy TOPSIS-GRA method based on different separation measures for green logistics service provider selection. International Journal of Environmental Science and Technology, 13, 1377-1392. https://doi.org/10.1007/s13762-016-0977-4Dymova, L., Sevastjanov, P., Tikhonenko, A. (2013). A direct interval extension of TOPSIS method. Expert Systems With Applications, 40, 4841-4847. https://doi.org/10.1016/j.eswa.2013.02.022Garca-Cascales, M.S., Lamata, M.T. (2012). On rank reversal and TOPSIS method. Mathematical and Computer Modelling, 56, 123-132. https://doi.org/10.1016/j.mcm.2011.12.022Hafezalkotob, A., Hafezalkotob, A. (2015). Comprehensive MULTIMOORA method with target-based attributes and integrated significant coefficients for materials selection in biomedical applications. Materials & Design, 87, 949-959. https://doi.org/10.1016/j.matdes.2015.08.087Hafezalkotob, A., Hafezalkotob, A. (2016). Interval MULTIMOORA method with target values of attributes based on interval distance and preference degree: biomaterials selection. Journal of Industrial Engineering International, 13, 181-198. https://doi.org/10.1007/s40092-016-0176-4Hafezalkotob, A., Hafezalkotob, A. (2017). Interval target-based VIKOR method supported on interval distance and preference degree for machine selection. Engineering Applications of Artificial Intelligence, 57, 184-196. https://doi.org/10.1016/j.engappai.2016.10.018Hafezalkotob, A., Hafezalkotob, A., Sayadi, M.K. (2016). Extension of MULTIMOORA method with interval numbers: An application in materials selection. Applied Mathematical Modelling, 40, 1372-1386. https://doi.org/10.1016/j.apm.2015.07.019Hajiagha, S.H.R., Hashemi, S.S., Zavadskas, E.K., Akrami, H. (2012). Extensions of LINMAP model for multi criteria decision making with grey numbers. Technological and Economic Development of Economy, 18, 636-650. https://doi.org/10.3846/20294913.2012.740518Hazelrigg, G.A. (2003). Validation of engineering design alternative selection methods. Engineering Optimization, 35, 103-120. https://doi.org/10.1080/0305215031000097059Hu, J., Du, Y., Mo, H., Wei, D., Deng, Y. (2016). A modified weighted TOPSIS to identify influential nodes in complex networks. Physica A: Statistical Mechanics and its Applications, 444, 73-85. https://doi.org/10.1016/j.physa.2015.09.028Huang, Y., Jiang, W. (2018). Extension of TOPSIS Method and its Application in Investment. Arabian Journal for Science and Engineering, 43, 693-705. https://doi.org/10.1007/s13369-017-2736-3Jahan, A. (2018). Developing WASPAS-RTB method for range target-based criteria: toward selection for robust design. Technological and Economic Development of Economy, 24, 1362-1387. https://doi.org/10.3846/20294913.2017.1295288Jahan, A., Bahraminasab, M., Edwards, K.L. (2012). A target-based normalization technique for materials selection. Materials & Design, 35, 647-654. https://doi.org/10.1016/j.matdes.2011.09.005Jahan, A., Edwards, K.L. (2013). VIKOR method for material selection problems with interval numbers and target-based criteria. Materials & Design, 47, 759-765. https://doi.org/10.1016/j.matdes.2012.12.072Jahan, A., Edwards, K.L. (2015). A state-of-the-art survey on the influence of normalization techniques in ranking: Improving the materials selection process in engineering design. Materials & Design, 65, 335-342. https://doi.org/10.1016/j.matdes.2014.09.022Jahan, A., Edwards, K.L., Bahraminasab, M. (2016). Multi-criteria decision analysis for supporting the selection of engineering materials in product design, Oxford, Butterworth-Heinemann.Jahan, A., Mustapha, F., Ismail, M.Y., Sapuan, S.M., Bahraminasab, M. (2011). A comprehensive VIKOR method for material selection. Materials & Design, 32, 1215-1221. https://doi.org/10.1016/j.matdes.2010.10.015Jahan, A., Zavadskas, E.K. (2018). ELECTRE-IDAT for design decision-making problems with interval data and target-based criteria. Soft Computing, 23, 129-143. https://doi.org/10.1007/s00500-018-3501-6Jahanshahloo, G.R., Hosseinzadeh Lotfi, F., Davoodi, A.R. (2009). Extension of TOPSIS for decision-making problems with interval data: Interval efficiency. Mathematical and Computer Modelling, 49, 1137-1142. https://doi.org/10.1016/j.mcm.2008.07.009Jahanshahloo, G.R., Lotfi, F.H., Izadikhah, M. (2006). An algorithmic method to extend TOPSIS for decision-making problems with interval data. Applied Mathematics and Computation, 175, 1375-1384. https://doi.org/10.1016/j.amc.2005.08.048Kasirian, M., Yusuff, R. (2013). An integration of a hybrid modified TOPSIS with a PGP model for the supplier selection with interdependent criteria. International Journal of Production Research, 51, 1037-1054. https://doi.org/10.1080/00207543.2012.663107Kuo, T. (2017). A modified TOPSIS with a different ranking index. European Journal of Operational Research, 260, 152-160. https://doi.org/10.1016/j.ejor.2016.11.052Liang, D., Xu, Z. (2017). The new extension of TOPSIS method for multiple criteria decision making with hesitant Pythagorean fuzzy sets. Applied Soft Computing, 60, 167-179. https://doi.org/10.1016/j.asoc.2017.06.034Liao, H., Wu, X. (2019). DNMA: A double normalization-based multiple aggregation method for multi-expert multi-criteria decision making. Omega, 94. 102058. https://doi.org/10.1016/j.omega.2019.04.001Liu, H.C., You, J.X., Zhen, L., Fan, X.J. (2014). A novel hybrid multiple criteria decision making model for material selection with targetbased criteria. Materials & Design, 60, 380-390. https://doi.org/10.1016/j.matdes.2014.03.071Maghsoodi, A.I., Maghsoodi, A.I., Poursoltan, P., Antucheviciene, J., Turskis, Z. (2019). Dam construction material selection by implementing the integrated SWARA-CODAS approach with target-based attributes. Archives of Civil and Mechanical Engineering, 19, 1194-1210. https://doi.org/10.1016/j.acme.2019.06.010Milani, A.S., Shanian, A., Madoliat, R., Nemes, J.A. (2005). The effect of normalization norms in multiple attribute decision making models: a case study in gear material selection. Structural and Multidisciplinary Optimization, 29, 312-318. https://doi.org/10.1007/s00158-004-0473-1Peldschus, F. (2009). The analysis of the quality of the results obtained with the methods of multi-criteria decisions. Technological and Economic Development of Economy, 15, 580-592. https://doi.org/10.3846/1392-8619.2009.15.580-592Peldschus, F. (2018). Recent findings from numerical analysis in multi-criteria decision making. Technological and Economic Development of Economy, 24, 1695-1717. https://doi.org/10.3846/20294913.2017.1356761Perez, E.C., Lamata, M., Verdegay, J. (2016). RIM-Reference Ideal Method in Multicriteria Decision Making. Information Sciences, 337- 338, 1-10. https://doi.org/10.1016/j.ins.2015.12.011Sayadi, M.K., Heydari, M., Shahanaghi, K. (2009). Extension of VIKOR method for decision making problem with interval numbers. Applied Mathematical Modelling, 33, 2257-2262. https://doi.org/10.1016/j.apm.2008.06.002Sen, P., Yang, J.B. (1998). MCDM and the Nature of Decision Making in Design, Springer. https://doi.org/10.1007/978-1-4471-3020-8_2Sevastianov, P. (2007). Numerical methods for interval and fuzzy number comparison based on the probabilistic approach and Dempster- Shafer theory. Information Sciences, 177, 4645-4661. https://doi.org/10.1016/j.ins.2007.05.001Shanian, A., Savadogo, O. (2009). A methodological concept for material selection of highly sensitive components based on multiple criteria decision analysis. Expert Systems With Applications, 36, 1362-1370. https://doi.org/10.1016/j.eswa.2007.11.052Shen, F., Ma, X., Li, Z., Xu, Z., Cai, D. (2018). An extended intuitionistic fuzzy TOPSIS method based on a new distance measure with an application to credit risk evaluation. Information Sciences, 428, 105-119. https://doi.org/10.1016/j.ins.2017.10.045Shishank, S., Dekkers, R. (2013). Outsourcing: decision-making methods and criteria during design and engineering. Production Planning & Control, 24, 318-336. https://doi.org/10.1080/09537287.2011.648544Shouzhen, Z., Yao, X. (2018). A method based on TOPSIS and distance measures for hesitant fuzzy multiple attribute decision making. Technological and Economic Development of Economy, 24, 969-983. https://doi.org/10.3846/20294913.2016.1216472Stanujkic, D., Magdalinovic, N., Jovanovic, R., Stojanovic, S. (2012). An objective multi-criteria approach to optimization using MOORA method and interval grey numbers. Technological and Economic Development of Economy, 18, 331-363. https://doi.org/10.3846/20294913.2012.676996Suder, A., Kahraman, C. (2018). Multiattribute evaluation of organic and inorganic agricultural food investments using fuzzy TOPSIS. Technological and Economic Development of Economy, 24, 844-858. https://doi.org/10.3846/20294913.2016.1216905Tilstra, A.H., Backlund, P.B., Seepersad, C.C., Wood, K.L. (2015). Principles for designing products with flexibility for future evolution. International Journal of Mass Customisation, 5, 22-54. https://doi.org/10.1504/IJMASSC.2015.069597Tsaur, R.C. (2011) Decision risk analysis for an interval TOPSIS method. Applied Mathematics and Computation, 218, 4295-4304. https://doi.org/10.1016/j.amc.2011.10.001Turskis, Z., Zavadskas, E.K. (2010) A novel method for multiple criteria analysis: grey additive ratio assessment (ARAS-G) method. Informatica, 21, 597-610. https://doi.org/10.15388/Informatica.2010.307Wang, Y.M., Luo, Y. (2009) On rank reversal in decision analysis. Mathematical and Computer Modelling, 49, 1221-1229. https://doi.org/10.1016/j.mcm.2008.06.019Ye, J. (2015) An extended TOPSIS method for multiple attribute group decision making based on single valued neutrosophic linguistic numbers. Journal of Intelligent & Fuzzy Systems, 28, 247-255. https://doi.org/10.3233/IFS-141295Yue, Z. (2013) Group decision making with multi-attribute interval data. Information Fusion, 14, 551-561. https://doi.org/10.1016/j.inffus.2013.01.00

Architecture value mapping: using fuzzy cognitive maps as a reasoning mechanism for multi-criteria conceptual design evaluation

The conceptual design phase is the most critical phase in the systems engineering life cycle. The design concept chosen during this phase determines the structure and behavior of the system, and consequently, its ability to fulfill its intended function. A good conceptual design is the first step in the development of a successful artifact. However, decision-making during conceptual design is inherently challenging and often unreliable. The conceptual design phase is marked by an ambiguous and imprecise set of requirements, and ill-defined system boundaries. A lack of usable data for design evaluation makes the problem worse. In order to assess a system accurately, it is necessary to capture the relationships between its physical attributes and the stakeholders\u27 value objectives. This research presents a novel conceptual architecture evaluation approach that utilizes attribute-value networks, designated as \u27Architecture Value Maps\u27, to replicate the decision makers\u27 cogitative processes. Ambiguity in the system\u27s overall objectives is reduced hierarchically to reveal a network of criteria that range from the abstract value measures to the design-specific performance measures. A symbolic representation scheme, the 2-Tuple Linguistic Representation is used to integrate different types of information into a common computational format, and Fuzzy Cognitive Maps are utilized as the reasoning engine to quantitatively evaluate potential design concepts. A Linguistic Ordered Weighted Average aggregation operator is used to rank the final alternatives based on the decision makers\u27 risk preferences. The proposed methodology provides systems architects with the capability to exploit the interrelationships between a system\u27s design attributes and the value that stakeholders associate with these attributes, in order to design robust, flexible, and affordable systems --Abstract, page iii