Teacher-Student Architecture for Knowledge Distillation: A Survey

Although Deep neural networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs are hard to be deployed in real-world systems due to their voluminous parameters. To tackle this issue, Teacher-Student architectures were proposed, where simple student networks with a few parameters can achieve comparable performance to deep teacher networks with many parameters. Recently, Teacher-Student architectures have been effectively and widely embraced on various knowledge distillation (KD) objectives, including knowledge compression, knowledge expansion, knowledge adaptation, and knowledge enhancement. With the help of Teacher-Student architectures, current studies are able to achieve multiple distillation objectives through lightweight and generalized student networks. Different from existing KD surveys that primarily focus on knowledge compression, this survey first explores Teacher-Student architectures across multiple distillation objectives. This survey presents an introduction to various knowledge representations and their corresponding optimization objectives. Additionally, we provide a systematic overview of Teacher-Student architectures with representative learning algorithms and effective distillation schemes. This survey also summarizes recent applications of Teacher-Student architectures across multiple purposes, including classification, recognition, generation, ranking, and regression. Lastly, potential research directions in KD are investigated, focusing on architecture design, knowledge quality, and theoretical studies of regression-based learning, respectively. Through this comprehensive survey, industry practitioners and the academic community can gain valuable insights and guidelines for effectively designing, learning, and applying Teacher-Student architectures on various distillation objectives.Comment: 20 pages. arXiv admin note: substantial text overlap with arXiv:2210.1733

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

T-Spherical Fuzzy Rough Interactive Power Heronian Mean Aggregation Operators for Multiple Attribute Group Decision-Making

In this article, to synthesize the merits of interaction operational laws (IOLs), rough numbers (RNs), power average (PA) and Heronian mean (HM), a new notion of T-spherical fuzzy rough numbers (T-SFRNs) is first introduced to describe the intention of group experts accurately and take the interaction between individual experts into account with complete and symmetric information. The distance measure and ordering rules of T-SFRNs are proposed, and the IOLs of T-SFRNs are extended. Next, the PA and HM are combined based on the IOLs of T-SFRNs, and the T-Spherical fuzzy rough interaction power Heronian mean operator and its weighted form are proposed. These aggregation operators can accurately express both individual and group uncertainty using T-SFRNs, capture the interaction among membership degree, abstinence degree and non-membership degree of T-SFRNs by employing IOLs, ensure the overall balance of variable values by the PA in the process of information fusion, and realize the interrelationship between attribute variables by the HM. Several properties and special cases of these aggregation operators are further presented and discussed. Subsequently, a new approach for dealing with T-spherical fuzzy multiple attribute group decision-making problems based on proposed aggregation operator is developed. Lastly, in order to validate the feasibility and reasonableness of the proposed approach, a numerical example is presented, and the superiorities of the proposed method are illustrated by describing a sensitivity analysis and a comparative analysis

Sustainable Circular Supplier Selection in the Power Battery Industry Using a Linguistic T-Spherical Fuzzy MAGDM Model Based on the Improved ARAS Method

In the power battery industry, the selection of an appropriate sustainable recycling supplier (SCS) is a significant topic in circular supply chain management. Evaluating and selecting a SCS for spent power batteries is considered a complex multi-attribute group decision-making (MAGDM) problem closely related to the environment, economy, and society. The linguistic T-spherical fuzzy (Lt-SF) set (Lt-SFS) is a combination of a linguistic term set and a T-spherical fuzzy set (T-SFS), which can accurately describe vague cognition of human and uncertain environments. Therefore, this article proposes a group decision-making methodology for a SCS selection based on the improved additive ratio assessment (ARAS) in the Lt-SFS context. This paper extends the Lt-SF generalized distance measure and defines the Lt-SF similarity measure. The Lt-SF Heronian mean (Lt-SFHM) operator and its weighted form (i.e., Lt-SFWHM) were developed. Subsequently, a new Lt-SF MAGDM model was constructed by integrating the LT-SFWHM operator, generalized distance measure, and ARAS method. In it, the expert weight on the attribute was determined based on the similarity measure, using the generalized distance measure to obtain the objective attribute weight and then the combined attribute weight. Finally, a real case of SCS selection in the power battery industry is presented for demonstration. The effectiveness and practicability of this method were verified through a sensitivity analysis and a comparative study with the existing methods

T-spherical uncertain linguistic MARCOS method based on generalized distance and Heronian mean for multi-attribute group decision-making with unknown weight information

Abstract The T-spherical uncertain linguistic (TSUL) sets (TSULSs) integrated by T-spherical fuzzy sets and uncertain linguistic variables are introduced in this article. This new concept is not only a generalized form but also can integrate decision-makers’ quantitative evaluation ideas and qualitative evaluation information. The TSULSs serve as a reliable and comprehensive tool for describing complex and uncertain decision information. This paper focuses on an extended MARCOS (Measurement of Alternatives and Ranking according to the Compromise Solution) method to handle the TSUL multi-attribute group decision-making problems where the weight information is completely unknown. First, we define, respectively, the operation rules and generalized distance measure of T-spherical uncertain linguistic numbers (TSULNs). Then, we develop two kinds of aggregation operators of TSULNs, one kind of operator with independent attributes is T-spherical uncertain linguistic weighted averaging and geometric (TSULWA and TSULWG) operators, and the other is T-spherical uncertain linguistic Heronian mean aggregation operators (TSULHM and TSULWHM) considering attributes interrelationship. Their related properties are discussed and a series of reduced forms are presented. Subsequently, a new TSUL-MARCOS-based multi-attribute group decision-making model combining the proposed aggregation operators and generalized distance is constructed. Finally, a real case of investment decision for a community group-buying platform is presented for illustration. We further test the rationality and superiorities of the proposed method through sensitivity analysis and comparative study

Waste Clothing Recycling Channel Selection Using a CoCoSo-D Method Based on Sine Trigonometric Interaction Operational Laws with Pythagorean Fuzzy Information

Under the influence of circular economy theory, waste clothing recycling has been widely studied in the resource sector, and the waste clothing recycling channel (WCRC) is the vital link that affects the recycling efficiency of waste clothing. How to select the optimal WCRC is considered a typical multiple attribute group decision-making (MAGDM) problem. In this article, we develop sine trigonometric interaction operational laws (IOLs) (STIOLs) using Pythagorean fuzzy information. The sine trigonometric interaction Pythagorean fuzzy weighted averaging (STI-PyFWA) and sine trigonometric interaction Pythagorean fuzzy weighted geometric (STI-PyFWG) operators are advanced, and their several desirable properties are discussed. Further, we build a MAGDM framework based on the modified Pythagorean fuzzy CoCoSo (Combined Compromise Solution) method to solve the WCRC selection problem. The combined weight of attributes is determined, and the proposed aggregation operators (AOs) are applied to the CoCoSo method. A Pythagorean fuzzy distance measure is used to achieve the defuzzification of aggregation strategies. Finally, we deal with the WCRC selection problem for a sustainable environment by implementing the proposed method and performing sensitivity analysis and comparative study to validate its effectiveness and superiority

Waste Clothing Recycling Channel Selection Using a CoCoSo-D Method Based on Sine Trigonometric Interaction Operational Laws with Pythagorean Fuzzy Information

Under the influence of circular economy theory, waste clothing recycling has been widely studied in the resource sector, and the waste clothing recycling channel (WCRC) is the vital link that affects the recycling efficiency of waste clothing. How to select the optimal WCRC is considered a typical multiple attribute group decision-making (MAGDM) problem. In this article, we develop sine trigonometric interaction operational laws (IOLs) (STIOLs) using Pythagorean fuzzy information. The sine trigonometric interaction Pythagorean fuzzy weighted averaging (STI-PyFWA) and sine trigonometric interaction Pythagorean fuzzy weighted geometric (STI-PyFWG) operators are advanced, and their several desirable properties are discussed. Further, we build a MAGDM framework based on the modified Pythagorean fuzzy CoCoSo (Combined Compromise Solution) method to solve the WCRC selection problem. The combined weight of attributes is determined, and the proposed aggregation operators (AOs) are applied to the CoCoSo method. A Pythagorean fuzzy distance measure is used to achieve the defuzzification of aggregation strategies. Finally, we deal with the WCRC selection problem for a sustainable environment by implementing the proposed method and performing sensitivity analysis and comparative study to validate its effectiveness and superiority

Innovative Evolution Process Model of Product Platform Based on Evolutionary Design

Conference Name:2nd International Conference on Manufacturing Science and Engineering. Conference Address: Guilin, PEOPLES R CHINA. Time:APR 09-11, 2011.In order to grasp the direction of product upgrading and promote the innovation capability of enterprise, a model of innovative evolution process for Product Platform is proposed based on Evolutionary Design. The model consists of five parts. The product platform module genes expression is an important part of this model, the acquisition and operation of genes was highlighted during its evolution process. Finally, a sample was given expressing the method as mentioned before

Cost Estimation Model of Modular Product Family

Conference Name:International Conference on Engineering Design and Optimization (ICEDO 2010). Conference Address: Ningo, PEOPLES R CHINA. Time:OCT 28-30, 2010.For the more effective cost management and control of product platform, on the basis of modular product family (MPF) realization process and the cost of product family, the cost estimation model of modular product family was proposed. The manufacturing and management cost of component part level, module level and product level was estimated, and summed up to the cost of product family. Finally, a case of wheeling loader product family was illustrated to demonstrate the validity of the model

Analysis Method for Commonality of Module and Part in Modular Product Family

Conference Name:2nd International Conference on Manufacturing Science and Engineering. Conference Address: Guilin, PEOPLES R CHINA. Time:APR 09-11, 2011.An analysis method for commonality of module & part in modular product family was put forward. The part and module commonality in module layer and component part layer of product family were identified, respectively. The formulations of the two commonalities take into account amount of component part or module, variety, volume, price/cost of the part or module, size, geometry, material, manufacturing process, assembly. According to the source of parts, the mathematical formulas of self-made parts and purchased parts were set up respectively in the component part layer. Finally, an example of drive axle of wheel loader was given to indicate the effectiveness of the proposed method