Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by identifying and removing redundant training samples without sacrificing performance. In this work, we aim to address the problem of DP for transfer learning, i.e., how to prune a source dataset for improved pretraining efficiency and lossless finetuning accuracy on downstream target tasks. To our best knowledge, the problem of DP for transfer learning remains open, as previous studies have primarily addressed DP and transfer learning as separate problems. By contrast, we establish a unified viewpoint to integrate DP with transfer learning and find that existing DP methods are not suitable for the transfer learning paradigm. We then propose two new DP methods, label mapping and feature mapping, for supervised and self-supervised pretraining settings respectively, by revisiting the DP problem through the lens of source-target domain mapping. Furthermore, we demonstrate the effectiveness of our approach on numerous transfer learning tasks. We show that source data classes can be pruned by up to 40% ~ 80% without sacrificing downstream performance, resulting in a significant 2 ~ 5 times speed-up during the pretraining stage. Besides, our proposal exhibits broad applicability and can improve other computationally intensive transfer learning techniques, such as adversarial pretraining. Codes are available at https://github.com/OPTML-Group/DP4TL.Comment: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023

A two-step lineage reprogramming strategy to generate functionally competent human hepatocytes from fibroblasts

Terminally differentiated cells can be generated by lineage reprogramming, which is, however, hindered by incomplete conversion with residual initial cell identity and partial functionality. Here, we demonstrate a new reprogramming strategy by mimicking the natural regeneration route, which permits generating expandable hepatic progenitor cells and functionally competent human hepatocytes. Fibroblasts were first induced into human hepatic progenitor-like cells (hHPLCs), which could robustly expand in vitro and efficiently engraft in vivo. Moreover, hHPLCs could be efficiently induced into mature human hepatocytes (hiHeps) in vitro, whose molecular identity highly resembles primary human hepatocytes (PHHs). Most importantly, hiHeps could be generated in large quantity and were functionally competent to replace PHHs for drug-metabolism estimation, toxicity prediction and hepatitis B virus infection modeling. Our results highlight the advantages of the progenitor stage for successful lineage reprogramming. This strategy is promising for generating other mature human cell types by lineage reprogramming.</p

Rubber Toughened and Nanoparticle Reinforced Epoxy Composites

Epoxy resins have achieved acceptance as adhesives, coatings, and potting compounds, but their main application is as matrix to produce reinforced composites. However, their usefulness in this field still limited due to their brittle nature. Some studies have been done to increase the toughness of epoxy composites, of which the most successful one is the modification of the polymer matrix with a second toughening phase. Resin Transfer Molding (RTM) is one of the most important technologies to manufacture fiber reinforced composites. In the last decade it has experimented new impulse, due to its favorable application to produce large surface composites with good technical properties and at relative low cost. This research work focuses on the development of novel modified epoxy matrices, with enhanced mechanical and thermal properties, suitable to be processed by resin transfer molding technology, to manufacture Glass Fiber Reinforced Composites (GFRC’s) with improved performance in comparison to the commercially available ones. In the first stage of the project, a neat epoxy resin (EP) was modified using two different nano-sized ceramics: silicium dioxide (SiO2) and zirconium dioxide (ZrO2); and micro-sized particles of silicone rubber (SR) as second filler. Series of nanocomposites and hybrid modified epoxy resins were obtained by systematic variation of filler contents. The rheology and curing process of the modified epoxy resins were determined in order to define their aptness to be processed by RTM. The resulting matrices were extensively characterized qualitatively and quantitatively to precise the effect of each filler on the polymer properties. It was shown that the nanoparticles confer better mechanical properties to the epoxy resin, including modulus and toughness. It was possible to improve simultaneously the tensile modulus and toughness of the epoxy matrix in more than 30 % and 50 % respectively, only by using 8 vol.-% nano-SiO2 as filler. A similar performance was obtained by nanocomposites containing zirconia. The epoxy matrix modified with 8 vol.-% ZrO2 recorded tensile modulus and toughness improved up to 36% and 45% respectively regarding EP. On the other hand, the addition of silicone rubber to EP and nanocomposites results in a superior toughness but has a slightly negative effect on modulus and strength. The addition of 3 vol.-% SR to the neat epoxy and nanocomposites increases their toughness between 1.5 and 2.5 fold; but implies also a reduction in their tensile modulus and strength in range 5-10%. Therefore, when the right proportion of nanoceramic and rubber were added to the epoxy resin, hybrid epoxy matrices with fracture toughness 3 fold higher than EP but also with up to 20% improved modulus were obtained. Widespread investigations were carried out to define the structural mechanisms responsible for these improvements. It was stated, that each type of filler induces specific energy dissipating mechanisms during the mechanical loading and fracture processes, which are closely related to their nature, morphology and of course to their bonding with the epoxy matrix. When both nanoceramic and silicone rubber are involved in the epoxy formulation, a superposition of their corresponding energy release mechanisms is generated, which provides the matrix with an unusual properties balance. From the modified matrices glass fiber reinforced RTM-plates were produced. The structure of the obtained composites was microscopically analyzed to determine their impregnation quality. In all cases composites with no structural defects (i.e. voids, delaminations) and good superficial finish were reached. The composites were also properly characterized. As expected the final performance of the GFRCs is strongly determined by the matrix properties. Thus, the enhancement reached by epoxy matrices is translated into better GFRC´s macroscopical properties. Composites with up to 15% enhanced strength and toughness improved up to 50%, were obtained from the modified epoxy matrices

Epigenetic regulation of dental-derived stem cells and their application in pulp and periodontal regeneration

Dental-derived stem cells have excellent proliferation ability and multi-directional differentiation potential, making them an important research target in tissue engineering. An increasing number of dental-derived stem cells have been discovered recently, including dental pulp stem cells (DPSCs), stem cells from exfoliated deciduous teeth (SHEDs), stem cells from apical papilla (SCAPs), dental follicle precursor cells (DFPCs), and periodontal ligament stem cells (PDLSCs). These stem cells have significant application prospects in tissue regeneration because they are found in an abundance of sources, and they have good biocompatibility and are highly effective. The biological functions of dental-derived stem cells are regulated in many ways. Epigenetic regulation means changing the expression level and function of a gene without changing its sequence. Epigenetic regulation is involved in many biological processes, such as embryonic development, bone homeostasis, and the fate of stem cells. Existing studies have shown that dental-derived stem cells are also regulated by epigenetic modifications. Pulp and periodontal regeneration refers to the practice of replacing damaged pulp and periodontal tissue and restoring the tissue structure and function under normal physiological conditions. This treatment has better therapeutic effects than traditional treatments. This article reviews the recent research on the mechanism of epigenetic regulation of dental-derived stem cells, and the core issues surrounding the practical application and future use of pulp and periodontal regeneration

Research on China\u27s Primary Industry: Evidence From Regional Analysis Based on SVM and Moran\u27s Index

With advanced technology and efficient policy management in China\u27s primary industry, productivity has increased significantly. This article aims to use machine learning and Moran\u27s I to analyze the current situation of China\u27s primary industry from a regional perspective. Principal component analysis and Lagrange polynomial interpolation are used for data pre-processing. Classification result from the support vector machine reveals that there exist boundaries between each region based on the features of the primary industry. Our results show that fishery and forestry show positive spatial correlations in the Moran\u27s I scatter diagram, while animal husbandry and farming show negative spatial correlations, and regional agriculture development can improve China\u27s primary industry in the long run

The Adsorption Capacity of GONs/CMC/Fe3O4 Magnetic Composite Microspheres and Applications for Purifying Dye Wastewater

Graphene oxide nanosheets (GONs)/carboxymethyl chitosan (CMC)/Fe3O4 magnetic composite microspheres (MCMs) were prepared by enclosing Fe3O4 particles with CMC and GONs in turn. The microstructures of GONs and GONs/CMC/Fe3O4 MCMs were characterized by FTIR, XRD, TEM, and SEM. The effects of GON content, pH value, and adsorption time on the adsorption capacity of the MCMs were investigated. The results show that the GONs/CMC/Fe3O4 MCMs have a greater specific surface area and a strong adsorption capacity for dye wastewater. Meanwhile, the adsorption mechanism was investigated, and the results accorded with the pseudo-second-order kinetic model and the Freundlich isotherm model. The search results indicate that GONs/CMC/Fe3O4 MCMs can be used to purify dye wastewater and has an important potential use in the practical purification of dye wastewater

Shock wave mitigation and impact resistance response of kevlar fabric with novel shear-stiffening gel core

A novel shear thickening gel with micro-scale hard/soft interface structure and low reaction temperature was proposed in this article. The gel was named TH and used as core material within Kevlar fabrics. Storage modulus of TH was proved to increase by around two orders with increasing of shear frequency, and dynamic properties indicated that TH could dissipate or store more energy. TH can adhere with Kevlar fabrics well and satisfactorily fulfill the gap between fabrics. As a result, shock wave peak pressure and positive impulse decreased markedly. Wavelet decomposition analysis show that high frequency energy was filtered by protection materials. Meanwhile, impact resistance test suggested the existence of TH changed the stress propagation routes and avoided pulling out for Kevlar fabrics. Samples filled with TH demonstrated a better shock wave mitigation ability and impact resistance. Energy dissipation structures with TH have a promising prospect in the application of defending area