UniCode: Learning a Unified Codebook for Multimodal Large Language Models

In this paper, we propose \textbf{UniCode}, a novel approach within the domain of multimodal large language models (MLLMs) that learns a unified codebook to efficiently tokenize visual, text, and potentially other types of signals. This innovation addresses a critical limitation in existing MLLMs: their reliance on a text-only codebook, which restricts MLLM's ability to generate images and texts in a multimodal context. Towards this end, we propose a language-driven iterative training paradigm, coupled with an in-context pre-training task we term ``image decompression'', enabling our model to interpret compressed visual data and generate high-quality images.The unified codebook empowers our model to extend visual instruction tuning to non-linguistic generation tasks. Moreover, UniCode is adaptable to diverse stacked quantization approaches in order to compress visual signals into a more compact token representation. Despite using significantly fewer parameters and less data during training, Unicode demonstrates promising capabilities in visual reconstruction and generation. It also achieves performances comparable to leading MLLMs across a spectrum of VQA benchmarks.Comment: 14 pages, 2 figures, 11 table

Deterioration Effect of Sandstone Tensile Strength and Its Mesoscopic Mechanism under Dry-wet Cycles

The rock mass in the hydro-fluctuating zone of the reservoir bank slope is under dry-wet cycles for a long time, which will cause the deterioration of rock mass and induce geological disasters. In this study, a series of dry-wet cycle tests on the argillaceous quartz sandstone in the Three Gorges Reservoir area was carried out. Then, after different dry-wet cycles, the sandstone specimens were used to conduct the Brazilian splitting, scanning electron microscope, and 3D laser scanning tests. Herein, we provided detailed physical and microscopy image data to analyze the deterioration effect of tensile strength and mesostructure deterioration process of sandstone. With the increase of dry-wet cycles, the tensile strength of sandstone initially decreases rapidly, and then the decline rate tends to slow down. The evolution laws of fractal dimension and porosity are also significantly consistent with the deterioration of tensile strength. Moreover, further mesostructural analysis has revealed the repeated “absorption and swelling-dehydration and contraction” of clay minerals. This results in the breakage of framework mineral quartz and the expansion and connectivity of internal cracks, which ultimately deteriorates sandstone’s tensile strength

Founder Overconfidence and Successor Selection

The key issue for family business inheritance is how to choose the successor between family members and professional managers. Based on a sample of 1,992 Chinese listed family firms from 2000 to 2021, this paper studies the unique perspective of founder overconfidence and its role in successor selection. The findings indicate that overconfident founders are more inclined to pass the family business to family members. Both intra-family succession and founder overconfidence positively impact firms’ financial performance. Market investors also have a favorable view of founder overconfidence and intra-family succession, and family businesses that complete intergenerational succession exhibit better market performance. This paper provides empirical evidence on the factors influencing successor selection in intergenerational succession and offers policy recommendations for Chinese family businesses on maintaining their competitive advantage, operating dynamically to create wealth, and driving economic growth.深浦厚之教授、福澤勝彦教授、丸山幸宏教授　定年退職記念号In Honour of Prof. Atsuyuki Fukaura, Prof. Katsuhiko Fukuzawa, and Prof. Yukihiro Maruyama経営と経済, 104(1-2), pp.63-128; 2024departmental bulletin pape

Linear Alignment: A Closed-form Solution for Aligning Human Preferences without Tuning and Feedback

The success of AI assistants based on Language Models (LLMs) hinges on Reinforcement Learning from Human Feedback (RLHF) to comprehend and align with user intentions. However, traditional alignment algorithms, such as PPO, are hampered by complex annotation and training requirements. This reliance limits the applicability of RLHF and hinders the development of professional assistants tailored to diverse human preferences. In this work, we introduce \textit{Linear Alignment}, a novel algorithm that aligns language models with human preferences in one single inference step, eliminating the reliance on data annotation and model training. Linear alignment incorporates a new parameterization for policy optimization under divergence constraints, which enables the extraction of optimal policy in a closed-form manner and facilitates the direct estimation of the aligned response. Extensive experiments on both general and personalized preference datasets demonstrate that linear alignment significantly enhances the performance and efficiency of LLM alignment across diverse scenarios. Our code and dataset is published on \url{https://github.com/Wizardcoast/Linear_Alignment.git}.Comment: Accepted by ICML2024, I'm still preparing a better visio

Posthospital Discharge Medical Care Costs and Family Burden Associated with Osteoporotic Fracture Patients in China from 2011 to 2013

Objectives. This study collected and evaluated data on the costs of outpatient medical care and family burden associated with osteoporosis-related fracture rehabilitation following hospital discharge in China. Materials and Methods. Data were collected using a patient questionnaire from osteoporosis-related fracture patients (N = 123) who aged 50 years and older who were discharged between January 2011 and January 2013 from 3 large hospitals in China. The survey captured posthospital discharge direct medical costs, indirect medical costs, lost work time for caregivers, and patient ambulatory status. Results. Hip fracture was the most frequent fracture site (62.6%), followed by vertebral fracture (34.2%). The mean direct medical care costs per patient totaled 3,910¥, while mean indirect medical costs totaled 743¥. Lost work time for unpaid family caregivers was 16.4 days, resulting in an average lost income of 3,233¥. The average posthospital direct medical cost, indirect medical cost, and caregiver lost income associated with a fracture patient totaled 7,886¥. Patients’ ambulatory status was negatively impacted following fracture. Conclusions. Significant time and cost of care are placed on patients and caregivers during rehabilitation after discharge for osteoporotic fracture. It is important to evaluate the role and responsibility for creating the growing and inequitable burden placed on patients and caregivers following osteoporotic fracture

CCDC50 Promotes Tumor Growth Through Regulation of Lysosome Homeostasis

The maintenance of lysosome homeostasis is crucial for cell growth. Lysosome-dependent degradation and metabolism sustain tumor cell survival. Here, we demonstrate that CCDC50 serves as a lysophagy receptor, promoting tumor progression and invasion by controlling lysosomal integrity and renewal. CCDC50 monitors lysosomal damage, recognizes galectin-3 and K63-linked polyubiquitination on damaged lysosomes, and specifically targets them for autophagy-dependent degradation. CCDC50 deficiency causes the accumulation of ruptured lysosomes, impaired autophagic flux, and superfluous reactive oxygen species, consequently leading to cell death and tumor suppression. CCDC50 expression is associated with malignancy, progression to metastasis, and poor overall survival in human melanoma. Targeting CCDC50 suppresses tumor growth and lung metastasis, and enhances the effect of BRAFV600E inhibition. Thus, we demonstrate critical roles of CCDC50-mediated clearance of damaged lysosomes in supporting tumor growth, hereby identifying a potential therapeutic target of melanoma

Closed trans-intersphincteric fistulotomy: a new modified sphincter-sparing technique for high transsphincteric anal fistula

BackgroundThe main goals of surgery for fistula-in-ano are to completely resolve the condition and maintain optimal anal function. Effective management of the internal opening during and proper postoperative drainage of the intersphincter plane are crucial for achieving successful outcomes. This study evaluated the clinical efficacy of a novel sphincter-sparing technique for treating high transsphincteric anal fistula (HTAF).MethodsThis prospective study included 55 patients with HTAF who underwent closed trans-intersphincteric fistulotomy (CTiF) between July 2021 and April 2022 at our institution. Preoperative anorectal magnetic resonance imaging was performed for all patients. The primary outcome measures assessed the rate of fistula healing while the secondary outcome measures evaluated healing time, Cleveland Clinic Florida fecal incontinence score (CCF-FIS), 11-point visual analog scale (VAS) pain score and postoperative complications.ResultsWe included 55 patients with HTAF in this study. During a mean follow-up period of 9.3 months, CTiF achieved a healing rate of 90.91% (50/55). The mean time to recovery was 7.09 ± 1.94 weeks. Four (7.27%) patients developed postoperative urinary retention. At the 6-month follow-up, the CCF-FIS and VAS score were 0 [(0,0) range, 0–3] and 0 [(0,1); range, 0–4], respectively. Two patients with recurrent HTAF recovered after treatment with a transanal opening of intersphincteric space procedure, and three recovered after seton placement.ConclusionsCTiF is a promising and effective sphincter-sparing technique for treating HTAF. To confirm long-term outcomes, larger sample size prospective randomized controlled trials are required

CML/RAGE signal induces calcification cascade in diabetes

OBJECTIVE: Vascular calcification is a significant predictor of coronary heart disease events, stroke, and lower-limb amputation. Advanced glycation end-products (AGEs) play a key role in the development of vascular calcification. However, the role of Nε-carboxymethyl-lysine (CML), a major active ingredient of heterogeneous AGEs, in the development of atherosclerotic calcification in diabetic patients and the underlying mechanism remain unclear. Hence, the role and the mechanism of CML in the transmission pathway of diabetic calcification cascade were investigated in the present study. METHODS: In vivo and in vitro investigations were performed. In study I, 45 diabetic patients hospitalized for above-knee amputation in the Department of Orthopedics, Affiliated Hospital of Jiangsu University were recruited from February 2010 to June 2015. The patients were categorized based on the severity of anterior tibial artery stenosis, which was assessed by color Doppler ultrasound, into mild stenosis (0% < stenosis < 50%, n = 15), moderate stenosis (50 ≤ stenosis < 70%, n = 15), and severe stenosis/occlusion groups (70 ≤ stenosis ≤ 100%, n = 15). In study II, the specific mechanism of CML in the transmission pathway of the diabetic calcification cascade signal was investigated in A7r5 aortic smooth muscle cells under high-lipid, apoptosis-coexisting conditions. ELISA (for serum CML concentration of patients), ultrasound (for plaque size, calcification, blood flow filling, vascular stenosis etc.), H&E staining (for plaque morphology), vonKossa staining (for qualitative analysis of calcification), calcium content assay (for quantitative analysis of calcification), and Western blot analyses of CML, receptor for advanced glycation end products (RAGE), NADPH oxidase 4, phosphorylated p38, core-binding factor α1 (cbfα1), alkaline phosphatase (ALP) and β-actin were then performed. RESULTS: Morphological analysis revealed extensive calcification lesions in the intima and media of the anterior tibial artery. The extent and area of calcium deposition in the intima significantly increased with disease progression. Interestingly, spotty calcification was predominant in the atherosclerotic plaques of diabetic patients with amputation, and macrocalcification was almost invisible. Pearson correlation analysis revealed that serum CML level exhibited a significant positive correlation with calcium content in the arterial wall (R(2) = 0.6141, P < 0.0001). Semi-quantitative Western blot analysis suggested that the intensity of CML/RAGE signal increased with progression of atherosclerotic calcification in diabetic patients. In subsequent in vitro study, the related pathway was blocked by anti-RAGE antibody, NADPH oxidase inhibitor DPI, p38MAPK inhibitor SB203580, and anti-cbfa1 antibody in a step-wise manner to observe changes in calcium deposition and molecular signals. Results suggested that CML may play a key role in atherosclerotic calcification mainly through the CML/RAGE- reactive oxygen species (ROS)-p38MAPK-cbfα1-ALP pathway. CONCLUSION: Spotty calcification was predominant in the atherosclerotic plaques of amputated diabetic patients. CML/RAGE signal may induce the calcification cascade in diabetes via ROS-p38MAPK