6 research outputs found

    Semantic-Enhanced Image Clustering

    Full text link
    Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus being unable to distinguish visually similar but semantically different images. In this paper, we propose to investigate the task of image clustering with the help of a visual-language pre-training model. Different from the zero-shot setting, in which the class names are known, we only know the number of clusters in this setting. Therefore, how to map images to a proper semantic space and how to cluster images from both image and semantic spaces are two key problems. To solve the above problems, we propose a novel image clustering method guided by the visual-language pre-training model CLIP, named \textbf{Semantic-Enhanced Image Clustering (SIC)}. In this new method, we propose a method to map the given images to a proper semantic space first and efficient methods to generate pseudo-labels according to the relationships between images and semantics. Finally, we propose performing clustering with consistency learning in both image space and semantic space, in a self-supervised learning fashion. The theoretical result of convergence analysis shows that our proposed method can converge at a sublinear speed. Theoretical analysis of expectation risk also shows that we can reduce the expected risk by improving neighborhood consistency, increasing prediction confidence, or reducing neighborhood imbalance. Experimental results on five benchmark datasets clearly show the superiority of our new method

    Semantic-Enhanced Image Clustering

    No full text
    Image clustering is an important and open challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus being unable to distinguish visually similar but semantically different images. In this paper, we propose to investigate the task of image clustering with the help of visual-language pre-training model. Different from the zero-shot setting, in which the class names are known, we only know the number of clusters in this setting. Therefore, how to map images to a proper semantic space and how to cluster images from both image and semantic spaces are two key problems. To solve the above problems, we propose a novel image clustering method guided by the visual-language pre-training model CLIP, named Semantic-Enhanced Image Clustering (SIC). In this new method, we propose a method to map the given images to a proper semantic space first and efficient methods to generate pseudo-labels according to the relationships between images and semantics. Finally, we propose to perform clustering with consistency learning in both image space and semantic space, in a self-supervised learning fashion. The theoretical result of convergence analysis shows that our proposed method can converge at a sublinear speed. Theoretical analysis of expectation risk also shows that we can reduce the expectation risk by improving neighborhood consistency, increasing prediction confidence, or reducing neighborhood imbalance. Experimental results on five benchmark datasets clearly show the superiority of our new method

    The Performance of Different Mapping Functions and Gradient Models in the Determination of Slant Tropospheric Delay

    No full text
    Global navigation satellite systems (GNSSs) have become an important tool for remotely sensing water vapor in the atmosphere. In GNSS data processing, mapping functions and gradient models are needed to map the zenith tropospheric delay (ZTD) to the slant total tropospheric delay (STD) along a signal path. Therefore, it is essential to investigate the spatial–temporal performance of various mapping functions and gradient models in the determination of STD. In this study, the STDs at nine elevations were first calculated by applying the ray-tracing method to the atmospheric European Reanalysis-Interim (ERA—Interim) dataset. These STDs were then used as the reference to study the accuracy of the STDs that determined the ZTD together with mapping functions and gradient models. The performance of three mapping functions (i.e., Niell mapping function (NMF), global mapping function (GMF), and Vienna mapping function (VMF1)) and three gradient models (i.e., Chen, MacMillan, and Meindl) in six regions (the temperate zone, Qinghai–Tibet Plateau, Equator, Sahara Desert, Amazon Rainforest, and North Pole) in determining slant tropospheric delay was investigated in this study. The results indicate that the three mapping functions have relatively similar performance above a 15° elevation, but below a 15° elevation, VMF1 clearly performed better than the GMF and NMF. The results also show that, if no gradient model is included, the root-mean-square (RMS) of the STD is smaller than 2 mm above the 30° elevation and smaller than 9 mm above the 15° elevation but shows a significant increase below the 15° elevation. For example, in the temperate zone, the RMS increases from approximately 35 mm at the 10° elevation to approximately 160 mm at the 3° elevation. The inclusion of gradient models can significantly improve the accuracy of STDs by 50%. All three gradient models performed similarly at all elevations and in all regions. The bending effect was also investigated, and the results indicate that the tropospheric delay caused by the bending effect is normally below 13 mm above a 15° elevation, but this delay increases dramatically from approximately 40 mm at a 10° elevation to approximately 200 mm at a 5° elevation, and even reaches 500–700 mm at a 3° elevation in most studied regions

    Clinical features and prognosis of acute-on-chronic liver failure in patients with recompensated cirrhosis

    No full text
    Abstract Background There are few studies on acute-on-chronic liver failure (ACLF) in patients with recompensated cirrhosis. This study was aimed to investigate the clinical features of ACLF patients with recompensated cirrhosis. Methods A total of 461 ACLF patients were enrolled and divided into three groups: compensated, recompensated, and decompensated cirrhosis with ACLF. The baseline clinical data and 1-year survival rates were compared among the three groups. Results Compared with the decompensated group, in the recompensated group, the levels of hemoglobin, albumin, and serum sodium were significantly higher and the white blood cell count, international normalized ratio, and incidence of respiratory failure were significantly lower; there were no evident differences in other organ failures. The proportion of patients with ACLF grade 3 and 1-year survival rates significantly differed between the two groups. Conversely, compared with the compensated group, in the recompensated group, the platelet and total bilirubin levels were significantly lower and the proportion of patients with ACLF grade 1 was significantly higher. However, other clinical indicators or 1-year survival rates did not significantly differ between the two groups. Conclusions Compared with patients who developed ACLF with decompensated cirrhosis, those who developed ACLF with recompensated cirrhosis had a less severe condition, lower incidence of respiratory failure, and better 1-year prognosis. However, the baseline clinical features and prognosis were similar between ACLF patients with recompensated and compensated cirrhosis. Trial registration Chinese clinical trials registry: ChiCTR1900021539

    An Improved Model for Detecting Heavy Precipitation Using GNSS-Derived Zenith Total Delay Measurements

    No full text
    In recent years, precipitable water vapor has been widely used in heavy precipitation prediction, which is obtained from a conversion of the zenith total delay (ZTD) of the GNSS signal. Since the parameter directly estimated for the tropospheric delay from Global Navigation Satellite Systems (GNSS) data processing is the ZTD, this study investigated the feasibility of directly using ZTD to predict heavy precipitation. Based on the finding that, prior to a heavy precipitation events, ZTD was likely to start with a duration of continuous rise followed by a sharp drop, a new heavy precipitation detection model containing seven predictors derived from ZTD was established. The seven predictors reflect not only the ascending and descending trends but also long-term and short-term variations in the ZTD time series. Three criteria, representing different situations for the formation of heavy precipitation, were also constructed using the predictors to detect heavy precipitation. The optimal set of thresholds for the seven predictors for each summer month were determined based on hourly ZTD and precipitation records at a pair of co-located GNSS/weather station−HKSC-KP in Hong Kong over the period 2010−2017. The model was evaluated using the predictions in 2018 and 2019 to compare against the corresponding precipitation records. Results showed that the new model correctly predicted 98.8% of the heavy precipitation events, with a mean lead time of 4.37 h. Compared with the existing models, the new model also reduced the false alarms by 32.3%. Similar results were also obtained from the other three pairs of co-located stations. These results suggest that it is rational and effective to use the new ZTD-based model for improving the performance of heavy precipitation detection

    Development of an Improved Model for Prediction of Short-Term Heavy Precipitation Based on GNSS-Derived PWV

    No full text
    Nowadays, the Global Navigation Satellite Systems (GNSS) have become an effective atmospheric observing technique to remotely sense precipitable water vapor (PWV) mainly due to their high spatiotemporal resolutions. In this study, from an investigation for the relationship between GNSS-derived PWV (GNSS-PWV) and heavy precipitation, it was found that from several hours before heavy precipitation, PWV was probably to start with a noticeable increase followed by a steep drop. Based on this finding, a new model including five predictors for heavy precipitation prediction is proposed. Compared with the existing 3-factor model that uses three predictors derived from the ascending trend of PWV time series (i.e., PWV value, PWV increment and rate of the PWV increment), the new model also includes two new predictors derived from the descending trend: PWV decrement and rate of PWV decrement. The use of the two new predictors for reducing the number of misdiagnosis predictions is proposed for the first time. The optimal set of monthly thresholds for the new five-predictor model in each summer month were determined based on hourly GNSS-PWV time series and precipitation records at three co-located GNSS/weather stations during the 8-year period 2010–2017 in the Hong Kong region. The new model was tested using hourly GNSS-PWV and precipitation records obtained at the above three co-located stations during the summer months in 2018 and 2019. Results showed that 189 of the 198 heavy precipitation events were correctly predicted with a lead time of 5.15 h, and the probability of detection reached 95.5%. Compared with the 3-factor method, the new model reduced the FAR score by 32.9%. The improvements made by the new model have great significance for early detection and predictions of heavy precipitation in near real-time
    corecore