65 research outputs found

    OmniDataComposer: A Unified Data Structure for Multimodal Data Fusion and Infinite Data Generation

    Full text link
    This paper presents OmniDataComposer, an innovative approach for multimodal data fusion and unlimited data generation with an intent to refine and uncomplicate interplay among diverse data modalities. Coming to the core breakthrough, it introduces a cohesive data structure proficient in processing and merging multimodal data inputs, which include video, audio, and text. Our crafted algorithm leverages advancements across multiple operations such as video/image caption extraction, dense caption extraction, Automatic Speech Recognition (ASR), Optical Character Recognition (OCR), Recognize Anything Model(RAM), and object tracking. OmniDataComposer is capable of identifying over 6400 categories of objects, substantially broadening the spectrum of visual information. It amalgamates these diverse modalities, promoting reciprocal enhancement among modalities and facilitating cross-modal data correction. \textbf{The final output metamorphoses each video input into an elaborate sequential document}, virtually transmuting videos into thorough narratives, making them easier to be processed by large language models. Future prospects include optimizing datasets for each modality to encourage unlimited data generation. This robust base will offer priceless insights to models like ChatGPT, enabling them to create higher quality datasets for video captioning and easing question-answering tasks based on video content. OmniDataComposer inaugurates a new stage in multimodal learning, imparting enormous potential for augmenting AI's understanding and generation of complex, real-world data

    An Interface Setup Optimization Method Using a Throughput Estimation Model for Concurrently Communicating Access Points in a Wireless Local Area Network

    Get PDF
    The IEEE 802.11 wireless local-area network (WLAN) has been deployed around the globe as a major Internet access medium due to its low cost and high flexibility and capacity. Unfortunately, dense wireless networks can suffer from poor performance due to high levels of radio interference resulting from adjoining access points (APs). To address this problem, we studied the AP transmission power optimization method, which selects the maximum or minimum power supplied to each AP so that the average signal-to-interference ratio (SIR) among the concurrently communicating APs is maximized.However, this method requires measurements of receiving signal strength (RSS) under all the possible combinations of powers. It may need intolerable loads and time as the number of APs increases. It also only considers the use of channel bonding (CB), although non-CB sometimes achieves higher performance under high levels of interference. In this paper, we present an AP interface setup optimization method using the throughput estimation model for concurrently communicating APs. The proposed method selects CB or non-CB in addition to the maximum or minimum power for each AP. This model approach avoids expensive costs of RSS measurements under a number of combinations. To estimate the RSS at an AP from another AP or a host, the model needs the distance and the obstacles between them, such as walls. Then, by calculating the estimated RSS with the model and calculating the SIR from them, the AP interface setups for a lot of APs in a large-scale wireless network can be optimized on a computer in a very short time. For evaluation, we conducted extensive experiments using Raspberry Pi for APs and Linux PCs for hosts under 12 network topologies in three buildings at Okayama University, Japan, and Jatiya Kabi Kazi Nazrul Islam University, Bangladesh. The results confirm that the proposed method selects the best AP interface setup with the highest total throughput in any topology

    Experimental Demonstration of OFDM/OQAM Transmission for Visible Light Communications

    Get PDF
    We propose a modified orthogonal frequency division multiplexing/offset quadrature amplitude modulation (OFDM/OQAM) scheme for visible light communications (VLC). The OFDM/OQAM VLC system can efficiently boost the data rate, and combat multipath induced the inter symbol interference (ISI) and inter carrier interference (ICI). To combat the effect of intrinsic imaginary interference, intrasymbol frequency-domain averaging and minimum mean squared error (MMSE), combined with interference approximation method, are proposed. The experiment results show that the proposed system offers similar bit error rate performance to that of OFDM, while the bit rate is increased by 9% for the elimination of cyclic-prefix and guard band

    An Application of Throughput Request Satisfaction Method for Maximizing Concurrent Throughput in WLAN for IoT Application System

    Get PDF
    With the wide applications of the Internet of Things (IoT) in smart home systems, IEEE 802.11n Wireless Local Area Networks (WLANs) have become a frequently chosen communication technology due to their adaptability and affordability. In a high-density network of devices such as the smart home scenerio, a host often meets interferences from other devices and unequal Received Signal Strength (RSS) from Access Points (APs). This results in throughput unfairness/insufficiency problems between hosts communicating concurrently in WLAN. Previously, we have studied the throughput request satisfaction method to address this problem. It calculates the target throughput from measured single and concurrent throughputs of hosts and controls the actual throughput at this target one by applying traffic shaping at the AP. However, the insufficiency problem of maximizing the throughput is not solved due to interferences from other hosts. In this paper, we present an extension of the throughput request satisfaction method to maximize the throughput of a high-priority host under concurrent communications. It recalculates the target throughput to increase the actual throughput as much as possible while the other hosts satisfy the least throughput. For evaluations, we conduct experiments using the test-bed system with Raspberry Pi as the AP devices in several topologies in indoor environments. The results confirm the effectiveness of our proposal

    CRISPR/Cas9-mediated gene mutation of EcIAG leads to sex reversal in the male ridgetail white prawn Exopalaemon carinicauda

    Get PDF
    In the culture of crustaceans, most species show sexual dimorphism. Monosex culture is an effective approach to achieve high yield and economic value, especially for decapods of high value. Previous studies have developed some sex control strategies such as manual segregation, manipulation of male androgenic gland and knockdown of the male sexual differentiation switch gene encoding insulin-like androgenic gland hormone (IAG) in decapods. However, these methods could not generate hereditable changes. Genetic manipulation to achieve sex reversal individuals is absent up to now. In the present study, the gene encoding IAG (EcIAG) was identified in the ridgetail white prawn Exopalaemon carinicauda. Sequence analysis showed that EcIAG encoded conserved amino acid structure like IAGs in other decapod species. CRISPR/Cas9-mediated genome editing technology was used to knock out EcIAG. Two sgRNAs targeting the second exon of EcIAG were designed and microinjected into the prawn zygotes or the embryos at the first cleavage with commercial Cas9 protein. EcIAG in three genetic males was knocked out in both chromosome sets, which successfully generated sex reversal and phenotypic female characters. The results suggest that CRISPR/Cas9-mediated genome editing technology is an effective way to develop sex manipulation technology and contribute to monosex aquaculture in crustaceans

    Evidence of strong and mode-selective electron–phonon coupling in the topological superconductor candidate 2M-WS 2

    Get PDF
    The interaction between lattice vibrations and electrons plays a key role in various aspects of condensed matter physics — including electron hydrodynamics, strange metal behavior, and high-temperature superconductivity. In this study, we present systematic investigations using Raman scattering and angle-resolved photoemission spectroscopy (ARPES) to examine the phononic and electronic subsystems of the topological superconductor candidate 2M-WS2. Raman scattering exhibits an anomalous nonmonotonic temperature dependence of phonon linewidths, indicative of strong phonon–electron scattering over phonon–phonon scattering. The ARPES results demonstrate pronounced dispersion anomalies (kinks) at multiple binding energies within both bulk and topological surface states, indicating a robust and mode-selective coupling between the electronic states and various phonon modes. These experimental findings align with previous calculations of the Eliashberg function, providing a deeper understanding of the highest superconducting transition temperature observed in 2M-WS2 (8.8 K) among all transition metal dichalcogenides as induced by electron–phonon coupling. Furthermore, our results may offer valuable insights into other properties of 2M-WS2 and guide the search for high-temperature topological superconductors

    Characterization techniques for tobacco and its derivatives: a systematic review

    Get PDF
    Biomass and its derivatives have broad applications in the fields of bio-catalysis, energy storage, environmental remediation. The structure and components of biomass, which are vital parameters affecting corresponding performances of derived products, need to be fully understood for further regulating the biomass and its derivatives. Herein, tobacco is taken as an example of biomass to introduce the typical characterization techniques in unraveling the structural information, chemical components, and properties of biomass and its derivatives. Firstly, the structural information, chemical components and application for biomass are summarized. Then the characterization techniques together with the resultant structural information and chemical components are introduced. Finally, to promote a wide and deep study in this field, the perspectives and challenges concerning structure and composition charaterization in biomass and its derivatives are put forward

    Off-line evaluation of indoor positioning systems in different scenarios: the experiences from IPIN 2020 competition

    Get PDF
    Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements.Track 3 organizers were supported by the European Union’s Horizon 2020 Research and Innovation programme under the Marie Skłodowska Curie Grant 813278 (A-WEAR: A network for dynamic WEarable Applications with pRivacy constraints), MICROCEBUS (MICINN, ref. RTI2018-095168-B-C55, MCIU/AEI/FEDER UE), INSIGNIA (MICINN ref. PTQ2018-009981), and REPNIN+ (MICINN, ref. TEC2017-90808-REDT). We would like to thanks the UJI’s Library managers and employees for their support while collecting the required datasets for Track 3. Track 5 organizers were supported by JST-OPERA Program, Japan, under Grant JPMJOP1612. Track 7 organizers were supported by the Bavarian Ministry for Economic Affairs, Infrastructure, Transport and Technology through the Center for Analytics-Data-Applications (ADA-Center) within the framework of “BAYERN DIGITAL II. ” Team UMinho (Track 3) was supported by FCT—Fundação para a Ciência e Tecnologia within the R&D Units Project Scope under Grant UIDB/00319/2020, and the Ph.D. Fellowship under Grant PD/BD/137401/2018. Team YAI (Track 3) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 109-2221-E-197-026. Team Indora (Track 3) was supported in part by the Slovak Grant Agency, Ministry of Education and Academy of Science, Slovakia, under Grant 1/0177/21, and in part by the Slovak Research and Development Agency under Contract APVV-15-0091. Team TJU (Track 3) was supported in part by the National Natural Science Foundation of China under Grant 61771338 and in part by the Tianjin Research Funding under Grant 18ZXRHSY00190. Team Next-Newbie Reckoners (Track 3) were supported by the Singapore Government through the Industry Alignment Fund—Industry Collaboration Projects Grant. This research was conducted at Singtel Cognitive and Artificial Intelligence Lab for Enterprises (SCALE@NTU), which is a collaboration between Singapore Telecommunications Limited (Singtel) and Nanyang Technological University (NTU). Team KawaguchiLab (Track 5) was supported by JSPS KAKENHI under Grant JP17H01762. Team WHU&AutoNavi (Track 6) was supported by the National Key Research and Development Program of China under Grant 2016YFB0502202. Team YAI (Tracks 6 and 7) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 110-2634-F-155-001
    • …
    corecore