Using ACL2 to Verify Loop Pipelining in Behavioral Synthesis

Behavioral synthesis involves compiling an Electronic System-Level (ESL) design into its Register-Transfer Level (RTL) implementation. Loop pipelining is one of the most critical and complex transformations employed in behavioral synthesis. Certifying the loop pipelining algorithm is challenging because there is a huge semantic gap between the input sequential design and the output pipelined implementation making it infeasible to verify their equivalence with automated sequential equivalence checking techniques. We discuss our ongoing effort using ACL2 to certify loop pipelining transformation. The completion of the proof is work in progress. However, some of the insights developed so far may already be of value to the ACL2 community. In particular, we discuss the key invariant we formalized, which is very different from that used in most pipeline proofs. We discuss the needs for this invariant, its formalization in ACL2, and our envisioned proof using the invariant. We also discuss some trade-offs, challenges, and insights developed in course of the project.Comment: In Proceedings ACL2 2014, arXiv:1406.123

AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort

Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in character identities. Given the complexity of story visualization, existing methods drastically simplify the problem by considering only a few specific characters and scenarios, or requiring the users to provide per-image control conditions such as sketches. However, these simplifications render these methods incompetent for real applications. To this end, we propose an automated story visualization system that can effectively generate diverse, high-quality, and consistent sets of story images, with minimal human interactions. Specifically, we utilize the comprehension and planning capabilities of large language models for layout planning, and then leverage large-scale text-to-image models to generate sophisticated story images based on the layout. We empirically find that sparse control conditions, such as bounding boxes, are suitable for layout planning, while dense control conditions, e.g., sketches and keypoints, are suitable for generating high-quality image content. To obtain the best of both worlds, we devise a dense condition generation module to transform simple bounding box layouts into sketch or keypoint control conditions for final image generation, which not only improves the image quality but also allows easy and intuitive user interactions. In addition, we propose a simple yet effective method to generate multi-view consistent character images, eliminating the reliance on human labor to collect or draw character images.Comment: 19 page

CoDeF: Content Deformation Fields for Temporally Consistent Video Processing

We present the content deformation field CoDeF as a new type of video representation, which consists of a canonical content field aggregating the static contents in the entire video and a temporal deformation field recording the transformations from the canonical image (i.e., rendered from the canonical content field) to each individual frame along the time axis.Given a target video, these two fields are jointly optimized to reconstruct it through a carefully tailored rendering pipeline.We advisedly introduce some regularizations into the optimization process, urging the canonical content field to inherit semantics (e.g., the object shape) from the video.With such a design, CoDeF naturally supports lifting image algorithms for video processing, in the sense that one can apply an image algorithm to the canonical image and effortlessly propagate the outcomes to the entire video with the aid of the temporal deformation field.We experimentally show that CoDeF is able to lift image-to-image translation to video-to-video translation and lift keypoint detection to keypoint tracking without any training.More importantly, thanks to our lifting strategy that deploys the algorithms on only one image, we achieve superior cross-frame consistency in processed videos compared to existing video-to-video translation approaches, and even manage to track non-rigid objects like water and smog.Project page can be found at https://qiuyu96.github.io/CoDeF/.Comment: Project Webpage: https://qiuyu96.github.io/CoDeF/, Code: https://github.com/qiuyu96/CoDe

Mechanochemical synthesis of pillar[5]quinone derived multi-microporous organic polymers for radioactive organic iodide capture and storage.

The incorporation of supramolecular macrocycles into porous organic polymers may endow the material with enhanced uptake of specific guests through host-guest interactions. Here we report a solvent and catalyst-free mechanochemical synthesis of pillar[5]quinone (P5Q) derived multi-microporous organic polymers with hydrophenazine linkages (MHP-P5Q), which show a unique 3-step N2 adsorption isotherm. In comparison with analogous microporous hydrophenazine-linked organic polymers (MHPs) obtained using simple twofold benzoquinones, MHP-P5Q is demonstrated to have a superior performance in radioactive iodomethane (CH3I) capture and storage. Mechanistic studies show that the rigid pillar[5]arene cavity has additional binding sites though host-guest interactions as well as the halogen bond (-I⋯N = C-) and chemical adsorption in the multi-microporous MHP-P5Q mainly account for the rapid and high-capacity adsorption and long-term storage of CH3I

Imaging and Pathological Features of Percutaneous Cryosurgery on Normal Lung Evaluated in a Porcine Model

Background and objective Lung cancer is one of the most commonly occurring malignancies and frequent causes of death in the world. Cryoablation is a safe and alternative treatment for unresectable lung cancer. Due to the lung being gas-containing organ and different from solid organs such as liver and pancreas, it is difficult to achieve the freezing range of beyond the tumor edge 1 cm safety border. The aim of this study is to examine the effect of different numbers of freeze cycles on the effectiveness of cryoablation on normal lung tissue and to create an operation guideline that gives the best effect. Methods Six healthy Tibetan miniature pigs were given a CT scan and histological investigation after percutaneous cryosurgery. Cryoablation was performed as 2 cycles of 10 min of active freezing in the left lung; each freeze followed by a 5 min thaw. In the right lung, we performed the same 2 cycles of 5 min of freezing followed by 5 min of thawing. However, for the right lung, we included a third cycle of consisting of 10 min of freezing followed by 5 min of thawing. Three cryoprobes were inserted into the left lung and three cryoprobes in the right lung per animal, one in the upper and two in the lower lobe, so as to be well away from each other. Comparison under the same experimental condition was necessary. During the experiment, observations were made regarding the imaging change of ice-ball. The lungs were removed postoperatively at 3 intervals: 4 h, 3 d of postoperation and 7 d of postoperation, respectively, to view microscopic and pathological change. Results The ice-ball grew gradually in relation to the increase in time, and the increase in number of cycles. The size of the cryolesion (hypothesis necrotic area) in specimens, over time, became larger in size than the size of the ice-ball during operation, regardless of whether 2 or 3 freeze-thaw cycles were performed. The area of necrosis was gradually increased over the course of time. The hypothesis necrotic area was equal to necrosis area 3 d after cryosurgery. Conclusion Percutaneous cryoablation of the lung can achieve complete ablation of target tissue. The freezing technique may be different depending on the individual circumstances of each tumor. In technology, 3 freeze-thaw cycles are recommended, and the range of cryoablation’s effective diameter may be not necessarily beyond the tumor edge at least 1 cm safe border during cryosurgery

Measuring discrepancies between simple medullary and synchronous medullary/papillary thyroid carcinomas: a comparative cross-sectional study

ObjectiveTo study the clinicopathological characteristics of patients with synchronous medullary and papillary thyroid carcinomas.MethodsThe clinical data of patients with medullary thyroid carcinoma (MTC) operated in our hospital (Department of Thyroid Surgery, China-Japan Union Hospital, Jilin University) from February 2009 to February 2023 were evaluated using an analytical review approach. They were divided into an observation group (patients with synchronous MTC and papillary thyroid carcinoma PTC) and a control group (simple MTC) according to whether the clinical data were associated with MTC, in order to compare the clinical features, pathological types, stage characteristics and molecular biology characteristics of the two groups and to investigate the follow-up of the two groups.ResultsThe study included 122 MTC, 30 with synchronous MTC/PTC and 92 simple MTC. When the data were compared, the sex ratio, preoperative calcitonin level, preoperative CEA level, presence of calcifications in the MTC lesions, surgical methods, number of MTC lesions, presence of nodular goitre and presence of thyroiditis were higher in the observation group than in the control group. There was a significant difference between the groups when the MTC lesion diameter was ≤1cm in terms of preoperative CEA value (P<0.05); when the MTC lesion diameter was >1cm, there was a statistical difference between the two groups in terms of preoperative Ctn value (P<0.05). Type III was significantly different from the simple group, while type IV was more similar to the simple group. The preoperative serum Ctn value was positively correlated with maximum tumour diameter in both groups, although the correlation was stronger in the easy group. Preoperative CEA was positively correlated with maximum tumour diameter in both groups, with a stronger correlation in the combination group. Preoperative Ctn and CEA were positively correlated with lymph node metastasis in the simple group, whereas there was no apparent correlation with lymph node metastasis in the combination group. The cut-off value of preoperative serum Ctn for cervical lymph node metastases in the simple group was 39.2pg/ml and for lateral cervical lymph node metastases 195.5pg/ml. The cut-off value of preoperative serum Ctn for cervical lymph node metastases in the combination group was 60.79pg/ml and for lateral cervical lymph node metastases 152.6pg/ml. In the simple group, prognosis was significantly worse in the progression group (P<0.001), with no statistical difference between the remission and stable groups. In the combination group, the prognosis of the progression and stable groups was significantly worse than that of the remission group (P<0.001), with no statistical difference between the progression and stable groups.ConclusionIn patients with synchronous medullary and papillary thyroid carcinomas, preoperative Ctn and CEA levels, calcifications, solitary lesions, combined goitre or thyroiditis differ significantly from simple MTC. Therefore, clinical management should pay attention to the above factors and early risk screening should be performed to improve prognosis as much as possible

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

Equivalence Checking for High-Assurance Behavioral Synthesis

The rapidly increasing complexities of hardware designs are forcing design methodologies and tools to move to the Electronic System Level (ESL), a higher abstraction level with better productivity than the state-of-the-art Register Transfer Level (RTL). Behavioral synthesis, which automatically synthesizes ESL behavioral specifications to RTL implementations, plays a central role in this transition. However, since behavioral synthesis is a complex and error-prone translation process, the lack of designers\u27 confidence in its correctness becomes a major barrier to its wide adoption. Therefore, techniques for establishing equivalence between an ESL specification and its synthesized RTL implementation are critical to bring behavioral synthesis into practice. The major research challenge to equivalence checking for behavioral synthesis is the significant semantic gap between ESL and RTL. The semantics of ESL involve untimed, sequential execution; however, the semantics of RTL involve timed, concurrent execution. We propose a sequential equivalence checking (SEC) framework for certifying a behavioral synthesis flow, which exploits information on successive intermediate design representations produced by the synthesis flow to bridge the semantic gap. In particular, the intermediate design representation after scheduling and pipelining transformations permits effective correspondence of internal operations between this design representation and the synthesized RTL implementation, enabling scalable, compositional equivalence checking. Certifications of loop and function pipelining transformations are possible by a combination of theorem proving and SEC through exploiting pipeline generation information from the synthesis flow (e.g., the iteration interval of a generated pipeline). The complexity brought by bubbles in function pipelines is creatively reduced by symbolically encoding all possible bubble insertions in one pipelined design representation. The result of this dissertation is a robust, practical, and scalable framework for certifying RTL designs synthesized from ESL specifications. We have validated the robustness, practicality, and scalability of our approach on industrial-scale ESL designs that result in tens of thousands of lines of RTL implementations

Componentizing hardware/software interface design

Abstract—Building highly optimized embedded systems demands hardware/software (HW/SW) co-design. A key challenge in co-design is the design of HW/SW interfaces, which is often a design bottleneck. We propose a novel approach to HW/SW interface design based on the concept of bridge component. Bridge components fill the HW/SW semantic gap by propagating events across the HW/SW boundary and raise the abstraction level for designing HW/SW interfaces by abstracting processors, buses, embedded OS, etc. of embedded system platforms. Bridge components are specified in platform-specific Bridge Specification Languages (BSLs) and compiled by the BSL compilers for simulation and deployment. We have applied our approach to two different embedded system platforms. Case studies have shown that bridge components greatly simplify component-based codesign of embedded systems and system simulation speed can be improved three orders of magnitude by simulating bridge components on the transaction level. I

Equivalence Checking for Behaviorally Synthesized Pipelines

Loop pipelining is a critical transformation in behavioral synthesis. It is crucial to producing hardware designs with acceptable latency and throughput. However, it is a complex transformation involving aggressive scheduling strategies for high throughput and careful control generation to eliminate hazards. We present an equivalence checking approach for certifying synthesized hardware designs in the presence of pipelining transformations. Our approach works by (1) constructing a provably correct pipeline reference model from sequential specification, and (2) applying sequential equivalence checking between this reference model and synthesized RTL. We demonstrate the scalability of our approach on several synthesized designs from a commercial synthesis tool