Token Recycling for Efficient Sequential Inference with Vision Transformers

Vision Transformers (ViTs) overpass Convolutional Neural Networks in processing incomplete inputs because they do not require the imputation of missing values. Therefore, ViTs are well suited for sequential decision-making, e.g. in the Active Visual Exploration problem. However, they are computationally inefficient because they perform a full forward pass each time a piece of new sequential information arrives. To reduce this computational inefficiency, we introduce the TOken REcycling (TORE) modification for the ViT inference, which can be used with any architecture. TORE divides ViT into two parts, iterator and aggregator. An iterator processes sequential information separately into midway tokens, which are cached. The aggregator processes midway tokens jointly to obtain the prediction. This way, we can reuse the results of computations made by iterator. Except for efficient sequential inference, we propose a complementary training policy, which significantly reduces the computational burden associated with sequential decision-making while achieving state-of-the-art accuracy.Comment: The code will be released upon acceptanc

Global disparities in surgeons’ workloads, academic engagement and rest periods: the on-calL shIft fOr geNEral SurgeonS (LIONESS) study

: The workload of general surgeons is multifaceted, encompassing not only surgical procedures but also a myriad of other responsibilities. From April to May 2023, we conducted a CHERRIES-compliant internet-based survey analyzing clinical practice, academic engagement, and post-on-call rest. The questionnaire featured six sections with 35 questions. Statistical analysis used Chi-square tests, ANOVA, and logistic regression (SPSS® v. 28). The survey received a total of 1.046 responses (65.4%). Over 78.0% of responders came from Europe, 65.1% came from a general surgery unit; 92.8% of European and 87.5% of North American respondents were involved in research, compared to 71.7% in Africa. Europe led in publishing research studies (6.6 ± 8.6 yearly). Teaching involvement was high in North America (100%) and Africa (91.7%). Surgeons reported an average of 6.7 ± 4.9 on-call shifts per month, with European and North American surgeons experiencing 6.5 ± 4.9 and 7.8 ± 4.1 on-calls monthly, respectively. African surgeons had the highest on-call frequency (8.7 ± 6.1). Post-on-call, only 35.1% of respondents received a day off. Europeans were most likely (40%) to have a day off, while African surgeons were least likely (6.7%). On the adjusted multivariable analysis HDI (Human Development Index) (aOR 1.993) hospital capacity > 400 beds (aOR 2.423), working in a specialty surgery unit (aOR 2.087), and making the on-call in-house (aOR 5.446), significantly predicted the likelihood of having a day off after an on-call shift. Our study revealed critical insights into the disparities in workload, access to research, and professional opportunities for surgeons across different continents, underscored by the HDI

The taxpayer's protection rules in the tax law

Taxpayers` rights protection is an issue that requires a lot of attention nowadays. It is a subject of many debates, researches and controversy. However, taxpayers` rights are commonly considered as one of the main foundation of every tax system. Instruments protecting the rights of taxpayers can be found in international law, at the constitutional level, in national legislation and mainly in substantive law and tax procedure. This paper examines sources and the extent of the rights available to tax payers in the Republic of Poland

Mo-MDSCs are pivotal players in colorectal cancer and may be associated with tumor recurrence after surgery

Colorectal cancer (CRC) is the third most common malignancy. Its development and progression is associated with natural immunosuppression related, among others, to myeloid derived suppressor cells (MDSCs). Overall, 54 patients in different stage of CRC, before any treatment were recruited into the study. The analysis included flow cytometry evaluation of blood MDSCs subsets, correlation their level with the tumor stage and T cell subsets. In the case of 11 patients, MDSCs level was evaluated before and 3 days after surgery, and these patients were monitored for cancer recurrence over 5 years. The results showed that frequency of circulating MDSCs subsets is increased significantly in CRC patients, with highest level detected in most advanced tumor stages. Moreover, only monocytic MDSCs (Mo-MDSCs) positively correlate with regulatory Treg, and negatively with tumor Her2/neu specific CD8+ T cells. Circulating MDSCs, in contrast to tumor resident (mostly Mo-MDSCs), are negative for PD-L1 expression. Additionally, after surgery the blood level of Mo-MDSCs increases significantly, and this is associated with tumor recurrence during a 5-year follow-up. In conclusion, Mo-MDSCs are pivotal players in CRC-related immunosuppression and may be associated with the risk of tumor recurrence after surgery