Breaking the Architecture Barrier: A Method for Efficient Knowledge Transfer Across Networks

Transfer learning is a popular technique for improving the performance of neural networks. However, existing methods are limited to transferring parameters between networks with same architectures. We present a method for transferring parameters between neural networks with different architectures. Our method, called DPIAT, uses dynamic programming to match blocks and layers between architectures and transfer parameters efficiently. Compared to existing parameter prediction and random initialization methods, it significantly improves training efficiency and validation accuracy. In experiments on ImageNet, our method improved validation accuracy by an average of 1.6 times after 50 epochs of training. DPIAT allows both researchers and neural architecture search systems to modify trained networks and reuse knowledge, avoiding the need for retraining from scratch. We also introduce a network architecture similarity measure, enabling users to choose the best source network without any training.Comment: 23 pages, 16 figure

Pathway: a fast and flexible unified stream data processing framework for analytical and Machine Learning applications

We present Pathway, a new unified data processing framework that can run workloads on both bounded and unbounded data streams. The framework was created with the original motivation of resolving challenges faced when analyzing and processing data from the physical economy, including streams of data generated by IoT and enterprise systems. These required rapid reaction while calling for the application of advanced computation paradigms (machinelearning-powered analytics, contextual analysis, and other elements of complex event processing). Pathway is equipped with a Table API tailored for Python and Python/SQL workflows, and is powered by a distributed incremental dataflow in Rust. We describe the system and present benchmarking results which demonstrate its capabilities in both batch and streaming contexts, where it is able to surpass state-of-the-art industry frameworks in both scenarios. We also discuss streaming use cases handled by Pathway which cannot be easily resolved with state-of-the-art industry frameworks, such as streaming iterative graph algorithms (PageRank, etc.)

Framework of algorithm portfolios for strip packing problem

International audienceIn this paper selection of fast algorithm portfolios for 2SP packing problem is considered. The 2SP problem consists in placing rectangles on a strip of the given width for minimum strip length. The 2SP packing has application in many industries, but suitability of the related algorithms is limited by their runtimes. While solving combinatorial optimization problems, longer runtimes increase chances of obtaining higher quality solutions. This means that runtime vs solution quality trade-off is important in solving problems such as strip packing. Given some limited runtime, a method is needed to provide the best solution possible. However, a single algorithm outperforming all other methods under all possible conditions usually does not exist. Therefore, algorithm portfolios can reliably provide high quality solutions in the limited runtime. We propose a method choosing algorithm portfolios on the basis of the algorithm performance on a set of training instances. A portfolio covers the instances with the best solutions which could be obtained in the given runtime, subject to the minimum computational cost of the selected algorithms. The portfolios are evaluated in extensive experiments carried out on designed and literature datasets. We demonstrate that our method is capable of carrying over solution quality from the training datasets to the testing datasets. In other words, our algorithm selection method can learn from the training instances. We also compare performance of our portfolio selection method with some other more straightforward approaches to the portfolio selection

Mechanism of Reduction of Drought-Induced Oxidative Stress in Maize Plants by Fertilizer Seed Coating

In this study, we investigated the effects of the utilization of seed coating by dedicated fertilizer on the mechanism of oxidative stress reduction in maize growing in simulated drought conditions. A strict pot experiment was conducted for this purpose in a climatic chamber with a phytotron system and controlled temperature and air humidity. Maize seeds were planted and grown in soil with 20% (extreme drought), 40%, and 60% water holding capacity (WHC). The seeds were enhanced using proposed fertilizer and applied at a rate of 2 kg t−1 seeds. The levels of ROS, as well as antioxidant enzymes SOD, CAT, and GPOX, generated by plants enhanced using the seed coating by fertilizer and by control specimens (non-enhanced), were measured 21 days after the seeds were planted. Antioxidant potential and total polyphenol contents in the plants were also determined. The findings show that under drought stress, plants produce high levels of ROS, which is responsible for oxidative stress. However, the latter phenomenon may be reduced using seed coating. Application of seed coating by fertilizer contributed to a 32.7% decrease in ROS in the case of extreme drought (soil with 20% WHC). The treatment also led to increased activity of SOD (61.2%), CAT (45.7%), and GPOX (35.8%), which shows its positive effects on activation of the enzymatic antioxidant system responsible for neutralization of ROS and for reducing the negative effects of drought

Aspiration Versus Stent Retriever Thrombectomy for Distal, Medium Vessel Occlusion Stroke in the Posterior Circulation: A Subanalysis of the TOPMOST Study.

BACKGROUND The optimal endovascular strategy for reperfusing distal medium-vessel occlusions (DMVO) remains unknown. This study evaluates angiographic and clinical outcomes of thrombectomy strategies in DMVO stroke of the posterior circulation. METHODS TOPMOST (Treatment for Primary Medium Vessel Occlusion Stroke) is an international, retrospective, multicenter, observational registry of patients treated for DMVO between January 2014 and June 2020. This study analyzed endovascularly treated isolated primary DMVO of the posterior cerebral artery in the P2 and P3 segment. Technical feasibility was evaluated with the first-pass effect defined as a modified Thrombolysis in Cerebral Infarction Scale score of 3. Rates of early neurological improvement and functional modified Rankin Scale scores at 90 days were compared. Safety was assessed by the occurrence of symptomatic intracranial hemorrhage and intervention-related serious adverse events. RESULTS A total of 141 patients met the inclusion criteria and were treated endovascularly for primary isolated DMVO in the P2 (84.4%, 119) or P3 segment (15.6%, 22) of the posterior cerebral artery. The median age was 75 (IQR, 62-81), and 45.4% (64) were female. The initial reperfusion strategy was aspiration only in 29% (41) and stent retriever in 71% (100), both achieving similar first-pass effect rates of 53.7% (22) and 44% (44; P=0.297), respectively. There were no significant differences in early neurological improvement (aspiration: 64.7% versus stent retriever: 52.2%; P=0.933) and modified Rankin Scale rates (modified Rankin Scale score 0-1, aspiration: 60.5% versus stent retriever 68.6%; P=0.4). In multivariable logistic regression analysis, the time from groin puncture to recanalization was associated with the first-pass effect (adjusted odds ratio, 0.97 [95% CI, 0.95-0.99]; P<0.001) that in turn was associated with early neurological improvement (aOR, 3.27 [95% CI, 1.16-9.21]; P<0.025). Symptomatic intracranial hemorrhage occurred in 2.8% (4) of all cases. CONCLUSIONS Both first-pass aspiration and stent retriever thrombectomy for primary isolated posterior circulation DMVO seem to be safe and technically feasible leading to similar favorable rates of angiographic and clinical outcome

Thrombectomy versus Medical Management for Isolated Anterior Cerebral Artery Stroke: An International Multicenter Registry Study.

Background Evidence supporting a potential benefit of thrombectomy for distal medium vessel occlusions (DMVOs) of the anterior cerebral artery (ACA) is, to the knowledge of the authors, unknown. Purpose To compare the clinical and safety outcomes between mechanical thrombectomy (MT) and best medical treatment (BMT) with or without intravenous thrombolysis for primary isolated ACA DMVOs. Materials and Methods Treatment for Primary Medium Vessel Occlusion Stroke, or TOPMOST, is an international, retrospective, multicenter, observational registry of patients treated for DMVO in daily practice. Patients treated with thrombectomy or BMT alone for primary ACA DMVO distal to the A1 segment between January 2013 and October 2021 were analyzed and compared by one-to-one propensity score matching (PSM). Early outcome was measured by the median improvement of National Institutes of Health Stroke Scale (NIHSS) scores at 24 hours. Favorable functional outcome was defined as modified Rankin scale scores of 0-2 at 90 days. Safety was assessed by the occurrence of symptomatic intracerebral hemorrhage and mortality. Results Of 154 patients (median age, 77 years; quartile 1 [Q1] to quartile 3 [Q3], 66-84 years; 80 men; 94 patients with MT; 60 patients with BMT) who met the inclusion criteria, 110 patients (median age, 76 years; Q1-Q3, 67-83 years; 50 men; 55 patients with MT; 55 patients with BMT) were matched. DMVOs were in A2 (82 patients; 53%), A3 (69 patients; 45%), and A3 (three patients; 2%). After PSM, the median 24-hour NIHSS point decrease was -2 (Q1-Q3, -4 to 0) in the thrombectomy and -1 (Q1-Q3, -4 to 1.25) in the BMT cohort (P = .52). Favorable functional outcome (MT vs BMT, 18 of 37 [49%] vs 19 of 39 [49%], respectively; P = .99) and mortality (MT vs BMT, eight of 37 [22%] vs 12 of 39 [31%], respectively; P = .36) were similar in both groups. Symptomatic intracranial hemorrhage occurred in three (2%) of 154 patients. Conclusion Thrombectomy appears to be a safe and technically feasible treatment option for primary isolated anterior cerebral artery occlusions in the A2 and A3 segment with clinical outcomes similar to best medical treatment with and without intravenous thrombolysis. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Zhu and Wang in this issue

Thrombectomy for secondary distal, medium vessel occlusions of the posterior circulation: seeking complete reperfusion.

BACKGROUND Whether to approach distal occlusions endovascularly or not in medium-sized vessels secondary to proximal large vessel occlusion stroke remains unanswered. OBJECTIVE To investigates the technical feasibility and safety of thrombectomy for secondary posterior circulation distal, medium vessel occlusions (DMVO). METHODS TOPMOST (Treatment fOr Primary Medium vessel Occlusion STroke) is an international, retrospective, multicenter, observational registry of patients treated for distal cerebral artery occlusions. This study subanalysis endovascularly treated occlusions of the posterior cerebral artery in the P2 and P3 segment secondary preprocedural or periprocedural thrombus migration between January 2014 and June 2020. Technical feasibility was evaluated with the modified Thrombolysis in Cerebral Infarction (mTICI) scale. Procedural safety was assessed by the occurrence of symptomatic intracranial hemorrhage (sICH) and intervention-related serious adverse events. RESULTS Among 71 patients with secondary posterior circulation DMVO who met the inclusion criteria, occlusions were present in 80.3% (57/71) located in the P2 segment and in 19.7% (14/71) in the P3 segment. Periprocedural migration occurred in 54.9% (39/71) and preprocedural migration in 45.1% (32/71) of cases. The first reperfusion attempt led in 38% (27/71) of all cases to mTICI 3. On multivariable logistic regression analysis, increased numbers of reperfusion attempts (adjusted odds ratio (aOR)=0.39, 95% CI 0.29 to 0.88, p=0.009) and preprocedural migration (aOR=4.70, 95% CI,1.35 to 16.35, p=0.015) were significantly associated with mTICI 3. sICH occurred in 2.8% (2/71). CONCLUSION Thrombectomy for secondary posterior circulation DMVO seems to be safe and technically feasible. Even though thrombi that have migrated preprocedurally may be easier to retract, successful reperfusion can be achieved in the majority of patients with secondary DMVO of the P2 and P3 segment

Effect of anesthetic strategies on distal stroke thrombectomy in the anterior and posterior cerebral artery.

BACKGROUND Numerous questions regarding procedural details of distal stroke thrombectomy remain unanswered. This study assesses the effect of anesthetic strategies on procedural, clinical and safety outcomes following thrombectomy for distal medium vessel occlusions (DMVOs). METHODS Patients with isolated DMVO stroke from the TOPMOST registry were analyzed with regard to anesthetic strategies (ie, conscious sedation (CS), local (LA) or general anesthesia (GA)). Occlusions were in the P2/P3 or A2-A4 segments of the posterior and anterior cerebral arteries (PCA and ACA), respectively. The primary endpoint was the rate of complete reperfusion (modified Thrombolysis in Cerebral Infarction score 3) and the secondary endpoint was the rate of modified Rankin Scale score 0-1. Safety endpoints were the occurrence of symptomatic intracranial hemorrhage and mortality. RESULTS Overall, 233 patients were included. The median age was 75 years (range 64-82), 50.6% (n=118) were female, and the baseline National Institutes of Health Stroke Scale score was 8 (IQR 4-12). DMVOs were in the PCA in 59.7% (n=139) and in the ACA in 40.3% (n=94). Thrombectomy was performed under LA±CS (51.1%, n=119) and GA (48.9%, n=114). Complete reperfusion was reached in 73.9% (n=88) and 71.9% (n=82) in the LA±CS and GA groups, respectively (P=0.729). In subgroup analysis, thrombectomy for ACA DMVO favored GA over LA±CS (aOR 3.07, 95% CI 1.24 to 7.57, P=0.015). Rates of secondary and safety outcomes were similar in the LA±CS and GA groups. CONCLUSION LA±CS compared with GA resulted in similar reperfusion rates after thrombectomy for DMVO stroke of the ACA and PCA. GA may facilitate achieving complete reperfusion in DMVO stroke of the ACA. Safety and functional long-term outcomes were comparable in both groups

Thrombectomy for secondary distal, medium vessel occlusions of the posterior circulation: seeking complete reperfusion

Background Whether to approach distal occlusions endovascularly or not in medium-sized vessels secondary to proximal large vessel occlusion stroke remains unanswered. Objective To investigates the technical feasibility and safety of thrombectomy for secondary posterior circulation distal, medium vessel occlusions (DMVO). Methods TOPMOST (Treatment fOr Primary Medium vessel Occlusion STroke) is an international, retrospective, multicenter, observational registry of patients treated for distal cerebral artery occlusions. This study subanalysis endovascularly treated occlusions of the posterior cerebral artery in the P2 and P3 segment secondary preprocedural or periprocedural thrombus migration between January 2014 and June 2020. Technical feasibility was evaluated with the modified Thrombolysis in Cerebral Infarction (mTICI) scale. Procedural safety was assessed by the occurrence of symptomatic intracranial hemorrhage (sICH) and intervention-related serious adverse events. Results Among 71 patients with secondary posterior circulation DMVO who met the inclusion criteria, occlusions were present in 80.3% (57/71) located in the P2 segment and in 19.7% (14/71) in the P3 segment. Periprocedural migration occurred in 54.9% (39/71) and preprocedural migration in 45.1% (32/71) of cases. The first reperfusion attempt led in 38% (27/71) of all cases to mTICI 3. On multivariable logistic regression analysis, increased numbers of reperfusion attempts (adjusted odds ratio (aOR)=0.39, 95% CI 0.29 to 0.88, p=0.009) and preprocedural migration (aOR=4.70, 95% CI,1.35 to 16.35, p=0.015) were significantly associated with mTICI 3. sICH occurred in 2.8% (2/71). Conclusion Thrombectomy for secondary posterior circulation DMVO seems to be safe and technically feasible. Even though thrombi that have migrated preprocedurally may be easier to retract, successful reperfusion can be achieved in the majority of patients with secondary DMVO of the P2 and P3 segment