Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

The Mixture of Experts (MoE) is a widely known neural architecture where an ensemble of specialized sub-models optimizes overall performance with a constant computational cost. However, conventional MoEs pose challenges at scale due to the need to store all experts in memory. In this paper, we push MoE to the limit. We propose extremely parameter-efficient MoE by uniquely combining MoE architecture with lightweight experts.Our MoE architecture outperforms standard parameter-efficient fine-tuning (PEFT) methods and is on par with full fine-tuning by only updating the lightweight experts -- less than 1% of an 11B parameters model. Furthermore, our method generalizes to unseen tasks as it does not depend on any prior task knowledge. Our research underscores the versatility of the mixture of experts architecture, showcasing its ability to deliver robust performance even when subjected to rigorous parameter constraints. Our code used in all the experiments is publicly available here: https://github.com/for-ai/parameter-efficient-moe

Constituents, oxidant-antioxidant profile, and antimicrobial capacity of the essential oil obtained from ferulago sandrasica Peşmen and Quézel

Chemical constituents, total phenolic content, total oxidant status, total antioxidant status, lipid hydroperoxides, total free -SH levels, and antimicrobial activity of essential oil obtained from the Ferulago sandrasica (Umbelliferae) were investigated. The essential oil was obtained by hydrodistillation using a Clevenger-type apparatus. The chemical constituents were analyzed by gas chromatography-mass spectrometry. The main components of the essential oil were ocimene (30.5%), carene-δ-3 (27.4%), and pinene (17.8). The antimicrobial activity was tested by a disc diffusion method against E. coli MC 400, E. coli ATCC 25922, E. coli 0157 H7, E. colaecea ATCC 23355, E. feacalis ATCC 19433, P. aeruginosa NRRL B-2679, S. aureus ATCC 25923, B. nischenoformis NRRL B-1001, S. aureus ATCC 33862, B. cereus NRRL B-3711, B. subtilis NRRL B-209, M. luteus NRRL B-1013, L. monocytogenes ATCC 7644, B. subtulis ATCC 6633. © 2013 Copyright Taylor and Francis Group, LLC

Türkiye Cumhuriyet Merkez Bankası'nın Iletişim Politikalarının Değerledirilmesi Ve Açıklamalarının Borsa İstanbul Üzerine Etkisinin Analiz Edilmesi

Tez (Yüksek Lisans) -- İstanbul Teknik Üniversitesi, Sosyal Bilimler Enstitüsü, 2017Thesis (M.A.) -- İstanbul Technical University, Institute of Social Sciences, 2017Yüksek LisansM.A

Sternbergia lutea Etanol Ekstraktlarının Antioksidan Aktivitesi ve Total Fenolik Madde Miktarının Araştırılması

Sternbergia Waldst & Kit. cinsi doğal antioksidanlara kaynak oluşturan geofitlerin arasında ve Amaryllidaceae familyası içinde yer alan önemli bir cinstir. Bu çalışmanın amacı Sternbergia lutea türünün soğan ve yapraklarından elde edilen etanol ekstraktlarının antioksidan aktivitesini ve fenolik bileşen madde miktarını araştırmaktır. Fenolik madde miktarı soğan-etanol (10,5 mg GAE/g) ekstraktlarına nazaran yaprak-etanol (18.9 mg GAE/g) ekstraktlarında daha fazla olmuştur. Soğan ekstraktları (% 86.60) yaprak ekstraktlarından (% 68.10) daha yüksek antioksidan aktivite göstermiştir. Serbest radikal süpürücülük aktivite testinde ise benzer şekilde soğan ekstraktında (%64.29) yaprak ekstraktından (%42.8) daha yüksek serbest radikal süpürücülük saptanmıştır. Sonuçlara göre S. lutea soğan ekstraktları daha güçlü etkiye sahiptir

The role of green energy investments in energy supply security

Renewable energy sources provide the management and control of energy production. The increase in the share of renewable energy sources in the energy portfolio ensures that the renewable energy obtained from local sources is controlled nationally. Since energy is obtained by using local resources, control can be achieved completely. Ensuring the control of energy resources constitutes a priority step towards ensuring supply security. An important element of energy supply security is to ensure continuity of access to energy while meeting energy needs. If the continuity of access to energy is affected by any political, political, or economic factor and dragged into a negative direction, it is a risk factor for energy supply security. Reducing or eliminating the current risk will be possible by focusing on renewable energy sources. Investments in renewable energy resources will reduce foreign dependency as it will ensure energy supply stability through energy management and control. The fragility of access to energy will decrease. Energy supply security will be ensured by reducing the vulnerability of energy access. In this context, renewable energy investments are a factor that needs to be increased to ensure energy supply security

The contribution of sustainable energy policies to the economic improvements of the countries

Sustainable energy policies are important for the adoption and integration of sustainable energy into our lives. The adoption of sustainable energy not only improves our quality of life, but also ensures that we leave a habitable world for future generations. These policies can play a role in the changing of variables that affect all aspects of society, from national security to economic growth. Such important sustainable energy policies must be properly directed with the right policies. If not properly channeled, it is an undisputed fact that they can cause serious problems. Sustainable energy policies should be used effectively within the framework of existing goals. While national circumstances or special positions may sometimes change policies, changes are usually observed in the forms of implementation rather than policies. Just as different prescriptions can be written for individuals with the same diagnosis in the treatment of a disease, the same is true for sustainable energy policies. Policies must be carefully and meticulously created. Market structures, social order, and current habits should not be overlooked within the scope of policies. The successful development of policies can be achieved through everyone taking responsibility. Sustainable energy policies are strategically important for countries and individuals

Delta Hepatitine Bağlı Sirozlu Hastada Hepatosellüler Kanserin Yttrium-90 ile Radyoembolizasyon Tedavisi: Olgu Sunumu

Ülkemizde sirozun önemli etyolojik nedenlerinden biri delta hepatitidir. Hepatosellür kanser (HSK) sıklıkla siroz zemininde gelişmektedir. HSK tedavisinde radyoembolizasyon olarak adlandırılan yttrium-90 tedavisi son yıllarda gittikçe daha yaygın kullanılmaktadır. Radyoaktif mikropartiküllerin transarteryal olarak infüze edilmesinden oluşan ve daha yeni bir yöntem olan radyoembolizasyonun rezeke edilemeyen karaciğer tümörlerinde umut vaat ettiği bildirilmiştir. Delta hepatitine bağlı kompanse karaciğer sirozu zemininde HSK gelişen ve yttrium-90 ile başarılı kemoembolizasyonu yapılan 55 yaşında erkek hasta sunulmuştur.Cirrhosis due to delta hepatitis is one of the most important etiologic factors in our country. Hepatocellular carcinoma (HCC) often develops on the base of cirrhosis. Recently, yttrium-90 radioembolization therapy has been increasingly used in the treatment of HCC. Transarterial infusion of yttrium-90 radioactive microspheres is a new promising method in treating unresectable liver tumors. Herein, we present a 55-year-old male HCC patient who developed HCC due cirrhosis associated with delta hepatitis and was successfully treated with yttrium-90 radioembolization therapy