Finding Sparse Structures for Domain Specific Neural Machine Translation

Neural machine translation often adopts the fine-tuning approach to adapt to specific domains. However, nonrestricted fine-tuning can easily degrade on the general domain and over-fit to the target domain. To mitigate the issue, we propose Prune-Tune, a novel domain adaptation method via gradual pruning. It learns tiny domain-specific sub-networks during fine-tuning on new domains. Prune-Tune alleviates the over-fitting and the degradation problem without model modification. Furthermore, Prune-Tune is able to sequentially learn a single network with multiple disjoint domain-specific sub-networks for multiple domains. Empirical experiment results show that Prune-Tune outperforms several strong competitors in the target domain test set without sacrificing the quality on the general domain in both single and multi-domain settings. The source code and data are available at https://github.com/ohlionel/Prune-Tune.Comment: Accepted to AAAI 202

Strategies for Small Business Restaurant Sustainability Beyond the First 5 Years

Ineffective leadership strategies can negatively affect the sustainability of small business restaurants. Leaders of small business restaurants who do not implement effective leadership strategies may face challenges sustaining their business in the first 5 years of operation. Grounded in entrepreneurship theory, the purpose of this qualitative multiple case study was to explore leadership strategies that successful small business restaurant managers employ to help sustain their businesses beyond the first 5 years of operation. The participants of this study included three individuals who successfully managed small business restaurants in the Midwestern United States. Data collection procedures included semistructured interviews and a collection of company documentation such as business mission statements, organizational charts, and job descriptions. Data were analyzed using coding, theme development, member checking, and methodological triangulation. Four themes emerged: maintaining good customer relationships, quality of product, employee satisfaction, and importance of community involvement. A key recommendation is for small business restaurant owners to build honest relationships both within the company and with suppliers. Small business owners may engage directly with customers and employees while working alongside their staff and being hands-on with the business operations. Implications for positive social change include information that can support small businesses to remain successful. In return, a successful small restaurant business may lead to more job opportunities, encourage employee advancement, and increase local business-to-business transactions