76 research outputs found

    The Grass Is Indeed Greener in India and China for Returnee Entrepreneurs

    Get PDF
    Presents survey findings on why Indian and Chinese entrepreneurs left the United States to found companies back home, how they view their home countries' business climates and their advantages and disadvantages, and whether they maintain ties to the U.S

    ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout

    Full text link
    As deep learning models continue to increase in size, the memory requirements for training have surged. While high-level techniques like offloading, recomputation, and compression can alleviate memory pressure, they also introduce overheads. However, a memory-efficient execution plan that includes a reasonable operator execution order and tensor memory layout can significantly increase the models' memory efficiency and reduce overheads from high-level techniques. In this paper, we propose ROAM which operates on computation graph level to derive memory-efficient execution plan with optimized operator order and tensor memory layout for models. We first propose sophisticated theories that carefully consider model structure and training memory load to support optimization for large complex graphs that have not been well supported in the past. An efficient tree-based algorithm is further proposed to search task divisions automatically, along with delivering high performance and effectiveness to solve the problem. Experiments show that ROAM achieves a substantial memory reduction of 35.7%, 13.3%, and 27.2% compared to Pytorch and two state-of-the-art methods and offers a remarkable 53.7x speedup. The evaluation conducted on the expansive GPT2-XL further validates ROAM's scalability

    China’s national talent plan : key measures and objectives

    Get PDF
    China’s talent cultivation plan, the National Medium- and Long-term Talent Development Plan (2010), is a blueprint for creating a highly skilled national work force in the next 10 years. The goal is the transformation of China from a manufacturing hub to a world leader in innovation. The paper explores dimensions of the national talent plan in terms of China’s industrial sector, investment, demographic changes, labour markets, and capacity to retain talented people. China needs to transform its workforce from one that is labor-intensive to one that is talent-rich

    Chinese Manufacturing Firms' Overseas Direct Investment: Patterns, motivations and challenges

    No full text
    The widespread perception of industrialised countries as homes of multinational corporations (MNCs) and emerging markets as hosts of MNCs has been firmly rooted. These were, however, MNCs in the past, which were nowhere near as active or visible as they are today. In recent years, China and India, major Latin American economies such as Brazil and Mexico, and South Africa have all spawned their own MNCs (Dunning et al. 2007)
    • …
    corecore