3 research outputs found
helmholtz-analytics/heat: Heat 1.0: Data Parallel Neural Networks, and more
Release Notes Heat v1.0 comes with some major updates: new module nn for data-parallel neural networks Distributed Asynchronous and Selective Optimization (DASO) to accelerate network training on multi-GPU architectures support for complex numbers major documentation overhaul support channel on StackOverflow support PyTorch 1.8 stop supporting Python 3.6 many more updates and bug fixes, check out the CHANGELO
helmholtz-analytics/heat: Heat 1.1.0: distributed slicing/indexing overhaul, dealing with load imbalance, and more
Highlights Slicing/indexing overhaul for a more NumPy-like user experience. Special thanks to Ben Bourgart @ben-bou and the TerrSysMP group for this one. Warning for distributed arrays: breaking change! Indexing one element along the distribution axis now implies the indexed element is communicated to all processes. More flexibility in handling non-load-balanced distributed arrays. More distributed operations, incl. meshgrid . For other details, see the CHANGELOG