Accurate deep neural network inference using computational phase-change memory

In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog matrix-vector multiplications without intermediate movements of data. However, due to device variability and noise, the network needs to be trained in a specific way so that transferring the digitally trained weights to the analog resistive memory devices will not result in significant loss of accuracy. Here, we introduce a methodology to train ResNet-type convolutional neural networks that results in no appreciable accuracy loss when transferring weights to in-memory computing hardware based on phase-change memory (PCM). We also propose a compensation technique that exploits the batch normalization parameters to improve the accuracy retention over time. We achieve a classification accuracy of 93.7% on the CIFAR-10 dataset and a top-1 accuracy on the ImageNet benchmark of 71.6% after mapping the trained weights to PCM. Our hardware results on CIFAR-10 with ResNet-32 demonstrate an accuracy above 93.5% retained over a one day period, where each of the 361,722 synaptic weights of the network is programmed on just two PCM devices organized in a differential configuration.Comment: This is a pre-print of an article accepted for publication in Nature Communication

Optimizing hydrolysis and acidogenesis in order to dissolve and recover phosphorus in organic effluents upstream from methane production

Le phosphore est un élément crucial pour la vie sur Terre, de par son implication dans les processus bioénergétiques, le stockage et le traitement de l'information génétique. C'est également l'un des nutriments limitants en agriculture, aux côtés de l'azote et du potassium. Depuis la révolution verte au milieu du 20ième siècle, le monde agricole est dépendant des engrais phosphorés à bas coûts, fabriqués à partir d'une ressource fossile et nécessaires à l'amélioration des rendements des cultures à même de répondre aux besoins en nourriture d'une population en forte croissance. Cependant cette ressource, la roche phosphatée, s'épuise progressivement. De plus, son utilisation est très peu efficiente : moins de 20% du phosphore extrait se retrouve effectivement dans la nourriture consommée. L'une des raisons de cette faible efficience est la spécialisation de régions entières dans des productions agricoles spécifiques. Ainsi, les régions spécialisées dans les cultures à hauts rendements ont besoin de grandes quantités d'engrais minéraux alors que les régions d'élevage intensif ont des excédents de lisier sans terres agricoles suffisamment grandes et proches pour servir de zones d'épandage. L'épandage excessif de lisier en Bretagne est la cause première d'eutrophisation des cours d'eau. Le phosphore contenu dans le lisier porcin pourrait être recyclé sous forme de struvite (MgNH4PO4,6H2O), un engrais phosphaté à dissolution lente, très concentré et facilement transportable vers les régions de cultures végétales nécessitant une fertilisation phosphatée importante. Le phosphore du lisier porcin étant initialement présent sous une forme minérale solide, il est nécessaire de le dissoudre avant de le précipiter en struvite. Parce-que la dissolution par acidification chimique est trop chère et implique un mauvais bilan environnemental, le procédé développé lors de cette thèse utilise l'acidogénèse, un procédé biologique au cours duquel la matière organique est convertie en acides organiques en absence d'oxygène, acidifiant naturellement le lisier porcin. Différents déchets organiques ont été testés en tant que co-substrats dans du lisier porcin brut ou digéré, provoquant une fermentation de type lactique lorsque le co-substrat possédait une forte teneur en glucides facilement biodégradables, et une fermentation avec de nombreux acides organiques produits lorsque la teneur en glucides facilement biodégradables était faible. Il a pu être démontré que la fermentation lactique était le fait de bactéries appartenant au genre Lactobacillus, alors que divers Clostridiales dominaient lors des autres fermentations avec la production d'acétate, propionate, butyrate et valérate. Un réacteur en semi continu alimenté d'un mélange de lisier brut de petit pois et de carottes a permis la dissolution de 50% du phosphore total soit 750 mg-P/L. Après centrifugation, 3.4 g d'hydroxyde de magnésium par litre de surnageant a été ajouté afin d'élever le pH à 8 et ainsi précipiter la struvite. 99% du phosphore dissous a alors été abattu. Le solide obtenu contenait 70% de struvite, un léger excès de phosphore et de magnésium, ainsi que de la matière organique. L'acidogénèse permet l'hydrolyse de la matière organique complexe et la formation d'acides organiques. De ce fait, ce procédé de recyclage du phosphore contenu dans le lisier porcin pourrait être implémenté dans les nombreuses unités de méthanisation présentes en Bretagne et qui traitent des effluents animaux ainsi que des déchets organiques d'origine agricole, industrielle et municipale. La struvite obtenue pourrait être vendue dans les régions ayant besoin de fertilisation phosphatée alors que la matière organique du digestat pourrait être maintenue en Bretagne. Un tel procédé réduirait significativement l'eutrophisation due à l'épandage excessif du lisier tout en diminuant les besoins en fertilisants minéraux fossiles grâce à une source alternative aux performances fertilisantes équivalentes.Phosphorus is a crucial nutrient for life, implicated in cellular bioenergetics as well as storage and processing of genetic information. It is also one of the limiting nutrients in agriculture with nitrogen and potassium. Since the green revolution in the middle of the 20th century, agriculture has relied on increasing amounts of cheap mineral P-fertilizers produced from a fossil resource to improve crop yields and sustain population growth. However, the resource is depleting and its use efficiency is poor: less than 20% of extracted P is actually consumed in food. One of the reasons for this is the specialization of entire regions into on type of agricultural production or another. Thus, regions focusing on high yield crops require large applications of fossil mineral fertilizers while intensive livestock breeding areas cannot find an output for their P-rich manure due to the distance with crop fields in need of P fertilization. Over application of animal manure in Brittany is the main cause of eutrophication in the region. Phosphorus could be recovered from pig manure as struvite, a concentrated, slow-release mineral fertilizer easily transported to crop-oriented regions in need of P fertilization. P in pig slurry is mostly under a solid inorganic form, requiring dissolution prior to precipitation as struvite. Because chemical acidification is too expensive and harmful to the environment, the process developed in this PhD relied on acidogenesis, a biological process in which organic matter is converted to organic acids under anaerobic conditions, thus naturally acidifying the swine slurry. Various organic wastes were tested as organic co-substrates on raw and digested pig slurry, leading to lactic acid fermentation when the co-substrate had a high content in easily biodegradable carbohydrates and a fermentation with diverse organic acids produced at low content in easily biodegradable carbohydrates. Lactobacillus was the genus responsible for lactic acid fermentation and various Clostridiales dominated otherwise, producing acetate, propionate, butyrate and valerate. A reactor was operated with semi-continuous feeding of raw swine slurry and carrot/pea, leading to the dissolution of 50% total-phosphorus or 750 mg-P/L. After centrifugation, struvite was precipitated in the supernatant by adding magnesium hydroxide to increase the pH to 8. 99% of dissolved P precipitated. The solid recovered contained 70% of struvite, a slight excess of P and Mg as well as organic matter. Because hydrolysis of organic matter and production of organic acids occurs during acidogenesis, the process could be implemented in the many anaerobic digestion units installed in Brittany treating animal manure and agricultural, industrial and municipal organic waste. The struvite recovered could be sold to regions in need while the digestate impoverished in P and rich in organic matter could be kept locally. Such process would reduce eutrophication due to over application of pig manure and also reduce the reliance on fossil P fertilizer by offering an alternative source with equivalent fertilizing performances

Optimiser l'hydrolyse et l'acidogénèse pour dissoudre et recycler le phosphore des effluents organiques en amont des unités de méthanisation

Phosphorus is a crucial nutrient for life, implicated in cellular bioenergetics as well as storage and processing of genetic information. It is also one of the limiting nutrients in agriculture with nitrogen and potassium. Since the green revolution in the middle of the 20th century, agriculture has relied on increasing amounts of cheap mineral P-fertilizers produced from a fossil resource to improve crop yields and sustain population growth. However, the resource is depleting and its use efficiency is poor: less than 20% of extracted P is actually consumed in food. One of the reasons for this is the specialization of entire regions into on type of agricultural production or another. Thus, regions focusing on high yield crops require large applications of fossil mineral fertilizers while intensive livestock breeding areas cannot find an output for their P-rich manure due to the distance with crop fields in need of P fertilization. Over application of animal manure in Brittany is the main cause of eutrophication in the region. Phosphorus could be recovered from pig manure as struvite, a concentrated, slow-release mineral fertilizer easily transported to crop-oriented regions in need of P fertilization. P in pig slurry is mostly under a solid inorganic form, requiring dissolution prior to precipitation as struvite. Because chemical acidification is too expensive and harmful to the environment, the process developed in this PhD relied on acidogenesis, a biological process in which organic matter is converted to organic acids under anaerobic conditions, thus naturally acidifying the swine slurry. Various organic wastes were tested as organic co-substrates on raw and digested pig slurry, leading to lactic acid fermentation when the co-substrate had a high content in easily biodegradable carbohydrates and a fermentation with diverse organic acids produced at low content in easily biodegradable carbohydrates. Lactobacillus was the genus responsible for lactic acid fermentation and various Clostridiales dominated otherwise, producing acetate, propionate, butyrate and valerate. A reactor was operated with semi-continuous feeding of raw swine slurry and carrot/pea, leading to the dissolution of 50% total-phosphorus or 750 mg-P/L. After centrifugation, struvite was precipitated in the supernatant by adding magnesium hydroxide to increase the pH to 8. 99% of dissolved P precipitated. The solid recovered contained 70% of struvite, a slight excess of P and Mg as well as organic matter. Because hydrolysis of organic matter and production of organic acids occurs during acidogenesis, the process could be implemented in the many anaerobic digestion units installed in Brittany treating animal manure and agricultural, industrial and municipal organic waste. The struvite recovered could be sold to regions in need while the digestate impoverished in P and rich in organic matter could be kept locally. Such process would reduce eutrophication due to over application of pig manure and also reduce the reliance on fossil P fertilizer by offering an alternative source with equivalent fertilizing performances.Le phosphore est un élément crucial pour la vie sur Terre, de par son implication dans les processus bioénergétiques, le stockage et le traitement de l'information génétique. C'est également l'un des nutriments limitants en agriculture, aux côtés de l'azote et du potassium. Depuis la révolution verte au milieu du 20ième siècle, le monde agricole est dépendant des engrais phosphorés à bas coûts, fabriqués à partir d'une ressource fossile et nécessaires à l'amélioration des rendements des cultures à même de répondre aux besoins en nourriture d'une population en forte croissance. Cependant cette ressource, la roche phosphatée, s'épuise progressivement. De plus, son utilisation est très peu efficiente : moins de 20% du phosphore extrait se retrouve effectivement dans la nourriture consommée. L'une des raisons de cette faible efficience est la spécialisation de régions entières dans des productions agricoles spécifiques. Ainsi, les régions spécialisées dans les cultures à hauts rendements ont besoin de grandes quantités d'engrais minéraux alors que les régions d'élevage intensif ont des excédents de lisier sans terres agricoles suffisamment grandes et proches pour servir de zones d'épandage. L'épandage excessif de lisier en Bretagne est la cause première d'eutrophisation des cours d'eau. Le phosphore contenu dans le lisier porcin pourrait être recyclé sous forme de struvite (MgNH4PO4,6H2O), un engrais phosphaté à dissolution lente, très concentré et facilement transportable vers les régions de cultures végétales nécessitant une fertilisation phosphatée importante. Le phosphore du lisier porcin étant initialement présent sous une forme minérale solide, il est nécessaire de le dissoudre avant de le précipiter en struvite. Parce-que la dissolution par acidification chimique est trop chère et implique un mauvais bilan environnemental, le procédé développé lors de cette thèse utilise l'acidogénèse, un procédé biologique au cours duquel la matière organique est convertie en acides organiques en absence d'oxygène, acidifiant naturellement le lisier porcin. Différents déchets organiques ont été testés en tant que co-substrats dans du lisier porcin brut ou digéré, provoquant une fermentation de type lactique lorsque le co-substrat possédait une forte teneur en glucides facilement biodégradables, et une fermentation avec de nombreux acides organiques produits lorsque la teneur en glucides facilement biodégradables était faible. Il a pu être démontré que la fermentation lactique était le fait de bactéries appartenant au genre Lactobacillus, alors que divers Clostridiales dominaient lors des autres fermentations avec la production d'acétate, propionate, butyrate et valérate. Un réacteur en semi continu alimenté d'un mélange de lisier brut de petit pois et de carottes a permis la dissolution de 50% du phosphore total soit 750 mg-P/L. Après centrifugation, 3.4 g d'hydroxyde de magnésium par litre de surnageant a été ajouté afin d'élever le pH à 8 et ainsi précipiter la struvite. 99% du phosphore dissous a alors été abattu. Le solide obtenu contenait 70% de struvite, un léger excès de phosphore et de magnésium, ainsi que de la matière organique. L'acidogénèse permet l'hydrolyse de la matière organique complexe et la formation d'acides organiques. De ce fait, ce procédé de recyclage du phosphore contenu dans le lisier porcin pourrait être implémenté dans les nombreuses unités de méthanisation présentes en Bretagne et qui traitent des effluents animaux ainsi que des déchets organiques d'origine agricole, industrielle et municipale. La struvite obtenue pourrait être vendue dans les régions ayant besoin de fertilisation phosphatée alors que la matière organique du digestat pourrait être maintenue en Bretagne. Un tel procédé réduirait significativement l'eutrophisation due à l'épandage excessif du lisier tout en diminuant les besoins en fertilisants minéraux fossiles grâce à une source alternative aux performances fertilisantes équivalentes

Phosphorus recovery from pig slurry through biological acidification and re-crystallization as struvite

International audiencePig slurry is a phosphorus-rich waste stream that requires costly physical/chemical and-or biological treatment, particularly in areas vulnerable to eutrophication. Swine slurry commonly undergoes a solid-liquid separation: the liquid fraction is spread in the neighbouring fields while the solid phase has to be exported, often as compost, to phosphorus-depleted regions. There is currently a growing trend towards phosphorus recovery under a purified, marketable form such as struvite, a slow-release mineral fertilizer. Recycling phosphorus as struvite could reduce the treatment costs of pig slurry and provide a renewable phosphorus source for agriculture. Indeed, the phosphate rock used in the fertilizer industry is a non-renewable resource whose decreasing quality and progressive depletion could threaten the fertilizer-based agricultural model and harm global food supply. Phosphorus in swine slurry mostly exists as mineral solids. It is now possible to extract this phosphorus as ortho-phosphate by acidification and recover it as struvite by adding magnesia (MgO). Biological acidification of swine slurry using waste-type co-substrates would be more environment-friendly than chemical acidification and save the costs of chemical addition. Sucrose was used as a practical co-substrate in order to realize a preliminary study of the biological and chemical reactions taking place during the acidification of pig slurry. A continuous reactor and batch tests were used to ascertain the link between the amount of sucrose added, the type/amount of volatile fatty acids (VFA) produced, the resulting pH drop and the dissolved phosphorus obtained. The batch tests consisted in 12 flasks, each containing raw swine slurry and four different amounts of sucrose in triplicate (0, 15, 30 and 60g/L). At maximum initial sucrose concentration the pH dropped from 7.5 to 5.5 after 2 days, while dissolved phosphates reached 800 mgPO4-P/L from 50 mgPO4-P/L initially. Lactate was the main VFA all along (70-95%). At lower sucrose concentrations, the pH either increased or dropped slightly before re-increasing. At 30g-sucrose/L, 420 mgPO4-P/L were measured after 2 days when a pH of 6.2 was reached. However those phosphates re-precipitated when the pH increased to 6.5 after 60 hours. Lactate was the main VFA during the first 40 hours but disappeared afterwards, simultaneously with the pH re-increase. The pattern in term of VFA production at the highest sucrose concentration was comparable to what occurs in successful silage. The initial amount of water soluble carbohydrates (WSC) (i.e. sucrose in this case) was high enough to give a competitive advantage to Lactic Acid Bacteria (LAB). They were able to acidify the slurry down to a pH too low for other microorganisms to metabolize the lactate into less acidic VFAs or other end-products. This resulted in a stable, low pH and a constant VFA concentration and composition. On the other hand, at sucrose concentrations lower than 60 g/L, the pattern of VFA production was similar to what occurs in spoiled silage. At such WSC concentration, the initial lactic acid production was not sufficient and other microorganisms were able to consume the lactic acid, resulting in a pH increase and a decrease in VFA concentration (possibly due to the beginning of methane production). The continuous reactor was maintained at 36°C and fed with sucrose and the supernatant of digested, centrifuged pig slurry, at a fixed hydraulic retention time of 4 days, during 30 days. The reactor stabilized after 4 days at a pH of 4.8 while the sucrose concentration in the influent was decreased from 150 to 40g-sucrose/L in the feed. Sucrose was mostly converted to lactate (60-95% of removed sucrose) throughout the study, indicating that the biological process similar to ensiling could be maintained during 30 days in a continuous reactor. The results obtained indicate that the biological acidification of pig slurry with high sucrose concentration (40-60g/L), leads to the dissolution of most of the phosphorus (700-900g/L, 70-80% of TP). The critical pH range in which phosphorus got dissolved was between 5 and 6. The biological process taking place had many similarities with ensiling, with lactic acid being produced predominantly. This ensiling-like process could be maintained in a continuous reactor for 30 days. Based on these findings, the choice of real co-substrates for biological acidification of swine slurry should be oriented towards WSC-rich wastes, like fruits, vegetables, grass, or crop-residues

Sequencing biological acidification of waste-activated sludge aiming to optimize phosphorus dissolution and recovery

Phosphorus (P) recovery in wastewater treatment plants (WWTP) as pure crystals such as struvite (MgNH4PO4.6H2O), potassium struvite (KMgPO4.6H2O) and calcium phosphates (e.g. Ca3(PO4)2) is an already feasible technique that permits the production of green and marketable fertilizers and the reduction of operational costs. Commercial crystallizers can recovery more than 90% of soluble P. However, most of the P in WWTP sludge is unavailable for the processes (not dissolved). P solubilization and separation are thus the limiting steps in P-crystallization. With an innovative two-step sequencing acidification strategy, the current study has aimed to improve biological P solubilization on waste-activated sludge (WAS) from a full-scale plant. In the first step (P-release), low charges of organic waste were used as co-substrates of WAS pre-fermentation, seeking to produce volatile fatty acids to feed the P-release by Polyphosphate-accumulating organisms, while keeping its optimal metabolic pH (6-7). In this phase, milk serum, WWTP grease, urban organic waste and collective restaurant waste were individually applied as co-substrates. In the second step (P-dissolution), pH 4 was aimed at as it allows the dissolution of the most common precipitated species of P. Biological acidification was performed by white sugar addition, as a carbohydrate-rich organic waste model, which was compared to chemical acidification by HCl (12M) addition. With short retention times (48-96 h) and without inoculum application, all experiences succeeded on P solubilization (37-55% of soluble P), principally when carbohydrate-rich co-substrates were applied. Concentrations from 270 to 450 mg were achieved

Dissolution of particulate phosphorus in pig slurry through biological acidification: A critical step for maximum phosphorus recovery as struvite

International audienceRecycling phosphorus as struvite from pig slurry requires an acidification step to dissolve the inorganic solids containing most of the phosphorus. This study focused on the biological acidification of several pig slurries using sucrose as a model organic co-substrate. Lactic acid fermentation occurred systematically, dissolving 60'90% of TP (total phosphorus) and T-Mg (total magnesium) at pH 6 or lower. Optimal pH range for maximum P dissolution aimed at struvite recovery was 5.5'6. A simple model was developed correlating pH, sucrose and buffer capacity to optimize P dissolution and future recovery using real organic waste. © 2017 Elsevier Lt

Phosphorus recycling potential assessment by a biological test applied to wastewater sludge

Phosphorus (P) recycling as mineral fertilizer from wastewater activated sludge (WAS) depends on the amount that can be dissolved and separated from the organic matter before the final crystallization step. The aim of the biological phosphorus dissolution potential (BPDP) test developed here was to assess the maximum amount of P that could be biologically released from WAS prior that the liquid phase enters the recovery process. It was first developed for sludge combining enhanced biological phosphorus removal and iron chloride. Because carbohydrates are known to induce acidification during the first stage of anaerobic digestion, sucrose was used as a co-substrate. Best results were obtained after 24-48 h, without inoculum, with a sugar/sludge ratio of 0.5 gCOD/gVS and under strict anaerobic conditions. Up to 75% of the total phosphorus in sludge from a wastewater treatment plant combining enhanced biological phosphorus removal and iron chloride phosphorus removal could be dissolved. Finally, the test was applied to assess BPDP from different sludge using alum compounds for P removal. No dissolution was observed when alum polychloride was used and less than 20% when alum sulphate was used. In all the cases, comparison to chemical acidification showed that the biological process was a major contributor to P dissolution. The possibility to crystallize struvite was discussed from the composition of the liquids obtained. The BPDP will be used not only to assess the potential for phosphorus recycling from sludge, but also to study the influence of the co-substrates available for anaerobic digestion of sludge

Short Article Hypothalamic bile acid-TGR5 signaling protects from obesity

International audienceBile acids (BAs) improve metabolism and exert anti-obesity effects through the activation of the Takeda G protein-coupled receptor 5 (TGR5) in peripheral tissues. TGR5 is also found in the brain hypothalamus, but whether hypothalamic BA signaling is implicated in body weight control and obesity pathophysiology remains unknown. Here we show that hypothalamic BA content is reduced in diet-induced obese mice. Central administration of BAs or a specific TGR5 agonist in these animals decreases body weight and fat mass by activating the sympathetic nervous system, thereby promoting negative energy balance. Conversely, genetic downregulation of hypothalamic TGR5 expression in the mediobasal hypothalamus favors the development of obesity and worsens established obesity by blunting sympathetic activity. Lastly, hypothalamic TGR5 signaling is required for the anti-obesity action of dietary BA supplementation. Together, these findings identify hypothalamic TGR5 signaling as a key mediator of a top-down neural mechanism that counteracts diet-induced obesity