New SVD based initialization strategy for Non-negative Matrix Factorization

There are two problems need to be dealt with for Non-negative Matrix Factorization (NMF): choose a suitable rank of the factorization and provide a good initialization method for NMF algorithms. This paper aims to solve these two problems using Singular Value Decomposition (SVD). At first we extract the number of main components as the rank, actually this method is inspired from [1, 2]. Second, we use the singular value and its vectors to initialize NMF algorithm. In 2008, Boutsidis and Gollopoulos [3] provided the method titled NNDSVD to enhance initialization of NMF algorithms. They extracted the positive section and respective singular triplet information of the unit matrices {C(j)}k j=1 which were obtained from singular vector pairs. This strategy aims to use positive section to cope with negative elements of the singular vectors, but in experiments we found that even replacing negative elements by their absolute values could get better results than NNDSVD. Hence, we give another method based SVD to fulfil initialization for NMF algorithms (SVD-NMF). Numerical experiments on two face databases ORL and YALE [16, 17] show that our method is better than NNDSVD

Comparative study on freeze-dried lactic cheese starters and ripening cultures for the production of camembert cheese : a thesis submitted in partial fulfillment of the requirements for the degree of Master of Food Technology, Massy [i.e. Massey] University, Albany, New Zealand.

Background and Methodology The key to success in producing cheeses is the performance of the starter cultures (Parente and Cogan, 2004). Storage of freeze-dried cheese cultures at refrigeration and ambient temperature or higher provides convenience to culture handling and transportation, as well as reduce cost. This study investigated the effects of 4 storage temperatures: -18°C, 4°C, 20°C and 37°C on the stability of mesophilic lactic cheese starters and ripening cultures intended for Camembert production. In phase one, a 22 randomized complete block design (RCBD) was used to determine the potential of 14 commercial freeze-dried direct-vat-set (DVS) mixed cultures to produce Camembert after 5 months storage at the 4 temperatures. The cultures used were: O-type: Lactococcus (L.) lactis subsp. lactis, L. lactis subsp. cremoris; LD-type: L. lactis subsp. lactis, L. lactis subsp. cremoris, L. lactis subsp. lactis biovar. diacetylactis and Leuconostoc species (Leuconostoc (Leuc.) lactis and Leuc. mesenteroides subsp. cremoris) and a mould, Penicillum (P.) camemberti. During storage, the cultures were analysed for cell viability, acid production, colour and species composition. The characterised cultures were screened to select the most stable cultures with good potential for Camembert production. In phase two, a 23 RCBD design was used to study the potential of the cultures to produce prototype Camembert cheese using I-Make® Limited domestic cheese kits. The prepared cheeses were characterised for acidity, viable cell counts content, texture, volatile aromatic compounds and proteolysis using standard procedures. Results and Discussion Viable cell counts and acidification potential of cultures decreased (P<0.05) during storage at selected temperatures for 5 months. Cultures stored at 37°C were the most affected. Proportion of citrate-fermenting lactic acid bacteria (LAB) in LD-type starters also decreased in a similar pattern. Cell inactivation at high temperature was probably attributed to high oxidation, browning reactions, lactose crystallization, changes in glass transition temperature (Tg) of culture-lactose matrix and loss of β-galactosidase enzyme activity, which were possibly also affected by water activity (aw) of the culture during storage (Higl et al., 2007; Kurtmann et al., 2009c). Viability and activities of cultures stored at 4 and 20°C after 5 months were comparable to those of -18°C cultures and levels normally used in industry. Thus, the cultures demonstrated good potential for Camembert cheese production. Similar patterns of microbial growth (LAB and P. camemberti) and acidification were observed in both cheeses (O- and LD-types) during cheese fermentation. However, cheeses fermented with O-type starters had better growth and acidification activity (P<0.05), which may be attributed to compositional differences of culture, leading to variable metabolic patterns (Mcsweeney and Fox, 2004). Cheeses produced with cultures stored at 4 and 20°C had lower levels of cell growth and acidity (P<0.05), suggesting that the microorganisms could have been affected by prolonged storage at relatively high temperatures. During cheese ripening, changes in microbial content, acidity, proteolysis, texture and aroma compounds, were similar, and significantly changed (P<0.05) with ripening time. Viable cell counts of LAB reduced, while pH and P. camemberti counts increased. Increase of pH may result from lactate metabolism by P. camemberti creating an alkaline environment due to the deamination activity of the mould (Spinnler and Gripon, 2004). Proteolysis of cheeses was correlated (P<0.05) with LAB and P. camemberti activity as well as the pH of Background and Methodology The key to success in producing cheeses is the performance of the starter cultures (Parente and Cogan, 2004). Storage of freeze-dried cheese cultures at refrigeration and ambient temperature or higher provides convenience to culture handling and transportation, as well as reduce cost. This study investigated the effects of 4 storage temperatures: -18°C, 4°C, 20°C and 37°C on the stability of mesophilic lactic cheese starters and ripening cultures intended for Camembert production. In phase one, a 22 randomized complete block design (RCBD) was used to determine the potential of 14 commercial freeze-dried direct-vat-set (DVS) mixed cultures to produce Camembert after 5 months storage at the 4 temperatures. The cultures used were: O-type: Lactococcus (L.) lactis subsp. lactis, L. lactis subsp. cremoris; LD-type: L. lactis subsp. lactis, L. lactis subsp. cremoris, L. lactis subsp. lactis biovar. diacetylactis and Leuconostoc species (Leuconostoc (Leuc.) lactis and Leuc. mesenteroides subsp. cremoris) and a mould, Penicillum (P.) camemberti. During storage, the cultures were analysed for cell viability, acid production, colour and species composition. The characterised cultures were screened to select the most stable cultures with good potential for Camembert production. In phase two, a 23 RCBD design was used to study the potential of the cultures to produce prototype Camembert cheese using I-Make® Limited domestic cheese kits. The prepared cheeses were characterised for acidity, viable cell counts content, texture, volatile aromatic compounds and proteolysis using standard procedures. Results and Discussion Viable cell counts and acidification potential of cultures decreased (P<0.05) during storage at selected temperatures for 5 months. Cultures stored at 37°C were the most affected. Proportion of citrate-fermenting lactic acid bacteria (LAB) in LD-type starters also decreased in a similar pattern. Cell inactivation at high temperature was probably attributed to high oxidation, browning reactions, lactose crystallization, changes in glass transition temperature (Tg) of culture-lactose matrix and loss of β-galactosidase enzyme activity, which were possibly also affected by water activity (aw) of the culture during storage (Higl et al., 2007; Kurtmann et al., 2009c). Viability and activities of cultures stored at 4 and 20°C after 5 months were comparable to those of -18°C cultures and levels normally used in industry. Thus, the cultures demonstrated good potential for Camembert cheese production. Similar patterns of microbial growth (LAB and P. camemberti) and acidification were observed in both cheeses (O- and LD-types) during cheese fermentation. However, cheeses fermented with O-type starters had better growth and acidification activity (P<0.05), which may be attributed to compositional differences of culture, leading to variable metabolic patterns (Mcsweeney and Fox, 2004). Cheeses produced with cultures stored at 4 and 20°C had lower levels of cell growth and acidity (P<0.05), suggesting that the microorganisms could have been affected by prolonged storage at relatively high temperatures. During cheese ripening, changes in microbial content, acidity, proteolysis, texture and aroma compounds, were similar, and significantly changed (P<0.05) with ripening time. Viable cell counts of LAB reduced, while pH and P. camemberti counts increased. Increase of pH may result from lactate metabolism by P. camemberti creating an alkaline environment due to the deamination activity of the mould (Spinnler and Gripon, 2004). Proteolysis of cheeses was correlated (P<0.05) with LAB and P. camemberti activity as well as the pH ofBackground and Methodology The key to success in producing cheeses is the performance of the starter cultures (Parente and Cogan, 2004). Storage of freeze-dried cheese cultures at refrigeration and ambient temperature or higher provides convenience to culture handling and transportation, as well as reduce cost. This study investigated the effects of 4 storage temperatures: -18°C, 4°C, 20°C and 37°C on the stability of mesophilic lactic cheese starters and ripening cultures intended for Camembert production. In phase one, a 22 randomized complete block design (RCBD) was used to determine the potential of 14 commercial freeze-dried direct-vat-set (DVS) mixed cultures to produce Camembert after 5 months storage at the 4 temperatures. The cultures used were: O-type: Lactococcus (L.) lactis subsp. lactis, L. lactis subsp. cremoris; LD-type: L. lactis subsp. lactis, L. lactis subsp. cremoris, L. lactis subsp. lactis biovar. diacetylactis and Leuconostoc species (Leuconostoc (Leuc.) lactis and Leuc. mesenteroides subsp. cremoris) and a mould, Penicillum (P.) camemberti. During storage, the cultures were analysed for cell viability, acid production, colour and species composition. The characterised cultures were screened to select the most stable cultures with good potential for Camembert production. In phase two, a 23 RCBD design was used to study the potential of the cultures to produce prototype Camembert cheese using I-Make® Limited domestic cheese kits. The prepared cheeses were characterised for acidity, viable cell counts content, texture, volatile aromatic compounds and proteolysis using standard procedures. Results and Discussion Viable cell counts and acidification potential of cultures decreased (P<0.05) during storage at selected temperatures for 5 months. Cultures stored at 37°C were the most affected. Proportion of citrate-fermenting lactic acid bacteria (LAB) in LD-type starters also decreased in a similar pattern. Cell inactivation at high temperature was probably attributed to high oxidation, browning reactions, lactose crystallization, changes in glass transition temperature (Tg) of culture-lactose matrix and loss of β-galactosidase enzyme activity, which were possibly also affected by water activity (aw) of the culture during storage (Higl et al., 2007; Kurtmann et al., 2009c). Viability and activities of cultures stored at 4 and 20°C after 5 months were comparable to those of -18°C cultures and levels normally used in industry. Thus, the cultures demonstrated good potential for Camembert cheese production. Similar patterns of microbial growth (LAB and P. camemberti) and acidification were observed in both cheeses (O- and LD-types) during cheese fermentation. However, cheeses fermented with O-type starters had better growth and acidification activity (P<0.05), which may be attributed to compositional differences of culture, leading to variable metabolic patterns (Mcsweeney and Fox, 2004). Cheeses produced with cultures stored at 4 and 20°C had lower levels of cell growth and acidity (P<0.05), suggesting that the microorganisms could have been affected by prolonged storage at relatively high temperatures. During cheese ripening, changes in microbial content, acidity, proteolysis, texture and aroma compounds, were similar, and significantly changed (P<0.05) with ripening time. Viable cell counts of LAB reduced, while pH and P. camemberti counts increased. Increase of pH may result from lactate metabolism by P. camemberti creating an alkaline environment due to the deamination activity of the mould (Spinnler and Gripon, 2004). Proteolysis of cheeses was correlated (P<0.05) with LAB and P. camemberti activity as well as the pH of samples. Softening of cheese was associated with increased proteolysis and pH due to the growth of P. camemberti (Spinnler and Gripon, 2004). A range of volatile organic compounds, dominated by fatty acids, alcohols and aldehydes were identified in cheese samples as reported in other studies (Sable and Cottenceau, 1999). Changes in 3-methylbutanal and 3-methylbutanol profiles of samples reflected the degradation of leucine,, synthesis of the aldehyde and its degradation to branched alcohols as a consequence of peptidolytic activity of LAB (Yvon and Rijene, 2001) and enzymatic activity of P. camemberti (Molimard and Spinnler, 1996). Increased concentrations of 2-heptanone, 2-nonanone and butyric acid in cheese samples suggested lipolytic activity in all samples (Molimard and Spinnler, 1996). The activity of P. camemberti involved in β-oxidation pathway for producing methyl ketones was also demonstrated confirmed by identified metabolites. Higher proteolysis and softness in LD-cheeses than O-type, suggested a higher degree of cheese ripening (Ardö, 1999), which may be attributed to proteolytic and peptidolytic activity of LD-starters (Tzanetaki et al., 1993). Higher proteolysis may be also associated with higher pH of cheese curd at draining, which facilitated higher syneresis. Increased whey content of curd may retain higher concentration of coagulant enzyme in the curd (Guinee and Wilkinson, 1992) and effectively stimulate the growth of P. camemberti, thus probably allowing proteolysis to occur more readily (Grappin et al., 1985). A relatively higher concentration of 3-methylbutanal was found in O-type cheeses than in LD-type. This suggests that LAB in O-type starters may exhibit higher activity in degrading leucine to 3-methylbutanal than LD-type starters (Yvon and Rijene, 2001). 2,3-butandione was suspected in LD-type cheeses but not in O-type samples, demonstrating the active role of citrate-fermenting bacteria of LD-starters (Mcsweeney and Fox, 2004). Results indicate that storage temperature of cultures had a significant (P<0.05) impact on viable cell counts and acidity of samples. In spite of reduced cell counts, proteolysis, texture and aroma of the prototype cheese samples were not affected (P<0.05). Although there were no differences between the Camembert cheeses, 4 and 20°C cultures used in cheese-making may enhance the ripening process (Ardö, 1999) than -18°C cultures, as indicated by relatively higher proteolysis and degree of softening. Lower levels of 3-methylbutanal in samples containing 4 and 20°C cultures was probably due to the reduced aminotransferases activity of LAB (Yvon and Rijene, 2001) after prolonged storage at the two temperatures. The slightly higher levels of 2-heptanone, 2-nonanone and butyric acids in samples with 4 and 20°C cultures were probably due to increased lipolytic activity of enhanced growth of P. camemberti (Molimard and Spinnler, 1996) during cheese ripening. Conclusion LAB starter cultures and P. camemberti can be stored for 5 months at 4 and 20°C without affecting their activities and the quality of prototype Camembert produced. Camembert cheese samples produced in this study had typical characteristics of this type of cheese. Cheese fermented with LD-type starters showed extra flavour enhancement potential and the products had higher degree of softening due pronounced proteolysis. Cultures stored at 37°C for 5 months were characterised by poor viable cells and capability to the produce acid, therefore, they were not suitable for Camembert cheese production

Word Sense Determination from Wikipedia Data Using Neural Networks

Many words have multiple meanings. For example, “plant” can mean a type of living organism or a factory. Being able to determine the sense of such words is very useful in natural language processing tasks, such as speech synthesis, question answering, and machine translation. For the project described in this report, we used a modular model to classify the sense of words to be disambiguated. This model consisted of two parts: The first part was a neural-network-based language model to compute continuous vector representations of words from data sets created from Wikipedia pages. The second part classified the meaning of the given word without explicitly knowing what the meaning is. In this unsupervised word sense determination task, we did not need human-tagged training data or a dictionary of senses for each word. We tested the model with some naturally ambiguous words, and compared our experimental results with the related work by Schütze in 1998. Our model achieved similar accuracy as Schütze’s work for some words