Research and Application on Spark Clustering Algorithm in Campus Big Data Analysis

Big data analysis has penetrated into all fields of society and has brought about profound changes. However, there is relatively little research on big data supporting student management regarding college and university’s big data. Taking the student card information as the research sample, using spark big data mining technology and K-Means clustering algorithm, taking scholarship evaluation as an example, the big data is analyzed. Data includes analysis of students’ daily behavior from multiple dimensions, and it can prevent the unreasonable scholarship evaluation caused by unfair factors such as plagiarism, votes of teachers and students, etc. At the same time, students’ absenteeism, physical health and psychological status in advance can be predicted, which makes student management work more active, accurate and effective

Earth reflectivity from Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Camera (EPIC)

Poster presented at 2017 AGU Fall Meeting, New Orleans, Louisiana. POSTER ID: A33D-2387Earth reflectivity, which is also specified as Earth albedo or Earth reflectance, is defined as the fraction of incident solar radiation reflected back to space at the top of the atmosphere. It is a key climate parameter that describes climate forcing and associated response of the climate system. Satellite is one of the most efficient ways to measure earth reflectivity. Conventional polar orbit and geostationary satellites observe the Earth at a specific local solar time or monitor only a specific area of the Earth. For the first time, the NASA’s Earth Polychromatic Imaging Camera (EPIC) onboard NOAA’s Deep Space Climate Observatory (DSCOVR) collects simultaneously radiance data of the entire sunlit earth at 8 km resolution at nadir every 65 to 110 min. It provides reflectivity images in backscattering direction with the scattering angle between 168º and 176º at 10 narrow spectral bands in ultraviolet, visible, and near-Infrared (NIR) wavelengths. We estimate the Earth reflectivity using DSCOVR EPIC observations and analyze errors in Earth reflectivity due to sampling strategy of polar orbit Terra/Aqua MODIS and geostationary Goddard Earth Observing System-R series missions. We also provide estimates of contributions from ocean, clouds, land and vegetation to the Earth reflectivity. Graphic abstract shows enhanced RGB EPIC images of the Earth taken on July-24-2016 at 7:04GMT and 15:48 GMT. Parallel lines depict a 2330 km wide Aqua MODIS swath. The plot shows diurnal courses of mean Earth reflectance over the Aqua swath (triangles) and the entire image (circles). In this example the relative difference between the mean reflectances is +34% at 7:04GMT and -16% at 15:48 GMT. Corresponding daily averages are 0.256 (0.044) and 0.231 (0.025). The relative precision estimated as root mean square relative error is 17.9% in this example

Generating global products of LAI and FPAR from SNPP-VIIRS data: theoretical background and implementation

Leaf area index (LAI) and fraction of photosynthetically active radiation (FPAR) absorbed by vegetation have been successfully generated from the Moderate Resolution Imaging Spectroradiometer (MODIS) data since early 2000. As the Visible Infrared Imaging Radiometer Suite (VIIRS) instrument onboard, the Suomi National Polar-orbiting Partnership (SNPP) has inherited the scientific role of MODIS, and the development of a continuous, consistent, and well-characterized VIIRS LAI/FPAR data set is critical to continue the MODIS time series. In this paper, we build the radiative transfer-based VIIRS-specific lookup tables by achieving minimal difference with the MODIS data set and maximal spatial coverage of retrievals from the main algorithm. The theory of spectral invariants provides the configurable physical parameters, i.e., single scattering albedos (SSAs) that are optimized for VIIRS-specific characteristics. The effort finds a set of smaller red-band SSA and larger near-infraredband SSA for VIIRS compared with the MODIS heritage. The VIIRS LAI/FPAR is evaluated through comparisons with one year of MODIS product in terms of both spatial and temporal patterns. Further validation efforts are still necessary to ensure the product quality. Current results, however, imbue confidence in the VIIRS data set and suggest that the efforts described here meet the goal of achieving the operationally consistent multisensor LAI/FPAR data sets. Moreover, the strategies of parametric adjustment and LAI/FPAR evaluation applied to SNPP-VIIRS can also be employed to the subsequent Joint Polar Satellite System VIIRS or other instruments.Accepted manuscrip

Implications of whole-disc DSCOVR EPIC spectral observations for estimating Earth's spectral reflectivity based on low-earth-orbiting and geostationary observations

Earth’s reflectivity is among the key parameters of climate research. National Aeronautics and Space Administration (NASA)’s Earth Polychromatic Imaging Camera (EPIC) onboard National Oceanic and Atmospheric Administration (NOAA)’s Deep Space Climate Observatory (DSCOVR) spacecraft provides spectral reflectance of the entire sunlit Earth in the near backscattering direction every 65 to 110 min. Unlike EPIC, sensors onboard the Earth Orbiting Satellites (EOS) sample reflectance over swaths at a specific local solar time (LST) or over a fixed area. Such intrinsic sampling limits result in an apparent Earth’s reflectivity. We generated spectral reflectance over sampling areas using EPIC data. The difference between the EPIC and EOS estimates is an uncertainty in Earth’s reflectivity. We developed an Earth Reflector Type Index (ERTI) to discriminate between major Earth atmosphere components: clouds, cloud-free ocean, bare and vegetated land. Temporal variations in Earth’s reflectivity are mostly determined by clouds. The sampling area of EOS sensors may not be sufficient to represent cloud variability, resulting in biased estimates. Taking EPIC reflectivity as a reference, low-earth-orbiting-measurements at the sensor-specific LST tend to overestimate EPIC values by 0.8% to 8%. Biases in geostationary orbiting approximations due to a limited sampling area are between −0.7% and 12%. Analyses of ERTI-based Earth component reflectivity indicate that the disagreement between EPIC and EOS estimates depends on the sampling area, observation time and vary between −10% and 23%.The NASA/GSFC DSCOVR project is funded by NASA Earth Science Division. W. Song, G. Yan, and X. Mu were also supported by the key program of National Natural Science Foundation of China (NSFC; Grant No. 41331171). This research was conducted and completed during a 13-month research stay of the lead author in the Department of Earth and Environment, Boston University as a joint Ph.D. student, which was supported by the Chinese Scholarship Council (201606040098). DSCOVR EPIC L1B data were obtained from the NASA Langley Research Center Atmospheric Science Data Center. The authors would like to thank the editor who handled this paper and the two anonymous reviewers for providing helpful and constructive comments and suggestions that significantly helped us improve the quality of this paper. (NASA Earth Science Division; 41331171 - key program of National Natural Science Foundation of China (NSFC); 201606040098 - Chinese Scholarship Council)Accepted manuscrip

Inverse altitude effect disputes the theoretical foundation of stable isotope paleoaltimetry

Stable isotope paleoaltimetry that reconstructs paleoelevation requires stable isotope (δD or δ18O) values to follow the altitude effect. Some studies found that the δD or δ18O values of surface isotopic carriers in some regions increase with increasing altitude, which is defined as an “inverse altitude effect” (IAE). The IAE directly contradicts the basic theory of stable isotope paleoaltimetry. However, the causes of the IAE remain unclear. Here, we explore the mechanisms of the IAE from an atmospheric circulation perspective using δD in water vapor on a global scale. We find that two processes cause the IAE: (1) the supply of moisture with higher isotopic values from distant source regions, and (2) intense lateral mixing between the lower and mid-troposphere along the moisture transport pathway. Therefore, we caution that the influences of those two processes need careful consideration for different mountain uplift stages before using stable isotope palaeoaltimetry

Colloidosomes constructed by the seamless connection of nanoparticles: a mobile and recyclable strategy to intelligent capsules

Colloidosomes constructed by the self-assembly of nanoparticles (NPs) on liquid-liquid interfaces have been demonstrated to be useful in many fields. However, the interspaces between NPs on the surface of colloidosomes barricade their application in small molecule encapsulation. Herein, fabrication of a new type of colloidosome built by the seamless connection of NPs via simply heating and quenching a type of core-shell structured NPs (CSNPs) aqueous system using oil as a template, is presented. These colloidosomes have a hollow structure and exhibit efficient small molecule encapsulation. More importantly, the colloidosomes can dissociate into single NPs and release the small target molecules encapsulated in interior of the colloidosomes at a temperature higher than the melting point of the CSNP shell. It is also shown that the dissociation temperature of colloidosomes can be controlled by simply adjusting the length of the PEG chains in the CSNP shell, which implies that these intelligent capsules have attractive application prospects in controlled drug release.National Natural Science Foundation of China[50873082, 30700020]; Research Fund for the Doctoral Program of Higher Education[20070384047]; Scientific and Technical Project of Fujian Province of China[2009J1009, 2010H6021, 2010J01306

Controls on Stable Water Isotopes in Monsoonal Precipitation Across the Bay of Bengal: Atmosphere and Surface Analysis

Stable hydrogen isotopes in monsoonal precipitation (δDp) at three sites (Port Blair, Barisal and Darjeeling) reveal the factors governing δDp variations over a south-north gradient across the Bay of Bengal. We found that the δDp at each site continuously decreases from May to September and these trends become more pronounced from south to north. The decreasing trends of downstream δDp closely follow the decreasing trends of upstream stable hydrogen isotopes in water vapor (δDv), which indicates that upstream δDv properties shape initial spatiotemporal patterns of the downstream δDp (“shaping effect”). Additionally, our results demonstrate that, during moisture transport, upstream vertical air motions (convection and downward motion) and topographic relief magnify the amplitude of the decreasing trends of downstream δD (“magnifying effect”). Our findings imply that upstream δD properties and relevant atmospheric and pv topographical conditions along the moisture transport pathway need to be considered collectively to better interpret paleoclimate records