El Nino Southern Oscillation (ENSO) is the dominant mode of climate variability in the Pacific, having socio-economic impacts on surrounding regions. ENSO exhibits significant modulation on decadal to inter-decadal time scales which is related to changes in its characteristics (onset, amplitude, frequency, propagation, and predictability). Some of these characteristics tend to be overlooked in ENSO studies, such as its asymmetry (the number and amplitude of warm and cold events are not equal) and the deviation of its statistics from those of the Gaussian distribution. These properties could be related to the ability of the current generation of coupled models to predict ENSO and its modulation. Here, ENSO's non-Gaussian nature and asymmetry are diagnosed from in situ data and a variety of models (from intermediate complexity models to full-physics coupled general circulation models (CGCMs)) using robust statistical tools initially designed for financial mathematics studies. In particular alpha-stable laws are used as theoretical background material to measure (and quantify) the non-Gaussian character of ENSO time series and to estimate the skill of "naive" statistical models in producing deviation from Gaussian laws and asymmetry. The former are based on non-stationary processes dominated by abrupt changes in mean state and empirical variance. It is shown that the alpha-stable character of ENSO may result from the presence of climate shifts in the time series. Also, cool (warm) periods are associated with ENSO statistics having a stronger (weaker) tendency towards Gaussianity and lower (greater) asymmetry. This supports the hypothesis of ENSO being rectified by changes in mean state through nonlinear processes. The relationship between changes in mean state and nonlinearity (skewness) is further investigated both in the Zebiak and Cane (1987)'s model and the models of the Intergovernmental Panel for Climate Change (IPCC). Whereas there is a clear relationship in all models between ENSO asymmetry (as measured by skewness or nonlinear advection) and changes in mean state, they exhibit a variety of behaviour with regard to alpha-stability. This suggests that the dynamics associated with climate shifts and the occurrence of extreme events involve higher-order statistical moments that cannot be accounted for solely by nonlinear advection