Compression of interferometric radio-astronomical data

The volume of radio-astronomical data is a considerable burden in the processing and storing of radio observations with high time and frequency resolutions and large bandwidths. Lossy compression of interferometric radio-astronomical data is considered to reduce the volume of visibility data and to speed up processing. A new compression technique named "Dysco" is introduced that consists of two steps: a normalization step, in which grouped visibilities are normalized to have a similar distribution; and a quantization and encoding step, which rounds values to a given quantization scheme using a dithering scheme. Several non-linear quantization schemes are tested and combined with different methods for normalizing the data. Four data sets with observations from the LOFAR and MWA telescopes are processed with different processing strategies and different combinations of normalization and quantization. The effects of compression are measured in image plane. The noise added by the lossy compression technique acts like normal system noise. The accuracy of Dysco is depending on the signal-to-noise ratio of the data: noisy data can be compressed with a smaller loss of image quality. Data with typical correlator time and frequency resolutions can be compressed by a factor of 6.4 for LOFAR and 5.3 for MWA observations with less than 1% added system noise. An implementation of the compression technique is released that provides a Casacore storage manager and allows transparent encoding and decoding. Encoding and decoding is faster than the read/write speed of typical disks. The technique can be used for LOFAR and MWA to reduce the archival space requirements for storing observed data. Data from SKA-low will likely be compressible by the same amount as LOFAR. The same technique can be used to compress data from other telescopes, but a different bit-rate might be required.Comment: Accepted for publication in A&A. 13 pages, 8 figures. Abstract was abridge

A morphological algorithm for improving radio-frequency interference detection

A technique is described that is used to improve the detection of radio-frequency interference in astronomical radio observatories. It is applied on a two-dimensional interference mask after regular detection in the time-frequency domain with existing techniques. The scale-invariant rank (SIR) operator is defined, which is a one-dimensional mathematical morphology technique that can be used to find adjacent intervals in the time or frequency domain that are likely to be affected by RFI. The technique might also be applicable in other areas in which morphological scale-invariant behaviour is desired, such as source detection. A new algorithm is described, that is shown to perform quite well, has linear time complexity and is fast enough to be applied in modern high resolution observatories. It is used in the default pipeline of the LOFAR observatory.Comment: Accepted for publication in A&

Post-correlation radio frequency interference classification methods

We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95% recognition and an approximately 0.1% false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest.Comment: 14 pages, 12 figures (11 in colour). The software that was used in the article can be downloaded from http://www.astro.rug.nl/rfi-software

Post-correlation filtering techniques for off-axis source and RFI removal

Techniques to improve the data quality of interferometric radio observations are considered. Fundaments of fringe frequencies in the uv-plane are discussed and filters are used to attenuate radio-frequency interference (RFI) and off-axis sources. Several new applications of filters are introduced and tested. A low-pass filter in time and frequency direction on single baseline data is successfully used to lower the noise in the area of interest and to remove sidelobes coming from unmodelled off-axis sources and RFI. Related side effects of data integration, averaging and gridding are analysed, and shown to be able to cause ghosts and an increase in noise, especially when using long baselines or interferometric elements that have a large field of view. A novel projected fringe low-pass filter is shown to be potentially useful for first order source separation. Initial tests show that the filters can be several factors faster compared to common source separation techniques such as peeling and a variant of peeling that is currently being tested on LOFAR observations called "demixed peeling". Further testing is required to support the performance of the filters.Comment: 18 pages, 20 figures, accepted for publication in MNRA

A new strategic framework for water-related health research

The aim of this study was to compile a new strategic framework to guide the funding and management of research in waterrelated human health in South Africa. This framework had to identify the research areas of highest need in the country and provide an effective, yet simple, tool for the management of research projects. A review of current water-related human health research was first undertaken. Using this review as background document, input was solicited from key people in Government, water boards, metro councils, science councils and universities. As part of the study, the country’s research support infrastructure for water-related health research was investigated. The framework was finalised at a stakeholder workshop. A structure of Thrust Areas, with Programmes under each Thrust Area, was suggested for research management and funding. A matrix system of research thrusts versus impacts/risks, interventions and governance was further constructed to assist in the identification of research gaps, rendering the framework a very useful tool in the funding and management of water-related human health research.Keywords: water, public health, research needs, research managemen

Local phytochrome signalling limits root growth in light by repressing auxin biosynthesis

NWO14212Plant science

PDK1 regulates auxin transport and Arabidopsis vascular development through AGC1 kinase PAX

The PDK1 lipid-dependent kinase controls PINs and auxin transport through a phosphorylation cascade that includes AGC-type kinase PAX. The double pdk1 mutant reveals auxin-related phenotypes in vascular development.The 3-phosphoinositide-dependent protein kinase 1 (PDK1) is a conserved master regulator of AGC kinases in eukaryotic organisms. pdk1 loss of function causes a lethal phenotype in animals and yeasts, but only mild phenotypic defects in Arabidopsis thaliana (Arabidopsis). The Arabidopsis genome contains two PDK1-encoding genes, PDK1 and PDK2. Here, we used clustered regularly interspaced short palindromic repeat (CRISPR)/CRISPR-associated protein 9 (Cas9) to generate true loss-of-function pdk1 alleles, which, when combined with pdk2 alleles, showed severe developmental defects including fused cotyledons, a short primary root, dwarf stature and defects in male fertility. We obtained evidence that PDK1 is responsible for AGC1 kinase PROTEIN KINASE ASSOCIATED WITH BRX (PAX) activation by phosphorylation during vascular development, and that the PDK1 phospholipid-binding Pleckstrin Homology domain is not required for this process. Our data indicate that PDK1 regulates polar auxin transport by activating AGC1 clade kinases, resulting in PIN phosphorylation.Plant science

Auxin Binding Protein 1: A Red Herring After All?

Plant science