The Square Kilometre Array (SKA) will be both the largest radio telescope
ever constructed and the largest Big Data project in the known Universe. The
first phase of the project will generate on the order of 5 zettabytes of data
per year. A critical task for the SKA will be its ability to process data for
science, which will need to be conducted by science pipelines. Together with
polarization data from the LOFAR Multifrequency Snapshot Sky Survey (MSSS), we
have been developing a realistic SKA-like science pipeline that can handle the
large data volumes generated by LOFAR at 150 MHz. The pipeline uses task-based
parallelism to image, detect sources, and perform Faraday Tomography across the
entire LOFAR sky. The project thereby provides a unique opportunity to
contribute to the technological development of the SKA telescope, while
simultaneously enabling cutting-edge scientific results. In this paper, we
provide an update on current efforts to develop a science pipeline that can
enable tight constraints on the magnetised large-scale structure of the
Universe.Comment: Published in Galaxies, as part of a Special Issue on The Power of
Faraday Tomograph