The S4 pipeline runs continuously and checks the ASTRON Space weather page every minute for new solar observation data from the IDOLS system. It scans the available directories on the website, identifies the four most recent FITS files from the past hour, and compares them with the previously processed ones. If new files appear, the pipeline downloads them into a local temporary directory, loads their contents, merges the data, and reads the accompanying observational information. Once the full data set is prepared, it performs the necessary processing steps, generates visualizations, and saves both the processed results and the produced figures to designated output folders. After completing the cycle, it cleans up the temporary files and returns to a waiting state, allowing it to automatically react to every newly published set of observations on the server.
