What's new in Siril 0.99.4?

What’s new in Siril 0.99.4?

  • 32-bit native

The most important and especially the most awaited change is the switch to native 32-bit floating point for all calculations. The default FITS format is now of type TFLOAT. The files are therefore twice as large in size as before and the memory used is also twice as large. However, where one would have expected twice as long computation times, a lot of optimization work was done throughout the code. For comparison, on a machine with an I9 core, 32GB of DDR4 RAM (a good machine), a stack of 47 images takes 5min 24s with version 0.9.12 while only 2min01s are needed to stack 32bits images under 0.99.4. That makes Siril probably the fastest tool to process your astronomy images. (thanks @heckflosse :wink: )

  • New demosaicing algorithms.

With the introduction of 32-bit floating point in Siril, the need to completely review our demosaicing algorithms quickly became obvious. Indeed, these worked only in 16-bit.

9 new demosaicing algorithms have therefore been implemented in Siril. Of course, a user will rarely need to change this settings and therefore, choosing the default algorithm has been a crucial step. Our choice was done on the RCD algorithm : a very powerful algorithm for circular objects, such as stars. It produces images of the same quality as other software that uses the Bayer Drizzle technique. It replaces the VNG algorithm which was the default in Siril until version 0.9.12.


In this illustration (Siril / APP Comparison) Siril’s RCD algorithm is compared to different Bayer Drizzle results obtained with APP over a hundred images. Only the Bayer-Drizzle Point Kernel appears to have significantly higher resolution, however, this comes at the cost of a large introduction of noise that is generally not desirable and of course higher processing time.

  • Removed artifacts from X-TRANS sensors

These Fuji camera sensors are known to have artifacts when taking Bias or Darks images. Indeed, an uggly square pattern is visible in the image. An algorithm has therefore been introduced in order to remove this artifact. Either automatically during preprocessing, or from the command line before preprocessing.

  • FITS compression

It is now possible to work with compressed FITS. Compression can be lossy or lossless. Although the first option may scare the user, it is very difficult (impossible?) to notice a difference between an uncompressed image and one compressed with reasonable parameters. The preprocessing time can however be increased depending on the algorithms chosen.

  • Ha and Ha/OIII extraction

These new functions allow the direct extraction of Halpha or Halpha / OIII layers from non-demosaiced CFA images. This is very useful when using a Ha filter, or a new Duo Narrowband with a color camera.


preprocessed CFA image.

Extracted Ha layer

  • Linear Match function

Before compositing images taken with different filters (in the RGB composition tool for example), it is usually necessary to make them consistent with each other. Without it, the final image has a strong imbalance that is difficult to deal with. This is the goal of this new tool which takes a reference image as a parameter and transforms the loaded image to “match” the reference.

  • Sky background extraction applied to a sequence

Background extraction is something that needs to be done almost every time. Whether it’s from light pollution, the moon, or any other light source, the stacked image has a gradient that must be removed. This gradient is the sum of the gradients of each sub. However, the mount moves, the intensity and the position of the lighting change over time, etc. In fact, the final gradient is a complex sum of different gradients and therefore it can be quite difficult to remove it. To fix this issue, Siril allows the gradient to be automatically removed on each pre-processed image (to be done before registration). This creates a new sequence and the stacked image will be much easier to process, although background extraction may still be necessary.

  • Histogram transformation applied to the sequence

It is possible to apply the histogram transformation to the entire sequence. Only one button to do it.
mtf

  • New file format: Single FITS sequence file

The FITS format is a file format widely used in astrophotography. Developed by and for NASA, it is now well use by the amateur astrophotographer community.

What is less well known, however, is that it is possible to save multiple images into a single FITS file - such like a movie. Siril can now work with FITS files containing a sequence. To do this, simply select FITS sequence during the conversion, or during the pre-processing step. In scripts, this is the -fitseq option.

  • New deconvolution tool

The deconvolution tool has been completely rewritten. In addition to being now a “real-time” tool (with a preview), the algorithm is much more efficient and works with masks that are built automatically and transparently for the user. The stars are therefore much better protected and artefacts avoided.
deconv

  • New universal scripts

In versions of Siril prior to v0.99.4, scripts provided with the software were dedicated to DSLR only. Now scripts work regardless of the input image format (FITS or RAW). One also find scripts for extracting the Ha channel: at the end we end up with a monochrome image containing the signal Ha, or also a script for extracting Ha / OIII. This time we end up with two monochrome images Ha and OII.

  • Trying to make FITS file more standard

Finally I would like to end with the effort that we have tried to make the FITS file more standard in the amateur astrophotographer community by introducing a new FITS keyword. This keyword was quickly adopted by a lot of software (even PixInsight that has dropped the FITS support), showing that there was a need for it. To learn more about this new feature, you can read this page: https://free-astro.o…ITS_orientation

Of course, I introduced the main and funniest new features, but this version comes with a lot (a lot a lot …) of new features.

Hope you enjoy this thread, feel free to ask me about it.

Cheers,

6 Likes

Version 0.99.4 is available at the Siril PPA, right?

1 Like

Right

I can’t find it for macOS yet, in the official siril.org site. Which are the plans for the official release?

Already released.
https://www.siril.org/2020/08/13/siril-1-0-0beta/

But this was the beta. I’ve understood that the official version is different. Ok, I got it weeks ago.

Yes. 0.99.4 is the beta for the 1.0.0.

I think we will release 0.99.6 (beta 2) because I’ve fixed a bug. A very annoying bug.
But I don’t know when I will do it.

Hello, in this version 0.99.4, I can’t do the preprocessing with dark. As soon as I click on preprocessing (using a SER and a dark.fit), the program shut down.
If I try the same with 0.9, no pb.
Then I reopen the pp_xxx.seq and I can continue.

I tried many times with different .SER and different Darks.
Regards
Samuel

Do you try with monochrome file? Color file?
Do you debayer on-the-fly?

I tested with 0.99.5 with no problem but @vinvin made some changes.

I use a SER file coming from ZWO asi224mc. I did a SER file for the dark. I can create the dark.fit with 0.99.4 version.
I did nothing during the night. Just record raw data.
I have created the dark with median stack.
I open the SER and I check that dematrix is not selected. I select the dark.fit. I remove cosmetic correction. And after clicking on pre process, Siril shut down after 1-2 seconds without any message.
I don’t know where I can find a log

I have this issue from the first day I have installed 0.99.4

Is your dark.fit monochrome? (i.e single channel?)
Because you need it for preprocessing.

Yes. No dematrix when I create the dark.
The same things are working well on 0.9.
I use Windows 10

Could you try with this version ?
https://gitlab.com/free-astro/siril/-/jobs/735047803/artifacts/download

I will do it and come back to you. I understand you are french (as me) and I wonder in which forum you collect data for debug of the 0.99
Samuel

Tested after replacing all the files with your package. Same result. Immediate shut down

if you could share your master and your ser file please.

I have extracted only 20 pictures of the SER and export in a new SER file.
Here is the link to download the SER file and the dark.fit. I have checked, still an issue with only 20 pictures.
https://we.tl/t-PVlRjBagUp

Thanks for your help if I’m doing a wrong action in 0.99, but it works well in 0.9
Regards

It works here:

21:02:23: Preprocessing...
21:02:23: Created SER file pp_test_Siril.ser
21:02:23: Number of images allowed in the FITS write queue: 24 (zero or less is unlimited)
21:02:23: 42376 corrected pixels (0 + 42376)
21:02:23: Preprocessing: processing...
21:02:23: writer: Saving image 0, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 1, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 2, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 3, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 4, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 5, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 6, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: Sequence processing succeeded.
21:02:23: Execution time: 196.52 ms.
21:02:23: writer: Saving image 7, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 8, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 9, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 10, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 11, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 12, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 13, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 14, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 15, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 16, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 17, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 18, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: writer: Saving image 19, 1 layer(s), 1304x976 pixels, 16 bits
21:02:23: Saved 20 images in the sequence
21:02:23: Number of images allowed in the FITS write queue: 0 (zero or less is unlimited)
21:02:23: Sequence loaded: pp_test_Siril (0->19)
21:02:23: Closing sequence /home/cyril/Bureau/test_Siril/test_Siril