DeTeCt quick user guide
(based on version 3.2.3, Aug. 29, 2020, by Marc Delcroix)

Detect software is the tool to support the impact flashes detection project, aiming at:
- analyzing Jupiter and Saturn videos to look for potential flashes provoked by small bodies impacts
- collecting the results of these analyses wether successful or not (dates, impact found) to estimate the frequency of impacts on the giant planets (which has an impact on refining the age of bodies in this part of the solar system by counting craters on their surface)
- discovering as many impacts as possible to refine the physical characteristics of these impactors (size, composition) as well as the energy and components released int the giant planets' atmosphere


Download latest version of DeTeCt software at the project github repository.

Basic usage

GUI guide

Detection images check tutorial

Multi-instances mode


Basic usage

DeTeCt GUI 101
1. Ensure autoprocessing is checked to have impact detection starting automatically when folder or file is selected

2. Choose folder (all acquisition files with supported format found recursively in this folder will be selected for impact detection), or directly a single file

3. Check detection images and send results: 3 windows will be opened:
- an explorer where are the detection images to be checked (see tutorial for help) :
folder with detection images to check

- an explorer where is the zip file to send to the project :
folder with zip file to send

- an email, you should attach the zip file to it (by drag and drop for example) before sending it to
delcroix.marc at free.fr
email, attach zip file before sending

4. - gives you the number of potential impacts detected on all files processed, according to their probability (Null, Low or High)



GUI guide
GUI full legend


Detection images check tutorial

Detection images are generated in a folder named "Impact_detection_run@rundate_runtime". There is one "dtc_mean.jpg" image, mean of the aligned acquisition images, and a "dtc_max-mean.jpg" image where each pixel is its maximum brightness minus its mean brightness of all frames.
This "max-mean" image aim is to show any transient bright phenomena. A blue cross will show the brightest point in this detection image, and potentially a yellow cross showing the area where the differential photometry algorithm identified a potential impact flash.
Additionaly in the GUI, and in detect log, you will find a rating (Null, Low or High) measuring the probability of an impact, followed when relevant by a frame number corresponding when this possible event is visible. Examples: Null ; Low ; HIGH (@ 3231). For the high probability impacts, you have also a confidence number, the higher the better.
You need to look at those images, to see visually if there is anything suspect for you. With a bit of experience, you will do that in one or two seconds, you have below some examples to help you interpret those images.


Explantion dtc_max-mean.jpg "detection image"
dtc_mean.jpg image
2019-08-07 impact discovered by Ethan Chappel thanks to DeTeCt

Detection is obvious, both crosses are centered around a bright patch in max-mean image,
while nothing special is identified in the mean image at this location.

Confidence/Rating = 8.3875    HIGH (@ 9282)

2016-03-17 impact observed by John Mc Keon

Detection is obvious allthough on the limb. Both crosses are centered around a bright patch in max-mean image, while nothing special is identified in the mean image at this location.

Confidence/Rating: 14.0570    HIGH (@ 1167)

2017-05-26 impact discovered by Sauveur Pedranghelu

The differential photometry algorithm did not detect the impact properly (no yellow cross).
Nonetheless the brightest point in the image looks quite suspicous, it is spread over a few pixel, with some less bright pixels around. Nothing is seen at this area in the mean image. Here the direct analysis of the video proves that a flash was captured.

Confidence/Rating: 0.0000    Low
2010-08-20 impact observed by Kazuo Aoki

The differential photometry algorithm did not detect the impact properly (no yellow cross).
Furthermore, the brightest point of the detection image is not the impact flash (located a bit left and below the center of the planet), but on Ganymede on the top left corner of the image (as seen in the mean image)


Confidence/Rating: 0.0000    Low
Satellite shadow transit

The slow move of the shadow of Io on Jupiter globe hide a part of the planet which then appears bright in the max - mean detection image.

No impact here.
Confidence/Rating: 0.0000    Null
Bright pixel(s)

The differential photometry algorithm did not detect anything (no yellow cross).
The brightest part of the detection image is pnly a couple of fully saturated pixels, looking really artificial. A careful look at the video show that this is due to bright pixels only present on a couple of frames. This is due either to temporary hot pixels, or a cosmic ray event.


No impact here.
Confidence/Rating: 0.0000    Low 
Dust mole

The differential photometry algorithm did not detect anything (no yellow cross).
There are strange bright circles on the detection images, looking at the mean image reason is obvious: two dust moles, at different places due to the move of the planet on the sensor, are present. They hide part of the planet, for which the substraction of the mean image to the max imagemakes them bright.

No impact here.
Confidence/Rating: 0.0000    Low 
Artifact

The differential photometry algorithm did not detect anything (no yellow cross).
The brightest part is detected in the detection image is "pixellized", on the limb where several bright areas appear in this kind of image, when alignment or seeing is not so good.
This has no real explanation, this is only an artifact generated during processing.

No impact here.
Confidence/Rating: 0.0000    Low 
No outstanding bright area

The differential photometry algorithm detected something not obviously spread and birght, same for the brightest part of the image. Both are totally separated. No detection was made here, rating is Null.

No impact here.
Confidence/Rating: 1.4782    Null 
No outstanding bright area

The differential photometry algorithm did not detect anything (no yellow cross).
The brightest part is detected in the detection image is "pixellized", where several bright areas appear in this area (NEB).
There is no real explanation, this is only an artifact generated during processing
, rating is Null.

No impact here.
Confidence/Rating: 0.0000    Null
Dark zone generating pixellized bright area

The differential photometry algorithm did not detect anything (no yellow cross).
The brightest part is detected in the detection image is well spread but really "pixellized", at a place where very dark feaston lies in the mean image.
The seeing/alignment probably made probably this dark zone move, generating a bright area in  the detection image. A careful look ar the original video did not show anything suspect, and
, rating is Null.

No impact here.
Confidence/Rating: 0.0000    Null
Bright area in the rings

In this Saturn acquisition, both the differential photometry algorithm and the brightest area in detection image are a close match.
But this is in the rings, between brighter B ring and darker C ring, where turbulence moved the appareance from bright to dark.
Looking at the original video around the frame specified, nothing suspect was found
.


No impact here.
Confidence/Rating: 0.4497    Low  (@  915)

As a conclusion, after running detect:

- always check the detection images using this tutorial, to interpret the detection image and see if you have discovered an impact.
For that you can open the first image in the "Impact_detection_run@rundate_runtime" folder in your acquisition folder, analyze it and click right arrow to see the other ones
- focus on "high" and "low" probability detections
- in case of doubt, check the mean image, the ephemeris for a transiting satellite or shadow, have a deeper look at your original video (AutoStakkert! or SER Player can read the acquisitions frame by frame).
If a frame number was specified in the log file, have a deeper look around that place in the acquisition video.
- always send the generated zip file to delcroix.marc at free.fr, we will have another look at your images
- even if you found nothing, always send the generated zip file to delcroix.marc at free.fr, no detection matters and has high value to help us to estimate the frequency of impacts on Jupiter and Saturn
- do not erase your videos till you got an acknowledgment from me that we had a look at your results.
Precious scientific studies were made by analyzing the lightcurves of impact flashes discovered/observed by amateur astronomers.

-
If you are lucky enoough to detect an impact, please inform me. Send your files generated by DeTeCt, and make your acquisition file available.
Prepare also for a temporary celibrity, once announced to all international amateur community, medias, web sites, the pros will contact your to get more info, this is everything I wish for you!


Happy impact hunting!

 

Performance and multi-instances mode

Starting with v3.2.3, DeTeCt supports a multi-instance mode, aiming at reducing the total processing time. While the software does not process a single acquisition file with several parallel threads to take advantage of multi-processors CPUs, it can launch several instances of itself to process in parallel several acquisition files. Principle is to have a parent instance, the first one launched, both processing files and collecting the results of hidden instances (with no graphical user interface displayed).

The absolute maximum number of instances is fixed to the number of processors (physical or virtual) of your machine, but you can choose the maximum number of instances you want to have with the corresponding arrows in the GUI top right corner. Then detect will run as many instances needed to process all selected files, respecting the maximum number your defined. For example let's imagine you have a 12 core machines, you choose a maximum number of 9 instances, and select a folder with 24 files to process. The software will initially launch 8 additionnal instances to have 9 in total processing the files. Once 16 files has been processed, there will be only 8 total instances running to process the 8 files left, then 7, etc. down to the last one.

Selecting this maximum number of instances might be a bit tricky has it depends on your configuration. Here are tests results on my configuration (i7 12 cores, 24GB RAM) :

On a normal 7200rpm hard drive (HD):
Multi-instances tests on HD

We can see that with 3 instances running in parallel, we have a 37% gain in processing time. Then the time reduces a bit more, to increase again a bit when more than 8 processors are used. Looking at hard drive and processor usage with windows task manager, I could see that with one instance running, the HD is used at 15% capacity while the processor used at maximum capacity, and with 4 instances, the HD and the 4 processors are used close to maximum capacity. Increasing after the number of processors makes each instance use less than the maximum processor capacity while the hard drive does its best despite being the limiting factor. Starting at 7 instances, the hard drive access from so many instances makes the total computing time increase again.
In that case, I consider the optimum number of instances is 4 : the best processing time with the lowest number of instances (to avoid too many HD parallel access which put strains on the hardware).
The computing time is here 1.7x faster with 4 instances.

On a Solid State Drive (SSD):
Multi-instances tests on SSD
In a case of having the acquistion files stored on a SSD, read write access is not a limiting factor: even with the maximum of instances running, the SSD usages peaks only at 15% usage. Nonetheless above 9 instances used, the total computing time do not decrease: computing power is the limiting factor.
In that case I consider that 9 instances is the optimimum number of instances to use, the rest of the computing power being used by the operating system and other applications running.
The computing time is here 5.7x faster with 9 instances !

Some additional tips:
- you can reduce a bit (5 to 10%) computing time by activating the save of session files in autostakkert (menu advanced->Save sessions next to each stack): then DeTeCt will use the alignment information the session files store, to avoid realigning all frames.
- you can dynamically reduce or increase the maximum number of instances, in case you need more power for other tasks, or on the contrary you want to use as much computing power as possible for impact detection. Beware though, the number of running instances only changes slowly, decreasing when an instance has finished computing an acquisition file, or increasing after several seconds when the parent instance checks for changes in the number of instances.