To conclude our exploration of the pipelines that take raw channel files and create a beautiful, unmapped mosaic, let me introduce the Stitch pipelines: HiStitch and HiccdStitch.

The HiStitch pipeline combines the matching HiCal products for the same CCD into one more-or-less lined up CCD cube file. HiccdStitch combines these HiStitch cubes into RED, IR, and BG mosaics.

Both pipelines take some time, as overlapping pixels are accounted for and brought together. After these mosaics are created, additional steps create smaller jpeg files for easier viewing, and full-sized jpeg2000 files. We use these jpeg2000 files for validating our images.

There are later pipelines, but we first validate the HiccdStitch products: Did the previous pipelines work correctly? Did the uplink team command the camera correctly? Is there haze or clouds obscuring our view of the surface?

If everything looks good, and we have received the correct reconstructed SPICE ephemeris data, then the geometry pipelines are invoked. These pipelines project the images mathematically to a model of Mars and add geometry data to the images so that each pixel becomes a point on Mars with latitude and longitude coordinates.

The raw HiRISE image data needs to be cleaned up, and the HiCal pipeline is where this work is done. Now that the raw image data has been converted to a *.cub file format, ISIS tools can be used. These include hiclean, hipical, and hidestripe.

Hiclean does just what is says. Noise introduced into the image data by spacecraft electronics is corrected. Noise can show up as vertical and horizontal lines in the raw image and other periodic manifestations.

Hipical is a newer tool that performs calibration on the image data. For example, flatfield and gain corrections are performed by hipical. Hipical will be upgraded as we learn more about our instrument in its environment around Mars.

Hidestripe corrects a known striping pattern in HiRISE images.

We use other tools to collect even more statistical data about the newly calibrated image data. The HiCal pipeline will continue to be upgraded as our software matures. New statistics will be collected while corrections are added or improved.

After cleanup has been completed and a new *.hical.cub channel product created, HiCal creates a variety of jpeg browse and thumbnail images. The cleaned up channels are large, and for quick previews, these smaller jpegs come in handy.

Finally, HiCal lets the next pipeline – HiStitch – know that cleaned up channels are ready to be stitched together into CCD products.

Below is an example of raw data, prior to going through the HiCal pipeline. This image sample was taken from TRA_000873_1780; “Victoria Crater” at Meridiani Planum.

Below is the same image sample after going through the HiCal pipeline (notice that the bright vertical line in the center and the faint vertical lines throughout the image have been correctly removed by HiCal):

After a channel of raw data has been downloaded and converted into an *.IMG file, we need one more conversion before cleanup of the image can begin.

The EDR_Stats pipeline creates a *.cub file from the *.IMG file. These cube files are the file type used in ISIS 3.0, an image processing software package provided for planetary science missions by the United States Geological Survey (USGS). This package contains an entire suite of useful tools, many of which are used by our pipelines.

During the creation of a cube, a variety of statistics are gathered. For example, the number of gaps, saturated pixels, calibration pixels, and other pixels are counted. Image mean, standard deviation, and other statistics are also calculated. EDR_Stats takes these results and uploads them to our database. The resulting cube is archived in our storage directory.

The final EDR_Stats pipeline step lets the next pipeline – HiCal – know that an image channel cube file is ready for calibration processing. Let the cleanup of image data begin!

Some of you out there may be asking: what happens to a HiRISE image between the time that it is taken and the time that it is released to the public? Well, I’d like to give a summary here.

(more…)