Processing images at HiROC
Some of you out there may be asking: what happens to a HiRISE image between the time that it is taken and the time that it is released to the public? Well, I’d like to give a summary here.
- The image is taken by the HiRISE camera, and is stored in up to 28 channels, two for each of the 14 CCD arrays of the camera. Each channel covers about half of the image. Of the 14 CCDs, 10 are red CCDs, two are blue-green, and two are near-infrared. The color CCDs are aligned with the center red CCDs.
- The image is placed inside a buffer on MRO, awaiting transmission to Earth, along with science data from the other instruments on MRO.
- The image is received in packets by the Deep Space Network (DSN).
- After 4 hours of collecting data at the DSN, the Jet Propulsion Laboratory (JPL) puts the packets together for what is known as a “quick look”. The entire image generally has not yet been received by this point in time, but it is enough of the image that it can be processed to take a quick look at it. Subsequently, JPL puts together all of the data it has received every 4 hours and makes it available to the computers at HiROC.
- After the files have been put together by JPL, then one of the computers at HiROC looks and sees that there is data on the JPL server and copies the data to our system at HiROC. This is the start of what is known as the pipeline, the system of programs at HiROC which process the images. This usually happens either via a direct connection to JPL (slower), or through the Internet 2(Faster, but sometimes can be bogged down).
- The images are put together into a viewable format, using the minimum processing possible, and create what’s known as an EDR, or Experimental Data Record. This is done without calibration, stitching together the channels, or any other processing, aside from putting the image together. For an image which uses all 14 CCDs, there will be 28 EDRs. These generally speaking are of mainly scientific interest, but they will be released to the general public via the Planetary Database System (PDS). They will be in the standard PDS format.
- After the EDRs have been created, they are converted to another format for ISIS. ISIS, the Integrated Software for Imagers and Spectrometers is a suite of tools used for processing images for most interplanetary missions, that was developed by the United States Geological Society (USGS). Most of the tools that we use at HiROC for processing our images are written for ISIS files.
- After the ISIS files have been created, they are calibrated via a program called HiCal. This reduces the inherent noise of the camera to be more consistent with what is being photographed. All digital cameras create some level of noise, and while HiRISE is an extremely good instrument, it still generates a low level of noise.
- After the individual channels are calibrated, then they proceed to a program called HiStitch, which puts the two channels of the same CCD together. As they are a part of the same CCD, this requires little processing.
- Next, after each CCD been stitched together, the full CCD images run through a program called HiccdStitch. This program puts the different ccds together, making a mosaic for each color band. This requires some processing, as the ccds slightly overlap, and it can sometimes be difficult to match the different arrays exactly.
- If the image has not been completely received, then at this point, the pipeline stops, until JPL has received the entire image, or if there are a few confirmed gaps in the image which we haven’t been able to recover. Transmission over the vast distance between Earth and Mars is not easy, and even the best systems have some small error.
- After the image has been completely stitched together, then the image is geometrically projected. To understand this, realize that the images that HiRISE takes are flat, while Mars is actually round. Geometrical Projection alters the image so that the image points in compass directions, while correcting any distortions that are created by the ellipsoidal shape of Mars. With the geometrical projection images and the right software tools, such as qview for ISIS, the exact distance can be found between two point on the image. In order for this to happen, we must wait for information to be gathered on the exact position of the spacecraft. This is done by the nagivational team, based off of the downlink frequency. This takes two weeks after the picture has been taken, so Geometric Projection might take a while. This is the longest wait point of the operation. An image can be released from predicted information, however, most images will wait for the correct SPICE kernels to be calculated, in order to get the best information. If an image is geometrically projected from predicted information, it will be calculated with the correct info after it has been received.
- The images are then validated by a team of students known as the HiRISE Validators. They check to make sure that everything in the pipeline worked perfectly, see if there are any gaps in the images, and other similar tasks. If they notice a problem, they contact the HiRISE Operators, who will take steps to resolve the problems, which may include passing part or all of the image through the pipeline again, or tweaking the software to make it work perfectly.
- The image is converted to a format that the general public can use. Currently that format is JPG, or TIFF, but eventually we will use JPEG 2000.
- After all of this, the science team members of HiRISE will look at an image to see if there is anything noteworthy. If there is, it is given a caption, and perhaps a press release. If not, it will be posted on the HiRISE website. They are also posted on the MRO website, and occasionally on others.
This process may take as long as a week or two to complete, depending on the load of MRO, scheduling concerns, load at HiROC, etc. The first image took about 9 hours to be completely processed after it was taken by HiRISE. The Victoria Crater picture, taken during a much busier time on MRO, took about 36 hours to make its way to our hands. This was in part due to the larger size of the image, as well as the cache of images already awaiting transmission on MRO to earth. The captions for the images taken during Transition imaging took anywhere from a few hours to a few weeks to write, and this will likely continue to hold. We at HiROC want to release the images we take as fast as possible to the public, and we are doing everything we can to realize this goal. Several shortcuts were taken during the Transistion imaging phase that allowed for images to be released quicker. For Primary Science Phase, this will take a bit longer because these shortcuts will not be taken, but we expect that we will release most images within two weeks after them being taken, shortly after we have finished receiving, processing, and captioning the image.
There are some variations to this process, for example, the Victoria Crater picture was released in a press conference jointly with the Mars Exploration Rovers (MER) team. Also, color images require extensive calibration and take a lot more time. However, this is the general idea. Currently the entire system, except for writing the captions and adding the images to our website, is essentially completely automatic for receiving and processing HiRISE images, due to years of preparation by the HiTECH and HiOPS teams.


March 3rd, 2008 at 9:45 pm
March 3, 2008
I have been looking for an up-to-date list of steps and commands for ISIS 3 to process an image, in this case PSP_003234_2210, where we have ALL the raw data files. We would like to begin from these raw files and produce TWO final products. One is a “flat” color image and the other is a 3D version. We have seen 3D black and white versions of other HiRise images displayed and would like to know how this was done or how to use ENVI 4.4 for stereographic image input with necessary parameters to make a USGS DEM from a HiRise image if possible for importation into desktop 3D software like Bryce 5.
Any help would be appreciated.
We have already viewed:
http://www.lpi.usra.edu/meetings/lpsc2007/pdf/1779.pdf
http://isis.astrogeology.usgs.gov/IsisWorkshop/
http://www.planetary.org/explore/topics/mars_reconnaissance_orbiter/hirise_processing.html
I would appreciate an email reply for our team to me if possible.
Thank you very much in advance you folks are doing an excellent job and the recent data release is most welcome if overwhelming as you say so yourself. Faster pip-line processing and releases would make everyone happier.
Sincerely,
Robert H. Williams
2453 Route 11 Main St
Mooers, NY 12958
518-236-6733 -leave message
rhw007@twcny.rr.com
retired Clinton Community College Professor
also fall 2007 Mars Quest Challenge with image PSP_005824_2210 but all we have so far is a browse image with no ancillary data to compare to the four MGS MOCs we have of the object. We NEED all the data we have for our above image for the 2007 Quest image to do a proper analysis and write up.
March 5th, 2008 at 5:12 pm
[...] several days. Since these image are so different from our regular Mars images, our regular smooth pipelines are useless. Instead, everything has to be done by hand by our diligent downlink team. Fingers [...]
March 6th, 2008 at 12:55 pm
[...] article entitled “HiRISE Image Processing” based on Tuvas’ HiBlog post “Processing images at HiROC“. Both articles explain the EDRgen pipeline very [...]