UC SAN DUw he wW** UNIVERSITY OF CALIFORNIA, SAN DIEGO October 1991 MS GROUP 3 1822 044297448 TE NO. 230 Offsite (Annex-Jo rnals) QC 974.5 . T43 no. 230 WSI Processing Manual M. L. Ciandro UNIVERSITY OF CALIFORNIA SAN DIEGO CRSITO BASO CALIFO US 1868 **Gece The material contained in this note is to be considered proprietary in nature and is not authorized for distribution without the prior consent of the Marine Physical Laboratory. SCRIPPS INSTITUTION OF OCEANOGRAPHY MARINE PHYSICAL LAB San Diego, CA 92152-6400 UNIVERSITY OF CALFON, SAN 0E00 --- -- - -- 3 1822 04429 7448 TABLE OF CONTENTS 1.0 Introduction ..... 2.0 Data Tape Quality Assessment ........... 2.0.1 Enter Field Tape into Data Base ................... 2.1 The TAPEQC Program ........ 2.1.1 Checks Performed by TA 2.2 TAPEQC Program Execution... 2.2.ì Files Created by TAPEQC.... 2.3 DGN Program..... 2.3.1 DGN Output Files ..................... 2.3.2 The Special Use Files .... 2.3.3 Description of Diagnostic Error Summary Entries 2.4 TAPEQC and DGN File Screening Procedures ......... 2.5 Post TAPEQC Procedures .... 2.6 Data Tape Copy and Labelling .............. 3.0 Ratio Processing Preparation ..... 3.1 CHECKLAN Program ..... 3.1.1 Example of the CHECKLAN File Created ... 3.2 Example of VERSION.LOG file.. Example of DATEX.LST file ....... Example of OCCx.DAT file .. 3.5 Example of TIMEX.COR file .. تب تم تب در 3.4 4.0 TAPRATPL Program ................... 4.1 To Execute .. 4.1.1 Condensed Sample of TAPRATPL Output File: .DGN (Ten Minute Images) ......... 4.1.2 Condensed Sample of TAPRATPL Output File: .DGN (One Minute Images). 4.1.3 TAPRATPL Log File Entry Description........... 4.1.4 Condensed Sample of TAPRATPL Output File: .LOG. 5.0 6.0 CLDDECM Program (Fixed Thresholds). 5.1 To Execute .... 5.1.1 Condensed Sample of CLDDECM Output File: .CVR 5.2 EXQC Program ...... 5.2.1 To Execute ...... Cloud Decision (Variable Threshold) Preparation .... 6.1 GETREF Program .. 6.1.1 To Execute ..... 6.2 SETREF Program ....... 6.2.1 To Execute .................... CMPDECTP Program (Variable Thresholds) ..... 7.1 To Execute ......... 7.1.1 Condensed Sample of CMPDECTP Output File: .CCV 7.0 8.0 Utilities :................... 8.1 IMFIND Program ... 8.1.1 To Execute ... 8.2 EXBACK Program 8.2.1 EXBACK Using the Menu ......... 8.2.2 EXBACK Using the Command Line. . EXRCVR Program ..... 8.3.1 EXRCVR Using the Menu ....... 8.3.2 EXRCVR Using the Command Line ..... 8.4 EXCOPY Program..................... 8.4.1 To Execute ...... 8.4.2 Condensed Sample of Screen Output and EXCOPY Output File: .CPY ...... 8.5 WRIMGS Program ..... 8.5.1 To Execute .......................... 8.5.2 Detailed Description of the Options Available ... 9.0 Acknowledgements Appendix A......... Appendix B.... LIST OF FIGURES Fig. # 3-1 Figure Title Selecting the proper occultor arm mask ......... Determining the best angle for the occultor arm mask .. 3-2 3-3 Determining whether the sun is visible ... Jo vlllIIlIITS WIICUTE LI SUIT IS VISIUIO. . . . . . . . . . . . . . . . . . . . . . . . . 3-4 6-1 6-2 Determining the best sun position ......... Normal curve for a clear day (winter season) ..... Curve representing a clear morning and late afternoon - cloudy between 1800 - 2100 GMT. ............... Curve representing a mostly cloudy day - Reference values from a clear day (10 Dec) were used .... 6-3 1.0 INTRODUCTION This manual is a step by step guide to the processing of the radiance image (raw field) tape from the time it is received at MPL through the cloud/no cloud decision processing. It contains a brief description of the programs used and step by step instructions on how to use them. A more detailed description of the program's logic is found in Tech Note 231. Excluded from this manual is the description of the Calibration files that are used in the RATIO processing. This description can also be found in Tech Note 231. This manual is written so that the entries that must be made by the user are in the Bold Italic font and screen output is in the Courier font. 1.1 Processing Steps inntrion Check the raw field tape in. Run TAPEQC and DGN programs. Screen the program results and make a quality assessment. Back up TĀPEQC and DGN output files with EXBACK. Make a backup copy of the raw field tape with EXCOPY. Label and add the tapes to the data base and copy archive. Pre-Ratio Preparation. A. Run CHECKLAN program. B. Create files: 1. VERSION.LOG 2. DATEX.LST 3. OCCx.DAT 4. TIMEX.COR C. Get the necessary Calibration files. Run the ratio program TAPRATPL. Run the Cloud/No Cloud decision programs. A. Run cloud decision program CLDDECM (One minute only - Fixed Thresholds) B. Run the EXOC program to check the CLDDECM output tape. or C. Cloud decision (Variable Threshold) Preparation. 1. Run the GETREF program. 2. Run the SETREF program to determine thresholds. D. Run cloud decision program CMPDECTP (One or Ten minute Variable Thresholds) 2.0 DATA TAPE QUALITY ASSESSMENT Since the WSI data were being collected from several sites around the country and with limited on- site supervision, it was important to develop a procedure to perform diagnostic checks on the field tapes when they arrived at MPL. This enabled us to assess data quality and system performance, so that the necessary corrective action (if any) could be performed in a timely manner. The only required input to this step is the radiance image data (raw field) tape. 2.0.1 Enter Field Tape into Data Base A tape is received from the stations approximately once a week. It contains data from seven days unless something unusual happens; i.e. power outages or mechanical problems. Each station has been assigned a 3 letter Station ID as well as a 1 digit Station number. These are given in the following table: Station Number Station ID Location MPL ovau AWN WSC WSH KAA CLA MAG BAR COL CMP POR Marine Physical Laboratory, San Diego, CA C-Station, White Sands Missile Range, NM HELSTF, White Sands Missile Range, NM Kirtland AFB, Albuquerque, NM China Lake NWC, CA Malmstrom AFB, Great Falls, MT Malabar Tracking Facility, FL National Weather Service Office, Columbia, MO Composite System, San Diego, CA Portable System, various locations Each station has a log book which contains a summary of the pertinent information for each tape. The tape sequence numbers for each station begin with 001. As each tape comes in from a station it must be assigned a tape identification number which consists of the 3 letter Station ID and the next available sequence number for that station (LLL###, COL051). Handwrite a label for the tape. In the station log book and the inside jacket of the ExaByte tape case write the tape id number and the date that the tape was received. Tapes are assigned sequential numbers even if they are received out of date order. Make sure the WRITE PROTECT TAB is closed. 2.1 The TAPEQC Program The TAPE ogram (and its predecessor READTPQC) provides the diagnostic information needed for the data quality and system performance assessments. Tech. Memo AV88-046t and 58t provide brief descriptions of the REAÕTPQC program which was used with the prior version of e. Several features were added to the current version of TAPEQC. This manual presents the current version because it would be applied to any new field tapes. 2.1.1 Checks Performed by TAPEQC Information from every image on a FIELD tape is examined by TAPEQC. The frequency and extent of the checking procedures applied to a given image depend on the image type TAPEQC examines the header information on each of the one-minute, subset resolution images. Two types of checks are made: those indicating timing inconsistencies, or those pertaining to the filter wheel movement and the flux control procedures. The program expects the time to proceed forward in one minute increments. Times skips ahead of greater than one minute and backward time skips are noted. Time source changes between BIOS and WWV clocks are also flagged. TAPEQC also verifies the spectral filter sequence for the four quadrants. If the sequence is out of order, the program reports a spectral error. TAPEQC senses the IRIS character string for special character combinations that indicate any of the following: the spectral filter wheel could not be placed in the proper position, the neutral density filter wheel could not be placed in the proper position, or the flux control routine in the FIELD program was unable to converge on a solution in The time allotted. All the checks described above for the one-minute images are also performed on each ten-minute, full resolution image. TAPEQC also checks if the Iris is fully closed when the neutral density buffering is activated. If not, the Iris may need to be repaired. For every sixth ten-minute image encountered (hourly under normal operating conditions), TAPEQC performs dark signal and onscale checks and records the temperature inside the camera housing, if available. The dark scale checks are made by averaging 6x6 pixel arrays from the three corners of the bright blue (quadrant 1) image not containing header strings. The averages are saved and warnings written when certain values are exceeded, indicating deterioration of the video signal. Differences between the corner values are also evaluated to identify vertical or horizontal ramping. The onscale checks evaluate the average brightness level of a 6x6 pixel array near the northern horizon in all four images. Warnings are given if quadrants 1 and 2 are too dark, or quadrants 3 and 4 are too bright. This check is often activated on images taken before sunrise or after sunrise, when quadrants 1 and 2 are off scale dark. The hourly TAPEQC checks are performed on LAN and LAN + or - 3 hour images. The 3 dark scale pixel arrays are also saved." At LAN for day on the tape, the bright red (quadrant 2) image and its corresponding brightness level histogram are saved to separate output files. 2.2 TAPEQC Program Execution Select the next available processing computer which has at least one ExaByte drive. Each processing computer has a TAPEQC directory with subdirectories for each station denoted by the station identifier (LLL). Place the radiance image tape into ExaByte drive 0. When the ExaByte READY light (green) is lit you are ready to execute. To Execute; (The following example uses tape 051 from Columbia, MO) D:/TAPEQC/COL>TAPEQC Screen Output: TAPEQC--program version MOD--8.3. 11/6/89 Time/Date: TIME=12:20:03 DATE=01/FEB/90 Station=COL Please Enter Tape Number >> 051 13 digit sequence number assigned to the tape.) Station + Tape ID=COL051 (If the station ID cannot be read from amLAN=15:20 the first image header then the program LAN=18:20 will request it before the tape pMLAN=21:20 sequence number.) DATE=01/FEB/90 Software Version= 212S Hardware Version= 2V6H TIME=12:20:03 -TEN From here on the program will continue to run unassisted. Information will continue to scroll on the screen. The time it takes to write to the screen will contribute to the overall run time. To inhibit the screen output depress the SPACE BAR once. To resume screen output depress the SPACE BAR again. Normally the program takes seven to eight hours to run. By suppressing screen output the program will run in six to six and a half hours. When the TAPEQC program has finished, the screen output should look similar to the sample output below: -------------ONE Quad Time Iris Occultor ND SP #1 23:20 160 164 0 0 23:20 160 164 0 1 23:20 160 164 0 2 23:20 160 164 0 Data search in progress #2 #3 #4 ... Finished 23:20:01 Ten Minute Image count= One Minute Image count= Stop - Program terminated. 72 720 . .. 4 2.2.1 Files Created by TAPEQC TAPEQC creates three types of files: diagnostic files, LAN files and histogram files. The diagnostic file contains the output from the data checking procedures presented earlier in the TAPEQC program description for all days on the tape. It's filename is in the form LLL###.DGN, which is the tape identification number. Two files are also produced for each LAN on the tape. The quadrant 2 red image pixel values are saved in a file named LLL###c.LAN, where c is a character (A, B, C, ...,G) that indicates the sequence of the LAN image on the tape. A brightness level histogram file for this image is saved under the name LLL###c.HST. The TAPEQC run for COL051 produced the following files: COL051.DGN - for the entire tape COL051A.LAN & COL051A.HST COL051B.LAN & COL051B.HST COL051C.LAN & COL051C.HST COL051D.LAN & COLO51D.HST COL051E.LAN & COL051E.HST COL051F.LAN & COL051F.HST COL051G.LAN & COLO51G.HST for the first LAN on tape for the second LAN on tape for the third LAN on tape for the fourth LAN on tape for the fifth LAN on tape for the sixth LAN on tape for the seventh LAN on tape - The next step in the processing sequence is to run the DGN program. 2.3 DGN Program The DGN program takes the diagnostic file created for the entire data tape by TAPEQC and divides it into separate files for each day on the tape. It also creates three special use files (.EXT, .DRK and .HOT). To Execute: D:/TAPEQC/COL>DGN LLL###.DGN (example COL051.DGN) DGN creates a diagnostic file for each day on the tape named in the LLL###c.DGN format, where c indicates the day sequence position on the tape. A diagnostic error summary is appended to the end of the file. Table 1 describes the errors listed in the diagnostic summary. 2.3.1 DGN Output Files: The DGN files created by the DGN program for our sample are: COL.EXT COL051.DRK COL051.HOT COLO51A.DGN COL051B.DGN COL051C.DGN COLO51D.DGN COL051E.DGN COL051F.DGN special use file special use file special use file the first day on the tape the second day on the tape the third day on the tape the fourth day on the tape the fifth day on the tape the sixth day on the tape COL051G.DGN the seventh day on the tape 2.3.2 The Special Use Files LLL.EXT contains the catalog information: date, start/stop time, hardware/software versions and individual DGN file names. RENAME this file so that the tape sequence number follows the station identifier, i.e. >RENAME COL.EXT COL051.EXT. These files were used in putting together the WSI Data Base Catalog. LLL###.DRK intended to contain the hourly dark signal values for all the days. However, a mistake in the DGN program omitted the dark scale print to this file. At present these files contain no useful information. LLL###.HOT contains the hourly temperatures for all the days. The files are used in the tape quality evaluations. 2.3.3 Table 1 Description of Diagnostic Error Summary Entries - the spectral filters are out of sequence. 1) 2) Spectral Errors Occultor Errors the occultor moves more or less than 15 degrees per hour. If the images are missing this error could be flagged. 3) Signal Errors the dark signal exceeds a certain threshold in three regions outside the image in Quadrant 1. 4) Image Errors the signal within the image in a given quadrant is too high or low. 5) Minute Errors the minute skips to far ahead or back. Hour Errors - the hour skips to far ahead or back. 7) Iris & N.D. not set the IRIS reading is greater than 020 and the selected Neutral Correctly Errors Density is not equal to zero. 8) No Time for Flux Ctrl - not enough time to do flux control. Can't put filter in - the spectral filter could not be put in the proper position. Position 10) N.D. Runaway - the neutral density filter could not be put in the position. 11) Not on WWV time - number of times system used BIOS clock. 12) Missing Ten IMG - total number of missing ten minute images. 13) One Minute Errors - READ and COUNT values differ for one minute images* 14) Ten Minute Errors - READ and COUNT values differ for ten minute images* *READ is the image number from the header and COUNT is a counter that increments when each READ occurs. If they differ, then COUNT resets to the READ value and is flagged. COUNT resets after the first image of the day is read. 2.4 TAPEQC and DGN File Screening Procedures Certain features of the image quality and system performance must be noted in the individual station log books for each tape received. This information is obtained by examining the files produced by TAPEQC and DGN for each day on the tape. The appropriate entries outlined below are then made to the station log. 1. Sort the TAPEQC and DGN output files for the tape. Use the NORTON Utilities as follows: Type DS to enable the sorting utility, Select (C)hange sort order', Sort by: Name, Extension, Date, Time, Size (Defaults) Depress (R)e-sort and the (W)rite changes to disk Depress (ESC) to return to DOS. This step makes any inconsistencies in the sequence labelling between the LLL###c.DGN files and the LLL###c.LAN and .HST files readily apparent. In our example the day and LAN sequence characters match. i.e. the first LAN occurs on the first day, the second LAN on the second day, etc. This is not necessarily the case for every tape. If the data collection began after LAN on the first day of the tape, then the LLL###A.LAN (the first LAN on the tape) will actually be from the second day, creating an offset in the .LAN and .DGN character sequences. Offsets can also arise from missing LAN images on subsequent days. 2. Select the appropriate station TAPEQC log book. The following should be noted for each tape: The date the files were screened. The number of the QC computer that the tape was run on. 3. Examine the LAN images, their associated histogram (HST) and diagnostic (DGN) files for each day. Use the program SHOIMG to examine LAN files. i.e. >SHOIMG Image file name: COL051A.LAN Use the DOS LIST Utility to view .HST and .DGN files, i.e. >LIST COL051A.HST a) LAN image entries: - Date (Header) Occultor position (Header) Number of the occultor arm used (Bands on the arm) Temperature (Header) . Degree of cloudiness (i.e.. 10% ... 100%) Cloud type (if you cannot determine, note whether opaque or thin) WWV or BIOS time used (Header) - Other things to note: - - Is the occultor off-center or tilted? Is stray light present? (Occultor shadow) Does a bright halo appear in the dark area of the image? (This may indicate an inappropriate flux control threshold in the FIELD program input unit.) Any obstructions on the dome? (birds, dirt, etc.) Is there noise in the dark area? (grainy or speckly appearance) Are the images too bright? If so, then note the Iris setting and the Neutral Density (N.D.) used from the header. Does the temperature on the image differ from the average LAN temperature for all days on the tape by more than +/- 5 degrees C? See Appendix B for examples. Histogram (HST) entries: b) - Are the values distributed properly? (There should be a larger concentration at zero) - Is signal compression evident? This occurs when the highest pixel values fall below 240. Note, the character string readable on the image are assigned a value of 255, so the histogram will always register some pixels at that level. Is the dark signal creeping up? Diagnostic (DGN) entries: - - Abnormal start and stop times. Are there Image Signal errors? (If so, when, location and values.) In the winter these errors occur at the beginning and end of the day due to darkness. Time gaps (including the missing ten minute midnight image.) Excessive "NO TIME FOR FLUX CONTROL" errors (more than 100 occurrences) Note the time of "CAN'T PUT FILTER IN POSITION" errors if any. If the LAN images are too bright there may be "IRIS AND ND NOT SET CORRECTLY" errors. If so, note the time and quadrant where they occur. Note any Dark Signal errors over 15.0. - All noteworthy items for the tape are summarized in a memo to the group. 2.5 Post TAPEOC Procedures All of the files created by TAPEQC and DGN are then backed up to ExaByte tape for use in downstream processing. Each station has numerous backup tapes, with each tape having no more than 10 TAPEQC runs appended to allow for timely future retrieval. Two programs have been written for ExaByte backup and retrieval purposes. For backup purposes use EXBACK and to retrieve files written with EXBACK use EXRCVR. They are described in their entirely in the Utilities section. The following steps describe the TAPEQC and DGN files backup procedures. 1. Get a backup tape for the station. Use a previous tape if it contains less than 10 runs or get a new tape if the previous one is filled. Make sure that the WRITE PROTECT TAB is closed on the full tape. 2. Insert the backup tape into the ExaByte Drive 0. If the previous tape has files written on it you will type the following command to execute the backup: D:>EXBACK -a LLL###*.* If you are using a new backup tape replace the (-a) which stands for append, with (-r) which stands for rewind, to ensure that the tape is at the Beginning of Tape (BOT) marker. i.e. D:>EXBACK -1 LLL###*. * Screen Output: Using the append option (-a) EXBACK. Version 5.4 -- 28 February 1990 This program will copy information from disk to tape. WARNING: EXBACK can overwrite existing data. If you want to continue press the <> key. Searching for end of tape. Once the last end-of-file mark on the tape has been read the program will start to write all the files delineated by the file name. The asterisks are wild characters that tell EXBACK to write every file to tape that starts with the first six letters regardless of the characters that follow. The screen output for tape COL051 from Columbia, MO follows: Writing file (D:\TAPEQC\COL\COL051.DGN] to Exabyte. Finished writing file (COL051.DGN) to Exabyte. Writing file (D:\TAPEQC\COL\COL051G. LAN] to Exabyte. Finished writing file (COL051G.LAN) to Exabyte. 25 files (3) written to Exabyte. As the files are being written, the line: Bytes remaining: 000012345 appears. The changing numbers reflect how many bytes are left to write from the disk file to the file on tape. The line disappears once the file has been written. 3. When EXBACK is finished writing the files, run EXRCVR to produce a directory of the contents and to ensure that all the files written by EXBACK can be read. To produce the updated directory type the following: D:>EXRCVR -RDW This instructs the ExaByte drive to first rewind the tape to BOT. EXRCVR will then read the header/filename of every file on the tape and write it both to the screen and to a disk file named 'DIR.LST'. The screen output for COL051 was: 28 February 1990 + EXRCVR. Version 5.4 -- Rewinding Exabyte. Barming Finished Rewinding Exabyte. Skipping file (D:\TAPEQC\COL\COL051.DGN). Skipping file [D:\TAPEQC\COL\COL051G. LAN). Exabyte contains 25 file (8). The number of files from the output of EXRCVR should match the number of files from the output of EXBACK if the tape was new and had no other files on it and if all the files were written. If the tape has other files they are listed and reflected in the total. . 4. Print the 'DIR.LST' and remove the backup tape. If you had to use a new tape handwrite a tape label using the form of the following example: ** DGN, HST & LAN FILES COL051 - Place the tape in the box with all the other backup tapes for that station and place the directory listing in the manilla file folder with the other backup tape listings. If the tape had been appended remove the old directory listing and replace it with the new one. When the tape is full type a permanent label. i.e. DGN, HST & LAN FILES COL051 - COL060 5. After the files have been examined and they have been backed up you may delete them from disk. 2.6 Data Tape Copy and Labelling 1. Type a label for the tape using the following format: COL051.1-7 1 - 7 FEB 1990 Note: Number of days on the tape. Apply a MASTER sticker to the tape just below the write protect tab. 2. Ma Make a copy of the raw data tape using the program EXCOPY described in the Utilities section. Note, no copy is made if the data quality is questionable. The copy takes between 5 to 7 hours. A computer with 2 ExaByte drives is needed. Drive 0 is the read drive and Drive 1 is the write drive. When the copy is finished, check the .CPY (EXCOPY output) file to ensure that a normal copy was made. Attach an identical label as above and apply a COPY sticker to the tape just below the write protect tab. 3. On the outside of the tape case edge, apply stickers for the sequence number (top of case) and data status dots, pattern shown below (bottom of case.) EXAMPLE: 0 - Copy made QC complete - 00- Data quality** ** Data Quality: Black Yellow Red - Data O.K. - Special handling required - Data questionable or unusable The color of the dots for Copy made and QC complete are the color assigned to the station. Colors assigned to stations: C-Station : Green HELSTF : Light Blue Kirtland : Red China Lake : Yellow Malmstrom : Malabar : Columbia : Portable : Orange Dark Blue Black Yellow with red cross 4. Place the MASTER tape in the glass cabinet and the COPY tape in the box containing other COPY tapes. The COPY tapes are eventually stored at a separate location in Building 4. 3.0 RATIO PROCESSING PREPARATION Five input files need to be created before the ratio processing can begin. Three of these files receive input from the program CHECKLAN. Following the procedure to run CHECKLAN will be a brief description of each file. 1. Calibration files: Filename = CALxVxxA.RAT A new file is created for each significant hardware or software change that occurs at each station. See Tech Note 231 for description. 2. Hardware and software version files: Filename = VERSION.LOG Created once containing all stations and updated as new data is added to the processing cycle. Entries for each station are made each time the software or hardware versions change, data quality changes, data is missing, or a quality indicator needs to be set. These changes are denoted by date not tape number. This file is used to inform the program of the proper calibration file to be used for processing. 3. Field tape starting dates: Filename = DATEX.LST A separate file is created for each station. These files contain all of the tape sequence numbers with their respective starting dates, number of days contained on the tape and whether or not there is a day shift. Input comes from the Tape Catalog, notes taken during CHECKLAN processing and the NWS FORM 10s for the station. Occultor arm file: Filename = OCCx.DAT A separate file is created for each station. These files contain the dates when the occultor arm was changed and the offset angle needed to center the occultor mask on the occultor arm. Input comes from the CHECKLAN output file CHECK.OUT. 5. Time correction file: Filename = TIMEX.COR A separate file is created for each station. These files contain the dates when the time had to be corrected with an offset of plus or minus minutes. If no offset is needed (system ran using WWV time clock) then a zero is entered. Input comes from the CHECKLAN output file CHECK.OUT. The following pages contain samples of these files using data from field tape COL021. However, all examples from the program TAPRATPL on, use field tape KAA 100. This is due to the fact that the Kirtland station has more stable atmospheric conditions which made the explanation of the rest of this manual much more concise. At the end of every sample will be the entry made to this file for the tape KAA 100. 3.1 CHECKLAN Program . The CHECKLAN program is used to determine the values for two of the input files used by the Ratio program TAPRAT. The two files are OCCx.DAT and TIMEX.COR. File OCCx.DAT is a list of dates when the different occultor arms were in use and what their offset angle was. File TIMEX.COR contains a list of dates of time offsets, including zero. The Local Apparent Noon (LAN) images saved from the TAPEQC program are used as the input to this interactive program. Observation of occultor and time offsets once a day seem to be adequate. This program needs to be run on a computer with a mouse. The results are written to the output file CHECK.OUT. This file is created first. If you prematurely quit this program it is saved and you will need to delete it or name another output file before proceeding. To Execute The following is an example of the screen output: D:\CHECKLAN Welcome to CHECKLAN - Version 1.0 Checks the occultor and sun positions on LAN images Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego 1990 - All Rights Reserved Site # Location Site # Location 8 in A WNHO MPL C-Station HELSTE Kirtland China Lake Malmstrom Malabar Columbia Composite 1 Portable 1 I. 11 -> Please enter the site number: 7 -> Enter the field tape sequence number (eg, 001): 021 Input the start date of the tape as follows: Format: Month Day Year Example: 1 10 89 -> Please enter the starting date: 07 20 89 Calibration file CAL7001C.RAT opened successfully. Enter 'a zimuth offset for this site :-1.5 -> Enter the LAN indicator (such as A,B,C...):A Header Date = 20/JUL/89 IOFF = 2 - - - - - - - - - - - - - - - - - - - BEGIN THE OCCULTOR SPECIFICATION - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the correct arm number? Y OR N: N Enter the new arm number (1-7): 7 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the correct arm number? Y OR N: Y Is this the best occultor angle? Y OR N: Y BEGIN THE TIME OFFSET DETERMINATION Can the sun be seen in the image? Y or N: N COLO21a . LAN. 20/JUL/89 ND=1 Occultor: Arm=7 Cor= 0 Time: Cor= 999 W CHECKLAN Menu======== R9SN93SSSSSS S AKSSSSSSSSSSS ================ | SA Enter the letter corresponding to your choice for the next procedure. T = use a new Tape number L = use a different LAN indicator R = Review the last LAN X = exit this run ====================================3==================== -> Your Selection: L Note: When the program is initialized the first occultor arm mask used will be the mask for arm #4. If this is not the proper mask then you will have to select the correct mask. Subsequently, this new mask will be used until the program is either exited or the mask needs to be changed. (See Fig. 3-1) 6 . . . 9 . . . . . . . . . . . .... . . . . . 0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 . . . . . . . . . . . 001. . . . . . . . . . . . . . . 0 1 . . . 1 . 0 - - . 29 . - . . . . 6 # . 1 . . _ .. CD _ . . . _ _ O . . . ".. . 000 . . . . . 21. + . . VILO ! . . . . . . . . . . . _06 . . . . . . . . ! . . 10. ! . . . . . . . !! . VPH ! ! . . . DO . .. . . . 12 ! ! . . . . . ! PODO ! . . . . .. 0 . .. . . .. . . .- 1 . .. IN ON. . ... . .... ... .. : .. V . .. ..... . - .. 4 + + + + + + + + - . . N . . . . . . A . . t . TOO . . U . . . 11 . 6 . . . . . . . . . . . . 1 . ..... ORIGINAL LAN IMAGE .... . DO0 4 NA . 1 . . . . . . 1 . . 6 ... .. .. . .. . . . . . . . .... . . . . . . . . AN O L1 1 . 1 DO . - ! ! • . . P . . - P - . - . 1 . 0 _ D . OR . . _ . . . 10 _ . . $0 . X YT . __ . . O . . . . .. . _ + 01 TO 10 . . . - 0 + C . . .. O + . . . .. ..... . . DOMO.. . . .... . . . . . . ONROE . . . DE . .. OF . . . . . . 201 ........ DO . ....000 . M t O .... ! . . . . . . . . . . . . . . . . . . 1 00 . 000. . . . . . . . . . . 5 . . . . . . . . . . . . .. . . . . ........ . I . . . . . . 6 . . . TOT . . . . 0 0 . . . . . . . 0 . . . . . . . . . . .0 . . . . . . 2 . . . 01 . 0 . S . . . . . STRO . . : . . NO . . . . . . . + . . . . . . . . . . . . . . . . . .. . . . . . . . . ! . . . . . . . . I . . ..... . 000 . .... . ..! . . . . NO 6 . PIL UU . . ... . . . 0 ... . .... . 64 9 . . BEST ARM?:N ARM = 7 CORRECT ARM? : Y FIG. 3-1 Selecting the proper occultor arm mask. 16 -> Enter the LAN indicator (such as A, B,C...):B Header Date = 21/JUL/89 IOFF = 2 2 BEGIN THE OCCULTOR SPECIFICATION Is this the correct arm number? Y OR N: Y - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the best occultor position? Y OR N: N Enter the new occultor angle (0-100): 092 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the best occultor angle? Y OR N: Y BEGIN THE TIME OFFSET DETERMINATION Can the sun be seen in the image? Y or N: N COLO21b. LAN 21/JUL/89 ND=0 Occultor: Arm=7 Cor= 1 Time: Cor= 999 W I CHECKLAN Menu============================================= Enter the letter corresponding to your choice for the next procedure. T = use a new Tape number L = use a different LAN indicator R = Review the last LAN X = exit this run 1 ssss= =========== ======================================= -> Your Selection: L Note: The second LAN image now has the correct arm mask but it's angle is offset by 1 degree. So we change the current angle of 91 degrees to 92 degrees so that the mask is as centered on the occultor arm as possible. This correction will remain until the program is exited or the angle is again corrected. (See Fig. 3-2) (+ . . . . . T . . . . . . 4 . . . . . . . . . . . . 0 . . . . . . . . . ... . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 . . 1000 . . . . 000 O2! 0. . . . 11. . DA .000. . ORIGINAL LAN IMAGE AFTER BEFORE . . . . . . . . . . DO!! . . . . . . . . . . 0 . . . . . . 0 . ! ! 1 ! . . . . . . . otri.. 02.. . . . . . . . . JUS1 01. . . . . . . .. . . . . . . ..V000 . . . . . . . . . . . . ! . ......... . . . . P . . . . 3 . . .. . . O . . . . . O . . . . ............ . . . . OOO.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...000 . . . . O . . . . . D LLC T . . 2 00000000... 00..... . OL OOO...... vi : . .. OOO... . . . . ... . . 06. . . . . . . ....... . . . O . . . . . . . . . . . . . . . . . . . . YAN . . . . 1.800. . 2 0020 . . . . . . . O . ! . . ! . . . . . . . . . . . . . . . .. . . . . . . . . .•0 . 000+ . . . . BODO . . . . . VO . . . . . .. . . . ...02 ..... .... .. . 0. 000000 ... . .... ..... ... . . . . . . . . . DO f . . . . . . . . . . NO . . . . . . 1 . . . . . . . . 1 OOOO . . . . . . . . . . . U . . . . . . . ... . . . . . . . . . . . . . . . . . 0 . . BEST ANGLE?:N CURRENT ANGLE = 091 ENTER ANGLE = 092 BEST ANGLE?:Y CURRENT ANGLE = 092 FIG. 3-2 Determining the best angle for the occultor arm mask. 18 -> Enter the LAN indicator (such as A,B,C...): C Header Date = 22/JUL/89 IOFF = BEGIN THE BEGIN THE OCCULTOR SPECIFICATION CULTOR ICATION . - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the correct arm number? Y OR N: Y - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the best occultor angle? Y OR N: Y --- --------- --------- ---------- ----- ----- ---- ---- ------- -------- BEGIN THE TIME OFFSET DETERMINATION Can the sun be seen in the image? Y or N: Y Is this the best sun position? Y or N: N Enter a new time (HHMM, eg 1800): 1818 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Is this the best sun position? Y or N: Y COLO210. LAN 22/JUL/89 ND=1 Occultor: Arm=7 Cor= 1 Time: Cor= -2 W .. I CHECKLAN Menu============================================= . Enter the letter corresponding to your choice for the next procedure. C T = use a new Tape number L = use a different LAN indicator R = Review the last LAN X = exit this run = = = = = = = = = = = = = = = = = = = = = = = -> Your Selection: L Note: This third LAN image has the sun spot showing in the middle of the occultor. To determine if the time is correct the blue plus sign (+) should be directly centered over the sun spot. If it is not then we have to add or subtract minutes from the original time to correct this. You may move back and forth in time until you get the two lined up. The correction will not be saved until you answer yes to the last question. The initial time for this image was 1820 and the corrected time was 1818. (See Figs. 3-3 and 3-4) 19 . . . . . . . . . . ! . -_- . ! . . 1 " . A Abort. theids: 2 L11 . ..... : . : . . . . . . . . . T . . US .. . . .. _ . . . . . . 1 . . . . . . . . . 0 - . . . . ........ . . . . C . 10 - VU 000 INO OO1 1 1 . ....... ............. . .. ....... . . 1 L 0 - - C . . . 0 . S . . DI . . . . . . W # . . . . . 11 1 ORIGINAL LAN IMAGE I . U . . . . t . mo . . 8 . OS Hit: POT O . . . INC. . 121 . - .. Q .. . O . .. . . . . * L : * . . . • . . • . . . . . . - • - • DO. _ . • . Š . . . . ! .. . ...IM . ! DO . UUU . .. ... TOO!!!. . . . .. . 11 .. .. . ..17111: . . { lea . .... . . e.. . . . . . ::***!! . . .. - + . . . 1 . . . . ini . . . . . . + . . . . .. . DI A IS THE SUN VISIBLE?: Y (SUN TRACK APPEARS MOMENTARILY & CENTER OF IMAGE IS THEN MAGNIFIED) FIG. 3-3 Determining whether the sun is visible. 20 D O نمنننن . . . . . . . . . . ... . . . . . . . . . . . ... . ..! C SUN TM1E-1930 IS THIS THE BEST TIME? :N CURRENT TIME = 1820, ENTER TIME = 1818 THE DARK PLUS SIGN (+) SHOULD BE CENTERED IN THE WHITE SUN SPOT . . . . BUN TIE:16.3 IS THIS THE BEST TIME?: Y CURRENT TIME = 1818 THE DARK PLUS SIGN (+) IS NOW CENTERED IN THE WHITE SUN SPOT FIG. 34 Determining the best sun position. 21 (Note: continue this sequence until you have viewed all the LAN images for this tape. Then just to make sure that in the unlikely event that there is an eighth LAN image, your last entries should look like the following): -> Enter the LAN indicator (such as A,B,C...): H Can't find file COLO21h. LAN - Go to Menu ECKLAN MenuSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS Enter the letter corresponding to your choice for the next procedure. : T = use a new Tape number L = use a different LAN indicator R = Review the last LAN X = exit this run LC 1402 1 ======= ==== ========== SSSSSSSSS SSSSSSSSSSSS=33: .1. 41 -> Your Selection: X Stop - Program terminated. " OR .. .. -> Your Selection: T -> Enter the field tape sequence number (eg, 001):022 ******.1: W Input the start date of the tape as follows: WW ... . From here on you just repeat the above steps until you have completed all the CHECKLAN runs you intend to run. You will note that the entry to the output file is echoed to the screen after you have completed all determinations for that LAN image. ......... ww w . . . . .-.- 3.1.1 Example of the CHECKLAN Qutput File Created File CHECK.OUT COLO21a . LAN 20/JUL/89 ND=1 COLO21b. LAN 21/JUL/89 ND=0 COL021C.LAN 22/JUL/89 ND-1 Occultor: Arm=7 Cor= 0 Time: Cor= 999W Occultor: Arm=7 Cor 1 Time: Cor= 999W Occultor: Arm=7 Cor= 1 Time: Cor= -2W ENTRY FOR KAA100: KAA 100 started at 23:20 07/DEC/89, there was no LAN image for this day. KAA100a . LAN 08/DEC/89 ND=0 KAA100b. LAN 09/DEC/89 ND=0 KAA1000. LAN 10/DEC/89 ND=0 KAA1000. LAN 11/DEC/89 ND=1 KAA100e . LAN 12/DEC/89 ND=0 KAA100f. LAN 13/DEC/89 ND=0 Occultor: Arm=1 Cor= Occultor: Arm=1 Cor Occultor: Arm=1 Cor= Occultor: Arm=1 Cor= Occultor: Arm=1 Cor= Occultor: Arm=1 Cor= 2 2 2 1 2 2 Time: Cor= Time: Cor= Time: Cor= Time: Cor= Time: Time: Cor= -5W -4W -4W -6W -5W ADDITIONAL THINGS TO NOTE DURING CHECKLAN RUNS. While looking at the LAN write down the TAPE ID NUMBER, DATE, ESTIMATED PERCENT OF TOTAL SKY COVER and ESTIMATED PERCENT OF OPAQUE CLOUD COVER. In addition, comment about unusual obstructions on the dome; birds, dirt, rain, excessive stray light, etc. These notes will help determine inputs to two additional files; VERSION.LOG and DATEX.LST. Dome obstruction and other unusual attributes provide input to the Quality Indicators in VERSION.LOG. The DATE, EST. PERCENT OF TOTAL SKY COVER and PERCENT OF OPAQUE CLOUD COVER when matched against entries from the Station's FORM 10'S determine if there were any date shifts. If the percent totals are drastically different such as 100% cloudy on the FORM 10 and completely clear from the CHECKLAN notes with the next day 100% cloudy and the pattern of differences is the same between the two, only it is off by a day then the likelihood of the computer being a day off is very high. This could have happened during a rush maintenance visit and is corrected during the next visit or power outage. .- Print L . 11.444.. . . . . . . 3.2 Example of VERSION.LOG file. STATION COMMENTS HARDWARE DATA Qual 1A Vers 1B 1B DATE Mo/Da/Yr 02 08 89 03 24 89 05 08 89 05 16 89 05 31 89 06 22 89 11 09 89 11 17 89 07 12 14 89 25 89 12 26 89 12 28 89 pa HNW T WWW QUALITY SOFTWARE Indicators Vers 0000000000 1.71 0000000000 1.71 0000000000 1.71 0000000000 1.71 0000000000 1.71 0000000000 2.70 0000001000 2.70 0000000000 2.70 0000000000 2.70 0000001000 2.70 0000000000 2.70 0000001000 2.70 0000000000 2.70 89 12 Explanation of contents: Col. 1: The station identifier, Columbia was the seventh station put into the field. Col. 2: Date, Mo/Da/Yr Col. 3: The hardware version in the field at this time. Col. 4: Data quality flag. Three entries possible: 1 = Cloud data appear normal, but check the quality indicators (may include cases where special handling during processing was required.) 2 = Cloud data may be abnormal, for example no occultor present. 3 = Data missing. Col. 5: Quality indicator is a 10 character string that describes problems with the imagery based on automated and visual evaluation of the Local Apparent Noon images for each day. Zeroes indicate no problems expected. Non-zero flags are explained below. In general, data which are severely impacted are not processed past the ratio stage. Position 1 - No occultor present if = 1. Position 2 - Stray light. 1 = Wrong occultor arm may lead to stray light problems. 2 = Large time offset displaces occultor off sun producing significant stray light. 3 = Other. 24 Col. 5 (cont.) Position 3 - Split images, data unusable if = 1. Position 4 - Bad input look up table on FG-100 board in field if = 1, resulting in gaps in field brightness values. At ratio level, affected pixels are indicated as "no data" or eliminated by smoothing. Position 5 - Range truncation at top of range, if = 1. Ratio data may be slightly distorted. Position 6 - Range truncation at bottom of range, if = 1. Ratio data may be slightly distorted. Position 7 - Obstruction to vision on dome. 1 = Condensation inside dome. Ratio data may be useful. = Other obstruction on dome or portions of dome. 3 = Dirty dome. Positions 8 thru 10 - Currently unused. Col. 6: Software version of field code in use for this date. Col. 7: Comments. See Appendix B for examples of images that would cause some of these Quality Indicators to be set. . . . Entry for KAA100; V . ! STATION HARDWARE COMMENTS DATE Mo/Da/Yr 12 01 89 12 13 89 DATA Qual Vers QUALITY SOFTWARE Indicators Vers 0000000000 2.30 0000000000 2.30 3F 3F 3 (These two entries encompass the data contained on the tape (7 - 13 Dec 89.) 25 3.3 Example of DATEX.LST file. FIELD TAPE DATE LIST Site Number 7 - Columbia, Missouri Last Update - 25 June 1990 by MLC HO O o Tape Identifier COL001 COL002 COL003 COL004 COL005 COL006 COL007 COL008 COL009 COL010 COL011 COL012 COL013 COL014 COL015 COL016 COL017 COL018 COL019 COL020 COL021 Start # Date Mo/Da/Yr Days Corr. 02 09 89 02 16 89 02 23 89 03 02 89 03 08 89 03 15 89 7. 03 22 89 03 29 89 04 05 89 04 12 89 04 19 89 04 26 89 04 30 89 05 16 89 05 16 89 05 23 89 06 22 89 06 29 89 07 06 89 07 13 89 07 20 89 Explanation of contents: Col. 1: The tape sequence number assigned to each raw tape. Col. 2: Col. 3: Col. 4: The starting month, day and year of the tape. The number of days contained on the tape. 0 = The date does not have to be adjusted. 1 = Adjust the starting day on the tape by one day. Example: Add one day to the starting date of COL005, 03 09 89 vice 03 08 89. Entry for KAA 100: Таре Identifier KAA100 Start # Date Mo/Da/Yr Days Corr. 12 07 89 26 3.4 Example of OCCx.DAT file. ܢ N ܚ ܢ ا پنا ہ ہ ܢܙ ܢܙ ܝܬ ܙ ہ ہ OCCULTOR ARM INFORMATION -- Last updated 24 July 1990 Site #7 - Columbia, MO Beginning Date (* normal schedule, not verified) Mo/Da/Yr Arm Used Offset Angle 02 09 89 02 23 89 ... 02 24 89 03 12 89 03 29 89 04 17 89 05 01 89 05 02 89 05 07 89 05 17 89 08 12 89 08 28 89 08 29 89 09 15 89 10 05 89 10 07 89 10 08 89 04 09 90 ܙ ہ ہ ܘ ہ ܝ ܚ ه م ܗ م ܢ ܢ ه ܢ ه ܙ ا ܩ ا م Explanation of contents: Col. 1: Date that the occultor arm actually changed or was scheduled to change. Col. 2: The number of the arm actually used. Col. 3: The offset angle used to center the mask as precisely as possible. An entry is made whenever the arm is changed and/or the offset angle changes. The mask created with these parameters is the same for every image from the starting date until the parameters change. Sometimes the occultor arm is loose and the arm will move more than the offset angle allows for, but we only use the LAN image to determine these entries so we accept this error. 11 Entry for KAA100: Beginning Date Mo/Da/Yr 12 01 89 01 03 90 (* normal schedule, not verified) Arm Used Offset Angle hu 27 3.5 Example of TIMEX.COR file. -5 TIME CORRECTION INFORMATION - Last updated 24 July 1990 Site #7 - Columbia, MO Beginning Date Time ...Mo/Da/Yr . Offset 02 09 89 03 03 89 03 04 89 03 05 89 03 06 89 03 07 89 03 08' 89 03 09 89 03 10 89 03 11 89 05 27 89 05 28 89 04 08 90 Explanation of contents: Col. 1: Starting date that time offset is to be applied to data. The time offset will be applied to all data between this date and the date that the offset changes. Col. 2: Time offset to be applied to data in plus or minus minutes. Zero offset means use original time system wrote to header data. Zero offset usually indicates that the WWV clock was working properly. Entry for KAA100; -- - Beginning Date Mo/Da/Yr 07 07 89 03 22 90 Time Offset 28 4.0 TAPRATPL PROGRAM This program computes the red/blue ratios and saves the resulting images to ExaByte tape. The program requires the use of a PL board and a computer that has two ExaByte tape drives attached. The input tape is the raw data field tape (master) or a copy. (NOTE: creating a copy first with EXCOPY and then using it for the input tape helps avoid most read problems during TAPRATPL processing.) Five input files are required by this program. They are: Filename Calibration files: CALxVOxx.RAT Hardware/software version files: VERSION.LOG Field tape starting date files: DATEX.LST Occultor arm files: OCCx.DAT Time correction files: TIMEX.COR In the filenames, the "x's" should be replaced by the station number. In the case of the calibration file, the first "x" is the station number, the second "x" is the version of that calibration file (the camera has been changed) and the third "x" is a change that is less significant than a camera change or just a maintenance trip. A detailed description of these files and examples of each preceded this section. Output; Ratio tape: each image is given a DOS header with the filename format: R3891207.T01 R = Ratio, 3 = site #, 89 = year, 12 = month, 07 = day and T01 = first image (ten minute processing) Files: These files (images) may be recovered individually using EXRCVR. T3100.DGN (ten minute) or 03100.DGN (one minute) T3100.LOG (ten minute) or 03100.LOG (one minute) T = ten minute, 3 = site #, 100 = field tape sequence # Examples follow this section. 29 4.1 To Execute; D:\>TAPRATPL Screen Output: ** PL Setup Completed ** Welcome to TAPRATPL - TAPRAT Version 2.5 This program computes the red/blue ratios and saves the resulting images to ExaByte Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego 1991 - All Rights Reserved -> Enter the tape number (such as 001) : 100 =WSI Image Selection====================================== Enter the letter corresponding to your choice for WSI image processing. T = Ten Minute Images Only O = One Minute Images Only ======== ================================================ -> Your Selection: T Note: You have several options which may be changed during a run. Options may be changed by entering the appropriate keystroke, without pressing the ENTER key. All of these options take extra time, and are intended only for occasional use during a run to visually check the ratio images. The Key enter options are: S to change Show Color flag C to Change Color D to change Save Radiance flag T to change Save Ratio flag F to change Show Full flag (this shows full 10 min image when process 1 only has been chosen) P to change Print Log flag X exit after current image ? to print current values of flags Any other key will cause the available options to be printed -> Press ENTER to continue Do you want to change the color from default? 30 TAPRATPL (cont.) Note: Default thresholds are thin=120, thick=130. Type O if Ok, or enter new thresholds -> ENTER O or THIN CLD THRESHOLD: 0 (if you enter a new threshold for thin cld then the next question will ask you to enter a new threshold for thick cld) Site # Location | Site # Location 6 uns WNHO MPL C-Station HELSTF Kirtland China Lake Malmstrom Malabar Columbia Composite 1 Portable 1 1 9 3 -> Please enter the site number: Opened diagnostic file T3100.DGN Input the start date of the tape as follows: Format: Month Day Year Example: 1 10 89 -> Please enter the starting date: 12 07 89 Field Sequence Number = 100 Confirmed Expected number of days on tape is 7. * Results of the Calibration File Selection * Day Seq. Day Day-Mo-or 707 7/DEC/89 708 8/DEC/89 709 9/DEC/89 710 10/DEC/89 711 11/DEC/89 712 12/DEC/89 713 13/DEC/89 Data Qual. 1 1 1 Quality Hard. Indicators Ve 0000000000 0000000000 0000000000 0000000000 0000000000 0000000000 0000000000 Soft. Vers. 2.30 2.30 2.30 2.30 2.30 2.30 2.30 Calibration File Selected CAL3V03F.RAT CAL3V03F.RAT CAL3V03F . RAT CAL3V03F.RAT CAL3V03F. RAT CAL3V03F.RAT CAL3V03F . RAT Initial header found: Date = 07/DEC/89 Initial date confirmed. Site ID confirmed to be KAA FIELD tape format confirmed: FLDTYP = 3 TAPRATPL (cont.) Initial image type = 1 Log file T3100.LOG opened successfully Writing initial EoF to target tape *** New calibration file CAL3V03F.RAT opened successfully. Calibration file date is :20/FEB/91 Basic Time Information for 7/DEC/89 : Estimated Start Time = 1259 GMT Computed Sunrise = 1358 GMT Computed Sunset = 2358 GMT Time correction = 0 min Occultor Arm 1 selected: Offset = 3 THIS BLOCK OF TEXT IS SCROLLED TO THE SCREEN EVERY TIME A NEW DAY ON THE TAPE HAS BEGUN PROCESSING. After all days on the tape have been processed (approx. 13 hours) the following message appears on the screen; Stop - Program terminated. D:/> 4.1.1 Condensed Sample of TAPRATPL Output File: DGN (Ten Minute Images) Starting Mo/Da/Yr on tape is 12 07 89 Field Sequence Number = 100 Confirmed * Results of the Calibration File Selection * P 3F Day Seq. Data # Day Day-Mo-Yr Qual. 707 7/DEC/89 708 8/DEC/89 709 9/DEC/89 710 10/DEC/89 711 11/DEC/89 712 12/DEC/89 7 713 13/DEC/89 Quality Hard. Soft. Calibration Indicators vers. vers. File Selected 0000000000 ЗЕ 2.30 CAL3V03F.RAT 0000000000 2.30 CAL3V03F . RAT 0000000000 2.30 CAL3V03F.RAT 0000000000 2.30 CAL3V03F.RAT 0000000000 2.30 CAL3V03F. RAT 0000000000 2.30 CALZV03F.RAT 0000000000 2.30 CAL3V03F . RAT H for feed Initial header found: Date = 07/DEC/89 Initial date confirmed. FIELD tape format confirmed: FLDTYP = 3 Initial image type = 1 Log file T3100.LOG opened successfully New calibration file CAL3V03F.RAT opened successfully. Calibration file date is :20/JUN/90 Basic Time Information for 7/DEC/89 : Estimated Start Time = 1259 GMT Computed Sunrise = 1358 GMT Computed Sunset = 2358 GMT Time Correction = 0 GMT Occultor Arm 1 selected: Offset = 3 Summary for 7/DEC/89 Number of 10 min images processed to ratio = 4 FREQUENCY Oo PROBLEM Time skips ahead : Time skips back : Occultor out of range : Occultor disagrees with time : Neutral density inconsistencies : Spectral filter inconsistencies : Quadrant inconsistencies: ooo . oo (The above information is saved for every day processed on the tape, giving a summary of all that might be pertinent to future users.) T3100.DGN (cont.) The entries for that last day follow: Basic Time Information for 13/DEC/89 : Estimated Start Time = 1301 GMT Computed Sunrise = 1402 GMT Computed Sunset = 2359 GMT Time Correction = 0 GMT Occultor Arm 1 selected: Offset = 3 Summary for 13/DEC/89 . Number of 1 min images processed to ratio = 59 FREQUENCY PROBLEM Time skips ahead : Time skips back : Occultor out of range : Occultor disagrees with time: Neutral density inconsistencies : Spectral filter inconsistencies : Quadrant inconsistencies: OOOOOOO 34 4.1.2 Condensed Sample of TAPRATPL Output File: DGN (One Minute Images) Starting Mo/Da/Yr on tape is 12 07 89 Field Sequence Number = 100 Confirmed * Results of the Calibration File Selection * Data Qual. 3F Day Seq. Day Day-Mo-or 7/DEC/89 708 8/DEC/89 3 709 9/DEC/89 710 10/DEC/89 711 11/DEC/89 712 12/DEC/89 7 713 13/DEC/89 1 van AWNH Quality Hard. Indicators Vers. 0000000000 3F 0000000000 0000000000 0000000000 0000000000 0000000000 0000000000 Soft. Calibration Vers. File Selected 2.30 CAL3V03F.RAT 2.30 CAL3V0JF. RAT 2.30 CAL3V03F.RAT 2.30 CAL3V03F . RAT 2.30 CAL3V03F.RAT 2.30 CAL3V03F . RAT 2.30 CAL3V03F . RAT Initial header found: Date = 07/DEC/89 Initial date confirmed. FIELD tape format confirmed: FLDTYP = 3 Initial image type = 1 Log file 03100.LOG opened successfully New calibration file CAL3V03F.RAT opened successfully. Calibration file date is :15/JUN/90 Basic Time Information for 7/DEC/89 : Estimated Start Time = 1259 GMT Computed Sunrise = 1358 GMT Computed Sunset = 2358 GMT Time Correction = 0 GMT Occultor Arm 1 selected: Offset = 3 Summary for 7/DEC/89 Number of 1 min images processed to ratio = 39 FREQUENCY PROBLEM Time skips ahead : Time skips back : Occultor out of range : Occultor disagrees with time : Neutral density inconsistencies : Spectral filter inconsistencies : Quadrant inconsistencies: OOOOOOO (The above information is saved for every day processed on the tape, giving a summary of all that might be pertinent to future users.) 03100.DGN (cont.) The entries for that last day follow: Bas Estimarmputed Basic Time Information for 13/DEC/89 : Estimated Start Time = 1301 GMT Computed Sunrise = 1402 GMT Computed Sunset = 2359 GMT Time Correction = 0 GMT Occultor Arm 1 selected: Offset = 3 sunse Summary for 13/DEC/89 Number of 1 min images processed to ratio = 598 FREQUENCY PROBLEM Time skips ahead : Time skips back : Occultor out of range : Occultor disagrees with time : Neutral density inconsistencies : Spectral filter inconsistencies : Quadrant inconsistencies: OOOOOOO 36 4.1.3 TAPRATPL Log File Entry Description _ __ I New Seq New old old N Flags Off ScaRatio Histgram (Max-108) D YrModa # Time YrMoDa Time D TONSQ LU HU HL 0 1 2 3 4 5 6 7 8 9 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 3 891207 1 2320 891207 2320 0 00000 0 1 0 2 0 0 0 0 0 0 0 3 58 Ratio Histgram (Max-108) 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 >24 ++++++++++++++++++++++++++++++++++++++++++++++++ 28 5 2 1 0 0 0 0 0 0 0 0 0 0 0 0 ID - Station number New YrMoDa - corrected date (Year Month Day) Seq # - ratio image sequence number for this date New Time - corrected time Old YrMoDa - original date Old Time - original time ND - neutral density indicator. Values 0 to 3 correspond to ND filter positions 1 to 4 Flags TONSQ T - ratio processing problem flags - 0 values indicate normal operation . time check indicator Values: 1 - time advanced more than 1 minute 2 - time unchanged or backtracked 8 - date change expected but not found 9 - date changed by more than 1 day - occultor check indicator Values: 1 - position out of range (0 to 180) 2 - recorded position differs by more than 3 deg from that expected at Old Time - ND check: 1 - ND not identical for all 4 quadrants - spectral filter check: 1 - not in proper order - quadrant check: 1 - not in proper order oz Off Sca LU HU HL LU HU HL - - - - % of active image off scale % offscale dark in 1-2 pair % offscale bright in 1-2 pair % offscale bright in 3-4 pair Ratio Histogram (Max 10s) - % of active image in 10 count ranges labelled by 10's digit of top of range. For example, the value under 8 is the % of image with a ratio between 71 and 80, inclusive. O indicates % no ratio due offscale dark, or in occultor or obstacle mask. >24 indicates % offscale bright in 3-4 pair. 37 4.1.4 Condensed Sample of TAPRATPL Output File: LOG Sample of One Minute LOG file: Start of file: 3 891207 1 2320_891207 2320_0_00000_0_0_0_2_0_0_0_0_0_0_0_01_26 3 8912072 2321_891207_2321_0_00000_0_0_0_2_0_0_0_0_0_0_0_01_25 3 891207 _3_2322891207_2322_0_00000_0_0_0_2_0_0_0_0_0_0_0_0_0_21 3 8912074 _2323_891207_2323_0_00000_0_0_0_2_0_0_0_0_0_0_0_0_0_18 3 891207 _5 2324_891207_2324_0_00000 0_0_0_2_0_0_0_0_0_0_0_0_0 16 ܘ End of file: 3 891213 594 2355_891213 2355_0_00000_0_0_0_0_0_0_0_0_0 . 0_0_0_09 3 891213595 2356891213 2356_0_00000_0_0_0_1_0_0_0_0_0_0_0_0_0_09 3 891213 596 2357_891213 2357_0_00000_0_0_0_0_0_0_0_0_0_0_0_0_0_8 3891213 5912358_891213 2358_0_00000_0_0_0_1_0_0_0_0_0_0_0_0_0 10 3 891213 598 23590891213 2359_0_00000_0_0_0_1_0_0_0_0_0_0_0_0_0_9 Sample of Ten Minute .LOG file: Start of file: 3891207 1 2320 891207_2320_0_00000_0_0_0_2_0_0_0_0_0_0_0_3_58 28 3_891207 _2_2330_891207_2330_0_00000_0_0_0_2_0_0_0_0_0_0_0_0_24 52 3891207 3 2340 891207_2340 0 0 0 0 00 0 _0 _0_0 _0_42 3_891207 _4_2350_891207_2350_0_00000_0_0_0_1_0_0_0_0_0_0_0_0_0_22 3_8912085 1400_891208 1400_0_00000_0_0_0_1_0_0_0_0_0_0_0_0_0_00 ܘ ܘ ܘ ܘ ܘ ܘܘܘ ܘܘ End of file: 3 891213_55 2310_891213 2310_0_00000_0_4_0_3_0_0_0_0_0_0_0_6 12 18 17 15 4_0_0_0_0_0_0_0_2_0_8 ܂000000_0_2320 891213_2320 389121356 3 891213_57_2330_891213 2330_0_00000_0_5_0_2_0_0_0_0_0_0_0_1_8 16 3 89121358 2340_891213 2340_0_00000_0_1 ._0_0_010 15 3 89121359 2350 891213 2350_0_000000 _0 _0 _0_0_0_2_30_29 : hand in ܘܘ ܘ ܘܘܘ 5.0 CLDDECM PROGRAM (FIXED THRESHOLDS) This program creates the cloud/no cloud decision images from the TAPRATPL (Ratio) tape. This program produces one minute cloud decision images only. The only hardware requirement is a computer that has two ExaByte drives attached. Tech Note 231 discusses the procedure for determining the fixed threshold values. Inputs required: Output RATIO tape from TAPRATPL Blank tape Thresholds for Thin & Thick clouds (Fixed entry for entire tape) VERSION.LOG Qutput: Cloud Decision tape Cover file of the format: KAA 100.CVR Contents of the cover file: The cover file contains one entry for every tenth image. These entries contain the following: The Thin and Thick thresholds used for the tape. The sequence number assigned to the CLD image. The RATIO sequence number of this image. The Date. The Time. The percentage of TOTAL cloud cover. The percentage of OPAQUE cloud cover. The number of points used in this image to determine these percentages. A sample of this file is at the end of this section. 5.1 To Execute: D:\>CLDDECM Screen Qutput; Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego CLDDECM Version 2.1 27 Mar 90 Forms Cloud/NoCloud' decision from TAPRATPL images. (One minute only) Site # Location Site Location o I. MPL . . C-Station HELSTF Kirtland China Lake Malmstrom Malabar Columbia Composite 1 Portable 1 I 1 8 9 4 A 0 -> Please enter the site number: 3 -> Enter the field tape sequence number (eg, 001): 100 -> Enter the Thin Cloud Threshold: 120 -> Enter the Thick Cloud Threshold: 145 Note: You have several options which may be changed during a run. Options may be changed by entering the appropriate keystroke, without pressing the ENTER key. All of these options take extra time, and are intended only for occasional use during a run to visually check the cloud decision images. The Key enter options are: S to change Show Color flag D to change info Display flag I to change Image Save flag X exit after current image ? to print current values of flags Any other key will cause the available options to be printed. -> Press ENTER to continue Screen output cont. Opening Cloud Cover File KAA100.CVR cid Rat Count Seg Date Total Opaque Number Time Cover Cover of Pts 1 1 7/DEC/89 23:20 10.7% 1.0% 19443 15.4% 19637 589 589. 13/DEC/89 23:50 38.8% ***CLDDECM processing finished*** D:/> TA 5.1.1 Condensed Sample of CLDDECM Output File: CYR " Cover File KAA100.CVR Selected thresholds: Thin = 120 Thick = 145 cid Rat Count Seq Total Opaque Number Time Cover Cover of Pts Date 1 11 21 31 7/DEC/89 23:20 10.7% 7/DEC/89 23:30 25.9% 7/DEC/89 23:40 57.0% 7/DEC/89 23:50 72.2% 1.0% 3.8% 11.7% 16.5% 19443 19544 19587 19681 31 39 images processed for this date. N CLOUD COVER SUMMARY Cloud Cover (Tenths) 2 3 4 5 6 5 4 4 2 2 13 3 0 0 0 0 0 13 Total Opaque 1 5 10 7 6 0 8 6 0 9 5 0 10 0 0 .O · · · 579 579 13/DEC/89 23:40 72.0% 589 589 13/DEC/89 23:50 38.8% ***CLDDECM PROCESSING FINISHED *** 37.3% 15.4% 19587 19637 598 images processed for this date. 0 1 Total 162 48 Opaque 248 108 CLOUD COVER SUMMARY Cloud Cover (Tenths) 2 3 4 5 6 7 8 9 30 35 62 51 8065 46 19 88 113 35 6 0 0 0 0 10 0 0 42 5.2 EXOC Program ** We create a cloud/no cloud image tape for each week of data, or portion of, with CLDDECM. One month's worth of data is then stacked onto one tape with the program EXCOPY. The program EXQC is used to read this stacked tape and verify that the tape is readable and that it is complete. This program produces two output files: KAA100.SUM and KAA100.TOC. The .SUM file contains one line of output for each day of data. It has the following format: · START END TIME TIME SOURCE TAPEID #FIELD #CLOUD SEQ# TIME PARTIAL DATAQUAL IMAGES IMAGES GAPS GAPS IMAGES VALUES COMMENT DATE 100 100 7/DEC/89 23:20 23:58 8/DEC/89 13:59°23:58 9/DEC/89 13:59 23:58 10/DEC/89 14:00 23:59 11/DEC/89 14:01 23:59 12/DEC/89 14:02 23:59 13/DEC/89 14:02 23:59 100 100 100 100 100 39 600 600 600 599 598 598 39 600 600 600 599 598 598 ooooooo ooooooo ooooooo 1 0000000 1 0000000 1 0000000 1 0000000 1 0000000 1 0000000 1 0000000 This file is a brief summary of the contents of the tape and can be sent along with the stacked tape. It lets us and the user know what time frame of data is on the final tape, whether there are any data gaps and whether any images were lost in the actual processing. To do this EXQC reads the tape, extracting headers. The header includes an image sequence number; the minimum being 1 and the maximum 720 (one minute images) or 72 (ten minute images.) Whenever the sequence number decreases, i.e. goes from 720 to 1, it signals the start of a new day. The program then extracts the date, time (start time) and the previous time, which is the end time of the previous day. The source tape (number of the original field tape) is also extracted. These are the entries for the first four columns. The last sequence number before the day changed indicates how many images were pulled off the field tape in TAPRATPL. This is the number in column six. As you will notice with the .CVR output files created from CLDDECM, sequence numbers are also given to each RATIO image; this is column five. If the numbers in column five and six are not identical then there will be gaps in the sequence numbers. The images could have been lost in the TAPRATPL write, CLDDECM read or write, or during the EXCOPY read or write. The difference between columns five and six, if any, gives us the number of images lost and is written to column seven. The entry for column eight comes from a check done during TAPRATPL processing. TAPRATPL checks to see how many data gaps (time gaps) are on the original field tape. Every time a time gap is encountered TAPRATPL indicates this in the header of the RATIO image. This header is passed on to CLDDECM. EXQC counts these header indications, if any, and writes them to column eight. The last check consists of counting how many lines of data are in between headers. If it is less than the expected number we have a partial image and the number of these incidents is written to column nine. The last two columns echo the Data Quality (column 10) and the Data Quality Indicators (column 11) for the day from the VERSION.LOG file. There is also a comments space which can be used when this file is edited in preparation for data shipment. Usually it is used to further explain any entries in columns seven to eleven. The .TQC file is a very large and detailed file that we currently do not use or keep. The information we need is contained in the .SUM file. If a tape has an abundance of errors, that tape is rerun through the processing where the errors occurred and then all of the cloud image tapes for that month must be restacked and run through EXQC again. 5.2.1 To Execute; D:\>EXQC Screen output: ЕХОС Version 1.0 2 May 90 Enter the drive # (0 - 1) to be read from: 0 EXQC creates a detailed . TQC logfile and a .SUM summary. Enter a filename for the output log and summary file, usually the source tape ID, up to 8 characters long: KAA100 Filename entered: KAA100.SUM Hit any key to start reading... drive 0 EOM: end of medium (LBOT or LEOT) drive 0 LBOT: logical beginning of tape. drive 0 EOM: end of medium (LBOT or LEOT) drive 0 LBOT: logical beginning of tape. System date & time: 09/16/91 17:30:43 drive 0 received valid Exabyte CHECK CONDITION. drive 0 FMK: filemark encountered. ... partial buffer read: O blocks. filemark detected, total = 1 drive 0 LBOT: logical beginning of tape. drive 0 EOM: end of medium (LBOT or LEOT) drive 0 LBOT: logical beginning of tape. System date & time: 09/16/91 17:30:43 drive 0 received valid Exabyte CHECK CONDITION. drive 0 FMK: filemark encountered. ... partial buffer read: 0 blocks. filemark detected, total = 2 Read after filemark: KAA OCLD LONG 106DEG 36MIN W LAT 35DEG 03MIN N DATE=07/DEC/89 TIME=23:20:03 ND=O IRIS=015 OCCFLD=015 CAL FILE=CAL3V03F CAL DATE=09/APR/90 FVER=2.30RVER=2.0 FLD TAPE #100 FLAGS=00000 dd ddddddddddddddddddd dd NEW DATE= 7/DEC/89 NEW TIME=23:20 OCCTIM=016 OFF SCALE %: DARK (1&2)=000 BRIGHT (1&2)=000 BRIGHT (3&4)=0 00 SEQ. DAY=0707 DATA QUAL. =1 QUAL. IND.=0000000000 FILE NAME=C3891207.001 CLD. THRESH.: THIN=120 OPAQ=145 **PRELIMINARY DATA** NO DATA= 3% CLR= 11% THIN= 28% OPAQ=...48% OFF SCAL BRIGHT= 0% CLDDEC IMGCNT= 1 6.0 CLOUD DECISION (VARIABLE THRESHOLD) PREPARATION This section contains the two programs that must be run for all tapes before the cloud/no cloud decision program CMPDECTP can be run. 6.1 GETREF Program This program is used to compute the ratio/normalized sky ratio distribution along with the 45/45 angle values. The program reads the ten minute RATIO tape created by the TAPRATPL program. GETREF requires two additional input files: CMPDEC.INP and xxxSKY.DAT. CMPDEC.INP: contains list of all the calibration files (all stations) needed to process the data and each file's corresponding azimuth correction, opaque cloud threshold levels for NDO, NDI, ND2 and ND3 and the thin cloud acceptance level threshold. Even if the values do not change, a separate entry must be made for each calibration file. XXXSKY.DAT : the first three characters of the file name are the 3 character field station identifier. A separate file is required for each station. The file contains the relative ratio for solar zenith angles and that angles' corresponding BETA values. The zenith angles range from the maximum of 90 degrees in increments of 5 degrees) to the minimum angle for that station which is computed as: STATION LATITUDE MINUS 23 DEGREES. See Tech Note 231 for example. Sample entries for CMPDEC.INP file: File Name: CMPDEC. INP File Date: 29 Aug 1991 on Calibration File Name CAL3V03E CAL3V03F Azimuth Correction -0.5 -0.5 ND=0 143. 143. Opaque Threshold ND=1 ND=2 150. 177. 150. 177. ND=3 183. 183. Thin Cloud Accept Lul 1.20 1.20 6.1.1 To Execute; D:\GETREF Screen output: Welcome to GETREF - Version 1.2 This program computes the ratio/normalized sky ratio distribution along with the 45/45 values. (Ten Minute Full Resolution Images Only) Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego 1991 - All Rights Reserved Site # Location 1 Site # Location - I en A WNHO MPL C-Station HELSTF Kirtland China Lake Malmstrom Ooo va Malabar Columbia Composite 1 Portable 1 1 -> Please enter the site number: 3 -> Enter the field tape sequence number (eg, 001): 100 ** PL Setup Completed ** Opening Reference File KAA100T.R45 Azimuth correction for calibration CAL3V03F = -.5 deg Reading sky background from file KAASKY.DAT Sky background read complete 1 1 7/DEC/89 23:20 84.7 93.0 1.5 97.9 2.0 100.0 23.6 0 59 59 13/DEC/89 23:50 89.9 113.9 15.9 109.9 4.5 106.0 17.1 0 D:1 6.2 SETREF Program The SETREF program is used to select representative blue or clear sky values for various times during every day on a tape. The resulting output file is called xxxxxx.REF. The four required input files are: XXXXXXt.R45 (output from the GETREF program), CMPDEC.INP (contains thick and thin cloud threshold values for all four neutral density filters), VERSION.LOG and DATEX.LST. .. You must have a minimum of one reference value and no more than 24 values per day. If a day is completely cloudy then you must selected a blue or clear sky day that is close in time and substitute it's values for the cloudy ones. Each site has a distinctive curve representing clear days during the different seasons. Form 10s from the various sites (if available) help in determining atmospheric conditions that might influence operator selection of the reference values i.e. uniform haze. ... 6.2.1 To Execute The following is an example of the screen output: .. . D:\CMPDEC>SETREF ... .. . .. .... Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego SETREF Version 1.2 19 Jul 91 Sets up reference values used in CMPDECTP Switch over to RGB if you wish. Site # Location | Site # Location o 1 6 MPL C-Station HELSTF Kirtland China Lake Malmstromi Malabar Columbia Composite 1 Portable 1 O UT A 11 -> Please enter the site number: 3 -> Enter the field tape sequence number (eg, 001): 100 -> Do you want to read a second set? (Y or N): Y -> Enter the field tape sequence number (eg, 001): 101 -> Enter the Main Menu response: AT THIS POINT SWITCH OVER TO THE RGB SCREEN. THERE IS AN ABBREVIATED PROMPT FOR ENTRY WHICH IS ALSO ECHOED TO THE CMPTR SCREEN. RGB_SCREEN 180 -1 u 4 Pro ------ 40 -1 TIME (hours) 40 -1 0 * 1 7/DEC 2 8/DEC 3 9/DEC 4 10/DEC 5 11/DEC 6 12/DEC 7 13/DEC * - Done 8 14/DEC 9 15/DEC 10 16/DEC 11 17/DEC 12 18/DEC 13 19/DEC 14 20/DEC NMV MAIN MENU Analyze data T - select new Tape V - review previous set - exit program This is a sample RGB screen minus the reference values and percent of sky represented plots. The dates that occupy spaces 1 through 14 are the days on tapes KAA100 and KAA101. You may have two tapes loaded at a time. The top plot shows the reference values for that day from count 40 through 180 and over the period of time represented by the time line on the bottom. The % plot shows how much of the sky is represented by the reference values plotted above. (See Figs. 6-1, 6-2, and 6-3) 49 SETREF PLOT FOR KAA100 10 DEC 89 180, 17 160 1504 140 130 P126- 1 110. I ORY 60 SA . . . . . . . 13 14 15 16 17 18 19 20 21 22 23 24 TIILE Cours) 807 % 404 FIG. 6-1 Normal curve for a clear day (Winter season). 50 SETREF PLOT FOR KAA100 11 DEC 89 180 170- 169 1504 10 130 K 120. $1194 as | 80 - 70- 68 50 TINUE olya! 13 14 15 1'1' 1' 19 20 21 22 23 24 នៗ % 494 w tre ............. ........ .... .. ....... . ............... .......................10 FIG. 6-2 Curve representing a clear morning and late afternoon - cloudy between 1800 - 2100 gmt. 51 SETREF PLOT FOR KAA100 13 DEC 89 170. 190 150 1913- 1384 $129 110 t . A ,,100 90 - I 884 xx xx Got 50 M .. . D VM 13 14 15 16 17 18 19 20 21 22 23 24 TIME l hours) 89, "Al hormon FIG. 6-3 Curve representing a mostly cloudy day - reference values from a clear day (10 Dec) were used. 52 The following is a description of the different options under the Main Menu and any options they might invoke. The first option is: A - ANALYZE DATA --> ANALYSIS MENU P - Plot new data R - set new Reference values S - Save reference values - return to MAIN MENU P - Plot new data --> PLOT DATA OPTION -> Enter day number (0 - stop): (can enter up to 4 days(plots) at a time) R - set new Reference values --> SET REFERENCE OPTIONS -> Enter the day number: (only one day at a time, color of day appears on the percent graph as a vertical line that moves with the cursor as well as the day number written at the start of the reference value plot) -> BUTTON SELECTION (mouse activated, crosshair appears on the screen) Left: set current position (+ sign appears at the point selected) Center: use other day values --> Use Alternate Day Values -> Enter Alternate Day #: Right: stop selection --> Analysis Menu appears again. S - Save reference values --> SAVE REFERENCE OPTION MENU 1 - Save days 1 to 7 2 - Save days 8 to 14 M - return to Main Menu (if analysis is incomplete (all days for the tape must have reference values selected) the following appears:) 1 - Save days 1 to 7 2 - Save days 2 to 14 and --> Analysis incomplete!! Save anyway? (Y or N): Y (Normal prompt when save is complete.) Save file KAA100. ref opened. Save file complete. Hit return key to continue (returns to the Main Menu) Save the file once you complete all days for the tape. The file is not saved automatically and will be lost when replaced by a new tape. The second option under the MAIN MENU: T-select new Tape --> NEW TAPE OPTION MENU 1 - get days 1 to 7 2 - get days 8 to 14 M - return to MAIN MENU 1 - get days 1 to 7 --> -> Enter tape # (eg, 001): -> Read 2nd set? (Y or N): Y (this prompt only appears with option 1) -> Enter tape # (eg, 001): Returns to MAIN MENU after the screen clears and the new tape dates are loaded into the locations 1 to 7 or 8 to 14. The third option under the MAIN MENU: V - review previous set --> REVIEW OPTION MENU G - Get previous file D - Day view M - return to MAIN MENU G - Get previous file --> GET REFERENCE FILE MENU 1 - get days 1 to 7 2 - get days 8 to 14 . (once you select either 1 or 2, asterisks appear before all of the days in that set.) D - Day view --> REVIEW DATA OPTION -> Enter day number: (It is important to remember that the day number is not the date but the position that that day holds on the screen. Once you hit ENTER the plot for that day appears on the screen, along with the plus (+) signs that denote the chosen reference values for that day. Only one day at a time can be displayed.) Press return for REVIEW MENU The final option of the MAIN MENU: X - exit program *** SETREF finished *** Switching back to the CMPTR screen the following prompt will be displayed. ***SETREF processing finished*** Stop - Program terminated. 7.0 CMPDECTP PROGRAM (VARIABLE THRESHOLDS) This program creates the cloud/no cloud decision images from the TAPRATPL (Ratio) tape. This program corrects for the scattering and zenith angles and produces ten minute full resolution images only. There are two hardware requirements: a computer with two ExaByte drives attached and a PL board. -YYY Inputs required: .. . 4 Output RATIO tape from TAPRATPL Blank tape Input files: CMPDEC.INP VERSION.LOG DATE3.LST (Kirtland site #) KAA100.REF (Kirtland tape KAA100) KAASKY.DAT (Kirtland sky background file) Output: . Cloud decision tape - each image is given a DOS header with a filename i.e.. C3891207.T01. These files may be recovered individually using EXRCVR. See TAPRATPL section for explanation of format. Cover file of the format: KAA100T.CCV Contents of the cover file: The cover file contains the following information for the tape and one entry for every tenth image. The azimuth correction. The Opaque thresholds for NDO, ND1, ND2 and ND3. The Thin cloud acceptance level. Each entry contains the following: The sequence number assigned to the CLD image. The RATIO sequence number of the image. The Date. The Time. The percentages for the following values: Offscale dark, Clear sky, Thin cloud, Opaque cloud, Offscale bright, Indeterminate, Sky Cover for Opaque (in tenths) and Sky Cover Total (in tenths.) · A sample UNI of this file follows this section. 7.1 To Execute: D:\>CMPDECTP Screen Output: welchisch Welcome to CMPDECTP - Version 1.4 This program makes the cloud/no cloud decision after correcting for scattering and zenith angles. The corrected images are written to ExaByte (Ten Minute Full Resolution Images Only) Marine Physical Laboratory - Optical Systems Group Scripps Institution of Oceanography University of California, San Diego 1991 - All Rights Reserved Site # Location Site # Location H o i 6 N 8 MPL C-Station HELSTF Kirtland China Lake Malmstrom Malabar Columbia Composite 1 Portable 1 n > M O -> Please enter the site number: 3 -> Enter the field tape sequence number (eg, 001): 100 ** PL Setup Completed ** Note: You have several options which may be changed during a run. Options may be changed by entering the appropriate keystroke, without pressing the ENTER key. All of these options take extra time, and are intended only for occasional use during a run to visually check the decision images. The Key enter options are: is to change Show Color flag D to change cover Display flag I to change Image Save flag X exit after current image ? to print current values of flags Any other key will cause the available options to be printed. Screen output cont. -> Press ENTER to continue Opening Cloud Cover File KAA100t.CCV Azimuth correction for calibration CAL3V03f = -.5 deg Opaque Thresholds : ND (0) = 143. ND (1) = 150. ND (2) = 177. ND (3) = 183. Thin Cloud Acceptance Level = 1.20 Ratio reference tables successfully extracted from KAA100.ref ANYA Writing initial EOF to target tape ***+ Image Cover Sky Cover cid Rat Off (%) Off Tenths Seq Seg Date Time Drk Clr Thn Opq Brt Ind Opq Tot Reading sky background from file KAASKY.DAT Sky background read complete 1 1 7/DEC/89 23:20 2 96 0 0 0 2 0 0 59 59 13/DEC/89 23:501 88 *** CMPDECTP processing finished *** 1 4 0 5 0 1 D:/> 7.1.1 Condensed Sample of CMPDECTP Qutput File: „CCY Cover File KAA100T.CCv Azimuth correction for calibration CAL3V03F = -.5 deg Opaque Thresholds: ND (0) = 143. ND (1) = 150. ND (2) = 177. ND (3) = 183. Thin Cloud Acceptance Level = 1.20 Ratio reference tables successfully extracted from KAA100.REE cld Rat Seq Seg Image Cover Sky Cover Off (%) Off Tenths Time Drk Clr Thn Opq Brt Ind Opq Tot Date 1 O 2 0 2 0 O لسل 1 11 21 31 21 31 7/DEC/8.9 23:20 7/DEC/89 23:30 7/DEC/89 23:40 7/DEC/89 23:50 96 95 92 88 moo 1 1 Oooo 0 0 Oooo M لا 6 11 ooo Oooo . 4 images processed for this date. 0 4 4 Total Opaque CLOUD COVER SUMMARY Cloud Cover (Tenths) 2 3 4 5 6 0 0 0 0 0 0 0 0 0 0 1 0 0 7 0 0 8 0 0 9 0 0 10 0 0 • • • 58 58 13/DEC/89 23:40 1 49 59 59 13/DEC/89 23:50 1 88 ***CLDDECM PROCESSING FINISHED*** 38 1 8 4 0 0 3 5 1 0 5 1 59 images processed for this date. 0 14 41 Total Opaque CLOUD COVER SUMMARY Cloud Cover (Tenths) 2 3 4 5 6 3 0 4 4 6 4 0 0 0 0 1 8 14 الباح 7 9 0 8 4 0 9 7 0 10 0 0 8.0 UTILITIES n contains five utility programs written for reading, writing and checking ExaByte tapes. Each program section contains descriptions of all the options available plus a sample of the screen output. 8.1 IMFIND Program The program IMFIND is used to investigate a raw data field tape. It can be used to position the tape on a certain time or to save individual images. The data on a raw field tape consists of four different images (filters used) saved for each minute. The images saved for a ten minute image are full resolution and the images saved for a one minute images consists of every thirty third column and row. In addition, for the ten minute images only there is an one minute image (reduced resolution) also saved. One end-of-file mark is written at the beginning of the tape and after each hour. Two end-of-file marks are written at the end of each day and the end of the tape. 8.1.1 To Execute; D:\>IMFIND Screen display: Image Find--program version 2.0. Data search in progress. ## Station=*NO TIME=23:20:03 DATE=07/DEC/89 -----------------TEN Read one minute image? (y/n) y Doing one after ten TIME=23:20:03 DATE=07/DEC/89 (F) Skip forward. (B) Skip backward. (S) Save all four quadrants. (T) Show next "ten"-image (N) Show next image. (D) Display a time. (Q) Save a quadrant. (1) Show QD#1 (2) Show QD#2 (3) Show QD#3 (4) Show QD#4 Please enter choice (default=T): Description of program options: (F) Skip forward.: allows you to skip forward a specified number of end-of-file marks. Positions the read head after the end-of-file mark. Prompt: Please enter choice (default=T): F Forward Skip. Enter number of EOF's to skip: x (B) Skip backward.: allows you to skip backward a specified number of end-of-file marks. Positions the read head after the end-of-file mark. R Prompt: Please enter choice (default=T): B Backward Skip. Enter number of EOF'to skip: x (S) Save all four quadrants.: Allows you to save all four quadrants (images) for a particular time. It is important to remember that if you want to save the images exactly at the current position do not answer "y" to the prompt: "Read one minute image? (y/n)" as this will move tape to the next image. Prompt: Please enter choice (default=T): S Enter file name. 17 characters max.): XXXXXXX (xxxxxxx ] ##### SAVING Quads ########### XXXXxxx1.DAT XXXXXXX2.DAT XXXXxxx3.DAT XXXXXXX4.DAT (T) Show next "ten"-image.: Allows you to view the next ten minute image on the tape. However, if you do not enter "y" to the "Read one minute image? (y/n)" prompt just displayed and you select (T), the one minute after the ten minute image is displayed. You have to answer "n" to the read prompt again and then select (T) again. Prompt: Please enter choice (default=T): T or hit RETURN Station=KAA TIME=00:21:02 DATE=08/DEC/89 TIME=00:30:01 DATE=08/DEC/89 ------TEN Read one minute image? (y/n) (N) Show next image.: Displays the very next image on the tape. Prompt: Please enter choice (default=T): n TIME=00:31:01 DATE=08/DEC/89 -----ONE TIME=00:31:01 DATE=08/DEC/89 60 (D) Display a time.: Allows you to view one or ten minute images without using the (T) or (N) options. Also useful for checking blocks of time for missing images. Prompt: . + + + Please enter choice (default=T): d TIME=00:32:01 DATE=08/DEC/89 Use leading zero if hour <10. Please Enter Time. (HH:MM): XX :XX (Displays time for every image between starting image and selected time) (Q) Save a quadrant.: Allows you to save any one of the four quadrants. Prompt: Please enter choice (default=T): 9 Enter quadrant to save: 1 Enter file name with extension: XXXXXXX, dat ****** SAVING IMAGE ######### (XXXXXXX.dat ] (1) Show QD#1, : (2) Show QD#2, (3) Show QD#3, (4) Show QD#4 These four options allow you to view any one of the quadrants. Only QD#1 is displayed with any of the other options in this program. 61 teleco...-- *-- -- 8.2 EXBACK Program EXBACK is an EXabyte BACKup utility. It is designed to copy files from disk to be stored digitally on 8mm video cassette tapes via SCSI interface to EXABYTE. There are two ways that the program can be run. One is by menu and the other is by command line. EXBACK will not back up files that are hidden. Hidden files are files that do not appear in the directory listings. These files include system files, such as IO.SYS, which are used by the Disk Operating System (DOS). WARNING: If EXBACK is not used in append mode it will overwrite any existing information already written on the tape. As a result, when the program is initially started the user will be prompted to press the ESCAPE key to continue. If any other key is pressed the program will abort. 8.2.1 EXBACK Using the Menų To use EXBACK, type "EXBACK" at the prompt. A menu will be displayed. EXBACK will assume the user wants a menu when no parameters are specified. Parameters are explained in the command line section. The "a" option is used to append to tape. This is the default. If the rewind option "r" (this option will be explained later) is not used, the "a" option does not need to be specified. EXBACK will automatically append to the tape. When EXBACK is in append mode the end of the data on the tape is searched for before the information is written to tape. The "b" option is used to mark a file as having been backed up or archived. When used the DOS file archive bit is flipped to mark the files as having been backed up. The "C" option, when used, checks the file to see if it has been changed since its last backup. This allows the user to back up only new files and files that have been changed. This option will not mark the file as having been archived. The "d" option is the backup option. When chosen, EXBACK does a search through all directories looking for the files specified. When using this option, do not specify the drive nor the path or EXBACK may not backup the files you intended to back up. Start EXBACK on the drive that you want to back up. Note about the archive mark: The archive is marked by flipping the DOS archive bit of the file. This is the same archive bit that is used by the DOS backup utility. Thus if the "C" option is used to back up files after a DOS backup, those files backed up by DOS will not be backed up by EXBACK. Similarly, if the "6" option is used to back up files, these files will not be backed up by the DOS backup utility. It is suggested, if the user is going to back up a disk onto both tape and disk, to do the tape backup first and use the "c" option and not the "b" option. This will leave the archive bit unchanged for the DOS backup utility. See a DOS manual for more information on the DOS backup utility. 62 The "e" option allows the user to specify files for backup. Files may be backed up by giving the exact file name or by giving a file pattern. When the "e" option is chosen, the user will then be prompted for a file name or pattern. At this point the user may enter one file name or pattern. The "e" option must be chosen once for every file name or pattern. A file pattern is a file name that contains a "wildcard". The wildcards are the "*" and the "?". An "*" will match zero or more characters and the "?" will match exactly one. Examples of file patterns: Will match any file name ending in ".img". pic*.* Will match any file name starting with "pic". *img NOTE: Characters to the left of an "*" and before a"." must be exact. Any character to the right of an "*" and up to the dot will be matched. If there is an "*" after the "." it will work the same up to the end of the name. pic*m.*kj Will match the same thing as pic**. The "m", "k", or "j" will not effect the pattern. p?c.ext This example can only have the second character different. (NOTE: pc.ext is not a match, but if the pattern is changed to p*c.ext pc.ext is a match.) ???.?? This example will match any file name that has three letters before the dot and two letters after. Drive names and paths may be specified with the file name. There may not be any wildcards used for the drive or path, but the file name may still contain wildcards. A drive letter need not be specified with the path or the path need not be specified with the drive. Example drive and path specifications: D:pic.img Will match the file "pic.img" in the D drive's current directory. D:\pic.img Will look in the root directory of the D drive for the file "pic.img". \pic.img Will look in the root directory of the current drive for the file "pic.img". Vimage\pic.img If a directory named "image" exists in the root directory of the current drive, this directory will be searched for the file "pic.img". D:\image\pic.img If a directory named "image" exists in the root directory of the D drive, this directory will be searched for the file "pic.img". 63 The "q" option will quit the program. The "r" option rewinds the tape. If the "r" option is specified and the "a" option is not, EXBACK will start writing at the beginning of tape. If there is any previously existing data, it will be overwritten and destroyed. The "u" option resets all the options to the default. It will not remove the file names and patterns entered by using the "e" option. To remove file names and patterns the user must quit EXBACK an start over. After the user selects the parameters, the user must press the ESCAPE key before EXBACK will begin processing. 8.2.2 EXBACK Using the Command Line mman To use EXBACK in command line form, the user must type EXBACK at the DOS prompt followed by a list for parameters. D:\>EXBACK [-options] [file names ...) [file patterns ...] The parameters are the options, file names and file patterns. If an incorrect option is chosen a listing of the usage will be displayed. If no parameters are specified EXBACK will assume the user wants to run the program in menu form. The order of the parameters will not affect the way EXBACK saves files. . If no filename(s) and/or pattern(s) are specified no files will be saved to tape. The options are preceded by a "." or a "/". Both symbols have the same meaning. The user may specify one or more options after a single option symbol or specify each option in the line with its own option symbol. The options were explained in the section EXBACK Using the Meny. 64 8.3 EXRCVR Program EXRCVR is an EXabyte ReCoVeR utility. It is used to recover files and display the file names of files saved by EXBACK on 8mm video cassette tapes. 8.3.1 EXRCVR Using the Menų To use EXRCVR, type "EXRCVR" at the prompt. EXRCVR will assume the user wants a menu when no parameters are specified. The "d" option is used to display the names of the files on the tape. It displays all file names from the current position of the tape unless the rewind option is also used. If the rewind option is also used then the names of all files on the tape are displayed. When the display option is used no files will be written to disk. DO The "e" option allows the user to specify the files for recovery. Files may be recovered by giving the exact file name or by giving a file pattern of files on the tape. When the "e" option is chosen, the user will then be prompted for a file name or pattern. At this point the user may enter one file name or pattern. The "e" option must be chosen once for every file name or pattern. A file pattern is a file name that contains a "wildcard". The wildcards are the "*" and the "?". An "*" will match zero or more characters and the "?" will match exactly one. Drive names and paths may be specified with the filename. There may not be any wildcards used for the drive or path, but the filename may still contain wildcards. A drive letter need not be specified with the path or the path need not be specified with the drive. The "h" option will stop tape recovery after one file is recovered, regardless of the number of files specified. The "n" option is the no overwrite option. It will not allow a file from tape to overwrite an existing file on disk if the names match. The "p" option restores files to the directory that they were in when they were saved. If the directory does not exist EXRCVR will try to create it. If the directory can not be created it is ignored. All files are saved to the current drive unless the "s" option is used (see below for "s" option). If the "p" option is not used, the default directory is the current directory. The "q" option quits EXRCVR. The "r" option will rewind the tape before displaying file names or recovering files. The "s" option will recover files, writing them to the drive they were on at the time they were saved. If the "s" option is not used the default is the current drive. The "t" option is the time option. When used, if the name of a file on tape matches one on disk, the dates are compared. If the file on tape is most recent, the file on disk is overwritten. Otherwise the file on tape is not written. The "u" option resets all the options to the default. It will not remove the file names and patterns entered by using the "e" option. To remove filenames and patterns the user must quit EXRCVR and start over. The "w" option writes a directory listing of the tape to a file called "DIR.LST". This option can only be used when the "d" option is specified. 1 user m After the user selects the parameters, the user must press the ESCAPE key before EXRCVR will begin processing. 8.3.2 EXRCVR Using the Command Linę To use EXRCVR from the command line form, the user must type EXRCVR at the DOS prompt followed by a list of parameters. The order of the parameters will not affect the way EXRCVR recovers files. - D:\>EXRCVR (-options) (file names ...) [file patterns ...] The parameters are the options, file names and file patterns. If an incorrect option is chosen a listing of the usage will be displayed. If no parameters are specified EXRCVR will assume the user wants to run the program in menu form. The options are preceded by a "." or a '1". Both symbols have the same meaning. The user may specify one or more options after a single option symbol or specify each option in the line with its own option symbol. If no file name(s) and/or pattern(s) are specified, no files will be recovered. Drive names and paths may be specified with the filename. There may not be any wildcards used for the drive or path, but the filename may still contain wildcards. A drive letter need not be specified with the path or the path need not be specified with the drive. The options were explained in the section EXRCVR Using the Menu, 66 8.4 EXCOPY Program EXCOPY is an Exabyte tape copy utility. It is designed to copy all data from one tape to another. EXCOPY assumes that Drive () is the source (read) drive and Drive 1 is the target (write) drive. EXCOPY writes an initial and final filemark to the target tape, irregardless of any filemarks detected on the source tape, and copies a detected filemark to the target tape after dumping any partial buffers read from the source tape. EXCOPY takes about 5 hours to copy a full weekly raw data tape. Extensive status and sense checking is performed after all function requests. Output of every significant status line written to the screen is echoed to a user-named logfile *.cpy. Every read performed after a filemark is sampled and the first few hundred printable ASCII characters are printed to the screen and logfile. To run EXCOPY you will need a computer with two Exabyte drives. Place the tape to be copied into Drive 0 and a blank tape into Drive 1. Make sure that the write protect tab is closed on the source tape (drive () and open on the target tape (drive 1). If not the program will halt and tell you to do so. The program can then be continued by pressing Enter. 8.4.1 To Execute The following is an abbreviated example of an EXCOPY run: D:\>EXCOPY EXCOPY Version 2. 5 03 Jun 90 Enter a filename, usually the source tape ID, up to 8 characters long: co1014 Filename entered: COL014.CPY -- Be certain read (source) tape is in drive 0 and is -WRITE PROTE- CTED-. -- and load -WRITE ENABLED - (target) tape in drive 1. NOTE: In this version of excopy, filemarks ARE copied from the source tape. Regardless of source tape contents a filemark is always written at the beginning and at the end of data on the target tape. 4/4/90: ALL READ MEDIA ERRORS ARE IGNORED FOR TESTING. Hit any key to start copying... 67 8.4.2 Condensed Sample of Screen Output and EXCOPY Qutput File: „CPY EXCOPY version 2.5 03 Jun 90 logfile: COL014.CPY run 05/04/91 13:08:16 NOTE: In this version of excopy, filemarks ARE copied from the source tape. Regardless of source tape contents a filemark is always written at the beginning and at the end of data on the target tape. 4/4/90: ALL READ MEDIA ERRORS ARE IGNORED FOR TESTING. drive 0 UNIT ATTENTION: RESET or cartridge may have been changed. drive 0 EOM: end of medium (LBOT or LEOT) drive 0 LBOT: logical beginning of tape. drive o operation 0 returned status:2 drive 0 UNIT ATTENTION: RESET or cartridge may have been changed. drive 0 EOM: end of medium (LBOT or LEOT) drive 0 LBOT: logical beginning of tape. drive 1 UNIT ATTENTION: RESET or cartridge may been changed. drive 1 EOM: end of medium (LBOT or LEOT) drive 1 LBOT: logical beginning of tape. Writing initial filemark to drive 1... System time at initial transfer: 13:09:25 drive 0 operation 8 returned status: 2 drive 0 received valid Exabyte CHECK CONDITION. drive 0 FMK: filemark encountered. drive 0 total detected filemarks: 1 System time: 13:09:40 Blocks transferred: 0 (read) 0 (write) Writing filemark 2 on target tape. Read after filemark: COL QD #1 LONG 92DEG 49MIN W LAT 38DEG 49MIN N DATE=16/MAY/89 TIME=12:10:00 IRIS=061 OCCL=000 ND=0 SP=0 drive 0 operation 8 returned status: 79 (This is a busy signal) drive 0 received valid Exabyte CHECK CONDITION. drive 0 FMK: filemark encountered. drive 0 total detected filemarks: 2 ... Writing partial buffer: 53 blocks System time: 13:17:37 Blocks transferred: 25493 (read) 25493 (write) ... Writing filemark 3 on target tape. drive 0 operation 8 returned status: 2 drive 0 received valid Exabyte CHECK CONDITION. drive 0 FMK: filemark encountered. drive o total detected filemarks: 3 System time: 13:17:54 Blocks transferred: 25493 (read) 25493 (write) Writing filemark 4 on target tape. drive 0 operation 8 returned status: 2 drive 0 received valid Exabyte CHECK CONDITION. drive 0 BLANK CHECK: End of data or logically blank tape found during read. System time: 13:18:09 Blank tape detected on drive 0, ending run. Writing concluding filemark to drive 1.... System time at copy completion 13:18:19 System time at initial transfer 13:09:25 Drive 0 total detected filemarks: 3 Drive 0 unprocessed blocks: 160 Drive 0 read data error count: 545 Drive 0 tape remaining (blocks): 2058809 Drive i total filemarks written: 4 Drive 1 write data error count: 117 Drive 1 tape remaining (blocks): 2053737 Blocks transferred 2593 (read) 25493 (write) (THIS IS THE END OF THE FILE) A good copy writes identical (or close to it) numbers of blocks as read, and the (cumulative) read/write data error counts are low relative to the amount of data transferred (the tape remaining values should confirm this). The error count does not represent lost data, but data for which repeated tracks had to be laid down until a successful read or read-after-write occurred. Any differences between the read and write blocks transferred are due to data which could not be read from the source tape (after 100 attempts by Exabyte, including backing up over the data and re-reading it) or could not be written. Only a true hardware failure (when Exabyte ejects the tape) or a target tape media error halts a run prematurely. 8.5 WRIMGS Program Il The WRIMGS program reads and writes 1024 column x 960 row ExaByte tape images to and from FG-100 frame grabber image memory. Individual 512 x 480 (standard RS-170 format) images can be viewed in any quadrant. The quadrant may be written to or from a user named 512 x 480 diskfile. This is 245,760 bytes or about 1/4 Megabyte of data. If insufficient disk space is available then an error message is displayed. WRIMGS reports failed tape I/O attempts to the screen, at which time the user may rewind or eject the tape. The red ExaByte ACCESS light and the green READY light are both lit during tape transfer. You can watch input image lines advance down the screen as they are read in. A number of tape handling options, including diskfile or tape read/write functions, mouse, SCSI and FG-100 board are supplied. 8.5.1 To Execute: D:\>WRIMGS This is the screen appearance after the program had made contact with both the tape drive and the FG-100 frame grabber: WRIMGS Version 29 Aug 29 Initializing FG100. ..... Test if ExaByte is ready. ...LBOT or LEOT encountered ...Beginning of Tape ...Cartridge Write Protected ..... Exabyte ready. Select and Exabyte I/O function: WAIT FOR Exabyte READY (green) LIGHT 1. or "X": EXIT WRIMGS PROGRAM 2. or "S": SKIP AN EOF or "B": BACKSPACE OVER AN EOF 4. or "E": WRITE AN EOF MARK TO TAPE 5. or "L": REWIND THE TAPE (TO LOAD POINT) 6. or "J": EJECT THE TAPE "F": WRITE A DISK IMAGE FILE TO TAPE 8. or "T": WRITE AN RGB IMAGE TO TAPE 9. or "P": PAN & SCROLL OVER A SCREEN "D": SAVE PRESENT RGB IMAGE TO DISKFILE 11. or "W": WRITE RGB IMAGE FROM DISKFILE 12. or "R": READ IMAGE FROM TAPE 13. or "U": FIND BEGINNING OF UNWRITTEN TAPE 14. or "I": INITIALIZE THE FG100 BOARD 15. or "H": HARD RESET THE ASC-88 SCSI BOARD 16. or "M": USE MOUSE TO DISPLAY ASCII DATA OOOOWN 999999 0 0 0 0 0 هر م 0 8.5.2 The following is a somewhat more detailed description of the options available. Option: Description Returns you to DOS prompt. 1. or "X": EXIT WRIMGS PROGRAM 2. or "S": SKIP AN EOF Advance tape to START of next filemark. 3. or "B": BACKSPACE OVER AN EOF Rewind tape to START of previous filemark. 4. or "E": WRITE AN EOF MARK TO TAPE Write filemark at present tape position. 5. or "L": REWIND THE TAPE (TO LOAD POINT) Find physical beginning of tape. 6. or "J": EJECT THE TAPE Open tape drive door. 7. or "F": WRITE A DISK IMAGE FILE TO TAPE Write named file (of size 245.760 bytes) to tape. 8. or "T": WRITE AN RGB IMAGE TO TAPE Write image presently on RGB screen to tape. 9. or "P": PAN & SCROLL OVER A SCREEN Enter 1, 2, 3, or 4, to view a quadrant. Or, place upper left corner of RGB image at coordinates (column, row). See 12 below for diagram. 10. or "D": SAVE PRESENT RGB IMAGE TO DISKFILE Make a named file (of size 245,760 bytes) from present RGB image. 11. or "W": WRITE RGB IMAGE FROM DISKFILE Place named diskfile on RGB screen. 12. or "R": READ IMAGE FROM TAPE Read an entire 1024 x 960 image onto FG100 image memory. Note this if four frames, usually referred to as "quadrants": (0,0) (1023,0) (0,479) -------I-------I 1 1 1 2 1 |-------|-------|| 1 3 1 4 1 -------I------- (0,959) (1023,959) Use Pan and Scroll to view outside quadrant 1. 13. or "U": FIND BEGINNING OF UNWRITTEN TAPE Read the entire written portion of tape from present position, until blank tape is encountered. This can be slow, but also very instruc- tive if you have trouble navigating through a tape, as you can watch every frame being read in. 14. or "I": INITIALIZE THE FG100 BOARD Return the FG100 board to the condition it was in when you first powered up. Many of the above functions do this step automatically before they run. 15. or "H": HARD RESET THE ASC-88 SCSI BOARD Free a hung tape drive or SCSI board without having to reboot the entire system. 16. or "M": USE MOUSE TO DISPLAY ASCII DATA LEFT mouse button: displays any printable ASCII text in the row under the cursor. MIDDLE mouse button: displays entered line (0-959) as printable ASCII text. RIGHT mouse button: returns to menu. 72 9.0 ACKNOWLEDGEMENTS This work was sponsored by the Geophysics Directorate of Phillips Lab, under contract #F19628- 88-K-0005. Thanks to Mr. Donald Grantham for his support and guidance. I would also like to thank Richard W. Johnson and the members of the Optical Systems Group at MPL, who developed the WSI system and its software. Thanks to Tom Koehler, Gene Zawadzki, and John Malo for documentation excerpts used in this report. And special thanks are due to Carole Robb and Monette Karr for their outstanding publications support. 73 APPENDIX A MARINE PHYSICAL LABORATORY, 0701 of the Scripps Institution of Oceanography San Diego, California 92152-6400 AV88-046t 22 Aug 88 Technical Memorandum To: R. W. Johnson From: John Malo Subject: READTPQC - tape read program m The new tape read program creates two types of files. LAN files and DGN (diagnostic) files. There is still one LAN file created for every LAN that is on the tape. There is only one diagnostic file created per tape. A program will be written to split up the diagnostic file into individual files--one for each day. There are a few new terms being used in the tape read program. DARK SIGNAL- was know as thermal average amLAN- this time is 3 hours before LAN pmLAN- this time is 3 hours after LAN There is a change in the way the dark signal is checked. 1) The set of pixels was a 5x5 and is now a 6x6 so as not to favor even or odd rows. 2) The location of the check was moved 20 pixels horizontally and 20 pixels vertically toward the center. 3) Previously there was only one check in the upper right corner. The lower left and right corners were added. The dark signals are checked once an hour and at amLAN, LAN, and pmLAN. At amLAN, LAN, and pmLAN the pixel values that the signals are taken from are also written to the diagnostic file. Another version of this program will be written for reading tapes that are not on Z-time. This is only so that the LAN image can be checked and saved. New constants will also be needed to fix the LAN equation for 1989 and beyond. 100 - P . ... . .. . . . . . VAGYVVVVV. 1 22 .... O LE KYNNY. . . . . . 2 . . ..... . - - . . . . . + + - . . . . ►u. . . . . + + + + . $ 11 . . . 1 . . . . . . . " . . . . . 1 . . . . . . . TO.. . . + 1 1 1 1 1 1 . . A . . . . . . . . - . . . . . . . . + + + OOOO. 1 . . . . . N1 . . - - - 1 . . . + - + . . . + + + . . + .. 0 . + + . . . . . . . . . . . + • . + - . . . . . 1 + + + . 1 . . .. . . . .. + - 1 1 + + + + V . 1 P . . 1 . + 1 . . 1 . . .. . * .. - . END GET amLAN, LAN, & PILAN .. 1 e . . • - .. . . . . . . . . 22 August 1908. . FINISH READ OF IMAGE . + - + 1 .. . . SAVE IMAGE . . . 1 . . r . . . . . . . . . OO . . 1 . GET SIGNAL RAMPING INFORMATION AND ALSO DISPLAY WITH PIXEL VALUES an OR biu . . ... L .. I . . . Ni ... . 0 2 . . . . . 0 . 1 TO . > .. .... - + V . . . USIC 1 . . . . . N . 1 XV. . . . . YA O . PS + YA X2 . ri . . SO V . . NI . P . T . . ..IS . VU . . Y 2 . . . SONEL CHECK FLUX CONTROL . NS $ . YA DO SPECTRAL CHECK S. . PO ! . . AN . SVS . . SA . . 28 . I . NI . . . . . . . . A . . . . . . .. " . . . .... . . . . . . . .. . I . . A ..... .. . - . . . CI . • .. . O . . . . 1 . PP: . . . . NI. . . . . 1 . + . . . 1 . . . . ! . . . . . . . NY . . . . . . . . . . + L + + ” + - . . ME, LVĖS . . . . . . . ( QUALITY CONTROL VALIDATION ) . . . . . - SET UP IG-100 SET COUNTERS READ FIRST LINE OF IMAGE TO GET HEADER INFORMATION . | DONE? GET OCCULTOR READINGS YES YES HAVE amLAN, LAN, & AMILAN BEEN SET YET? DETERMINE TYPE OF IMAGE FINISH READ OF IMAGE CHECK OCCULTOR amLAN, LAN, PILAN, OR JUST 10 MINUTE IMAGE? 1 ! ! 10 MINS ! . . . .. . + . •O . ... T . . . . . - . + . . . . . . . . . . . . 1 . + + L . X D . .. NAS . . . . . C Y . MU . . . . . . .: . . 1 t . . . SC . . CHECK RAMPING . : ! . . . . . . 1 . . . . . .. . ... . ... . . . . . . . .. . . . 2 . .. . . X.25 . 27. . . . ! 1 ! . . - - - . + . . . . . . . • . 1 . . + . 1 € + 1 * 1 . 1 - . . 1 . . . . . . . . . . . . + 42 . . . . . . . O . . . . . D . . . . . . . . . . P 2 . CO . . . . . . . . . * . . . . 1 . 1 . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . $ + + + + . . . . . . . . . 1.2. . . . . . FIND NEXT IMAGE . . . . - . . . . . . . . . . 1 - . 1 - . . . an NEW DAY? ''.... 37. w . . . 0 . . . . . . ! LA • . . . 1 . O . . . . 1 . . . . . . . . . . . _ . . . . . . . . . . . . . . . . . . . .. . . . . . . . ........ . . . . . . . . . . . . . . . . . . . . . . 7 . .. . . . . . . - TAL . . . . . . . 75 APPENDIX A MARINE PHYSICAL LABORATORY, 0701 of the Scripps Institution of Oceanography San Diego, California 92152-6400 AV88-058t 04 NOV 88 Technical Memorandum To: R. W. Johnson From: John A. Malo, Jr. READTPQC.EXE and DGN.EXE Subject: This memo summarizes the use of READTPQC.EXE and DGN.EXE. DCI se To execute READTPQC put a tape in the Exabyte and type READTPQC at the prompt. When READTPQC starts, information similar to the following will be displayed: . Readtpqc--program version 4.0. Data Search in progress. ## Time/Date: TIME=15:10:04 DATE=26/APR/88 Station=WSH Please Enter Tape Number >> At this point the tape identification number is entered. This number should be a number that is less that 1000. If the station name can not be identified the READTPQC will ask for it before it asks for the identification number. The line that reads: Data Search in progress. ## may or may not appear. When the tape read program finishes, the output should look similar to the sample output below: 1 Qu ----------------ONE Quad Time Iris Occultor ND SP 1 00:55:00 156 180 0 0 #2 00:55:02 156 180 0 1 #3 00:55:03 156 180 0 2 #4 00:55:05 156 180 0 3 Data search in progress.......... . . . . . . . .. . .. . . . .. . .. . . . .. . .. . . .. . .. . . . . . .. . . .. . . . .. . .. . . . 72 .:. Finished 00:55:00 Ten Minute Image count= One Minute Image count= Stop - Program terminated. 644 D:\TAPEQC> 76 APPENDIX A The files that will be created by READTPOC are a diagnostic file and a LAN file for every local apparent noon on the tape. The diagnostic file is named in the form LLL###.DGN. The "LLL" is the three letter identification and the "###" is the tape identification number. The LAN files are named in the form LLL###D.LAN. The "LLL" and the "###" correspond to the diagnostic file and the "D" in the name corresponds to the day on the tape. The day will be a letter in the range A-G. DGN.EXE takes the diagnostic file created by READTPQC and divides it into separate files for each day. To execute DGN.EXE type "DGN filename". More than one file name may be listed. The file name is of the form "LLL###D.DGN". The "LLL###" is the same as the diagnostic file it came from. The "D" is the representation of the day as in the LAN files. At the end of every file is a list of totaled diagnostic errors: 1) Spectral Errors - Occurs when the spectral filter is out of sequence. 2) Occultor Errors - Occurs when the occultor changes more or less than 15+-2 degrees per hour. If images are missing this error could be flagged. 3) Signal Errors - When the dark signal rises. 4) Image Errors - When the signal in a given quadrant is too high/low. 5) Minute Errors - When the time skips ahead or back. 6) Ten Count Errors - When the image count jumps forward or back on a ten minute image. 7) One Count Errors - When the image count jumps forward or back on a one minute image. The attached page is a flow chart of READTPQC.EXE version 4.0. 77 . . . . . . . . . . . . . . . . . . + . . . . . . QUALITY CONTROL VALIDATIONS O4 NOV 8 8 SET UP FG-100 . . . . . . . . . . . . . . . . . . SET COUNTERS ? . . READ FIRST LINE OF IMAGE . . . DONE • • • • • . . . . . .. - - END . . . READ HEADER INFORMATION FOR QUADRANT 1 ............... . - . . . . . . . . . . F QUADRANT 3 . . . . . OKS . DETERMINE TYPE OF IMAGE . . FINISH READ OF IMAGE + . + . . 1 + 1 . . 0 0 1 0 0 0 COUNT IMAGE AND DO MINUTE CHECK RESET COUNTERS CHECK FOR NEW DAY NOT NEW DAY UPDATE & CHECK OCCULTOR READING GET arnLAN, LAN, AND POLAN UPDATE HOUR COUNTER LAN PULAN JUST TEN OR ONE CHECK TIME: DILAN, LAN pMLAN, OR JUST A TEN OR ONE MINUTE IMAGE IF HOURLY TEN MINUTE IMAGE CHECK RAMPING GET SIGNAL RAMPING INFORMATION AND DISPLAY WITH PIXEL VALUES . . . . - . . . IF LAN SAVE IMAGE FINISH READING OF HEADERS 1 . + + + . . . . . . . . . + . + . . + DO SPECTRAL CHECK CHECK FLUX CONTROL 1 1 11 78. APPENDIX B SI . 1 . . 00 11 - . . 2 . . 1 + 1 - TO . . . . . . 1 . . . . . . .. . . 1 . . . . . . . . . . . . . . . .. S . . . + + + + . .... . . . . . . VX . . . . . . . . . . ! . . .. . . . . .. 16.. . . . . . . . . . . . . . . . . . . 1 . . ....... . . T . . . . . . X .. . 1 . . . 10 X . . . . . . _ . . . S . . . . NO TOP LE_._+ 129 . , D + .. . Trent 1 1 71 .! .. .. . . . LU.AL . . . .. 1 . . T CDL . 1 . . + . . . . . . . . . . . .. . . . . + . . . . . . . . . . 1 . 0 . . X . . A . . . T To Do Do X . . . 2000 . . U 2 . . . •. .• DOOD.000 . . . . . . . . . . ... . . . 41 . . . . . . . . . 4 . . . . TA . . 2001 . . . T . . . 0 ! . - 4. . 17 D . . . . . . O L 17 . US TIITTI LILI 11 . . . . . . . . i NO. . . : . . . 0 .. . C 1 . 1. .. 1 .. . 1 . . L . DT . . AN . .. . . . . . X . ... TY . . X . . - . + 1 . . . . . 00 . * + 2 T.. + . 2 . 0 ._ DALIT + + ' .. • . . ... . . . " 1.. .. . .... . . . 4 . . . . . .. . . .. . . . . + SONO .00 • . 5 2 . . 1 . . 09 . ! . . . TATO A ILLA . . 4 . OXO TOD TO D . u 6 . .. . ! 0 .. n • . .. . ! . . . VA . . . . 09 . . .. . NO . . . . ....... . . . .... °•°•.. . . . . . 2 . . P . ! OOO ! ! 100 20 . .... . . .. . •.• . . . . ! T. 1 . HD ! . . . . •. . TII . . . . . 0 . . . . . . . . . ! . .. . . . . .. . . ! . ! YIT . .... 16 . T . . . . . . . .... O120 . P . . .. . . . . .. . O . . . C . .. II . . . . . . . . . ... . . ... . .. M . - .. ...... . . . .. . . . . . . ... . . .. . L . .... . . . . .. .::: . .. .. . . . . ... . . . ... ! 2 . .. . . 1 . . ... . ... .. . . .19 . . . . . 1 . 1 ...... .. . .. . 1 . .... . 1 .. D * .. # 5 . ON " 1 T • - . .. & . . NO OCCULTOR STRAY LIGHT S . ... ... ... . OCO ... . . . .. . TOO. 0000 . .. . . 4 • . . . . . CPU 2 . . . 6 . 1 - A . . . . 1 . . . 1 . 1 . . IXOS + 60+ . . . . • . - * 2 . . • . . . . . . • . 1 . . D1 . • . . . . . • . . • . . . • . . + . . + . . . .. . . . . 1 + . 1 . . . - . . . . 1 .. . . . L . . 1 SU DO 1 + . . 1 1 _ . . . . " AY - O . 1 + ! + O . K . . 1 1 . 1 . . . . .... . . . + . . . . . . + . T . - . .... ... . 1 + T . . T O . + 1 1 + 1 DI . .. . ......... . . ... 1 1 . . . 10 . 1. 9 ... .. . 1 A ... . . . D XIX . . . 1 . .. . . . . SA . . . . . 0 . . WOW! + . .. . . . 0 . . . + . . . . .. ... OX . . . . 1 . .. . 1 . . . . . ... H . + . 1 . O 1 .. . 20 ... . . 1 . ... ..... ...... . . 9 . 1 . . . . . . . . . . . . + . .. .... ...... . . . . .... . . . . . N . + . TI . . . . . 1 1 . . CIT . . . .. : . 0 . 1 + . . 1 . . ... .. . . 0 . + . . YO . . 1 * 1 U LU . . ... ..+ 9 L . - + .. DILI ... . . . .. . TO . FIL . . ... . . . . _ . . . 1 .. . . . . . . . . . . . . . .... ... . . . . . . . . .. . . . . . E . . . . . . ... . . . . T + . .... . . . . 1 91. . . 2010.. . . . . . . + . ... 42 TO . . . . . OXAN • .... 06 .. CL . CE 41 . 11 . 24 .. A . . - . . IT < 1 . . . . . . . . 1 . C - * . . . . . . . . . ! . . . . . A .. . . VOD . 1 - + + + + + + + + 1 + 1 - . TO . . . 1 . SA A 0 . VET. WRONG ARM OCCULTOR OFF SUN 79 APPENDIX B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 . . . . 00 . . . . 00 . .. . . . . . . . . . . . . . . O . . OO! . . . . . .. . . . . . . . . . . . . . . .... . . . 100. . . . . .... . . . . . . " . . . . . . . . . . . . . . . . . . . . . . Od TO . . . . . . . . . . . . . . . . . . .... . . . . . . .1 . . . . .. . .. . . . . . . . . . . . . . . . . . . . . . . . . . . ..... . . . . . . . . . . . . . . . - - ...... . .... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ........ . . . . . . . .. ..... . . . . . . . . . .. . . . . . . . . ..... . ......... . . . ........ . . . .. . . . . . .. . . ..... . . . . . . . . . . . .. . . . . . . . ....... . . . . . . . . . . . . . . . . . . . . . . . . . . ... . . . . . . . . 4 ...... . . . . . . . . .. . . 4 . . . . . . . . . . . . . . . . . . . . 4 . ........ . . . . . . . . . 1 . . . . . . . . . . O . . . . . . 0 . . . 1 0 . T . . . . . . . . . . . 1 A . - - - - RAINDROPS ON OUTSIDE OF THE DOME WET SNOW ON THE OUTSIDE OF THE DOME .. . . ....... ... . . . . . OOO. ..... ..... ...4 .. . . . 0 0.000 . . OOO.. . .......4. ... .. .. . 0 .... . .. .... .... . ... . . . ..... .. ........ .. ... .. .. ... 0 ...... . .. . . . . . 61 . . . . . . . . ..6 . . . . ! . . . . . . . . . . . 0 . . .. 000 . . . ... . . . ...6 . ..... .. 000 . 0 . . . . . 1 . . . O 0 . . . . . . ......... OOO . CON O 06 . 1 .... . . . . . . . . . . .O. . . . . .. . . . . . . . . . . . . O 2 . . 104 PM U . . IL NIS . . TT . . . .. . . . . . . . . . . . . . DRY SNOW ON THE OUTSIDE OF THE DOME - BOTTOM EDGE ICE ON THE OUTSIDE OF THE DOME - BOTTOM EDGE 80 . . . . _ ._ ._._ . . ! . TO . APPENDIX B .. 0 . I . # . . . ! . . . . ! . . ! . . . • * . I • . • . . • • . . . . • . . . . . . 1 . . . . . + - • . . . . . . D . . . . . . 1 . 1 . 921. . . DIT + . LIT . . .. .... 1 . .... . . . . . - - . ZE . P GO IT ... to . *..10 . 09. . . . . . . • - . . VA . TI . 1 . . LLLLLLL 1 . . . . . * . TF 1 . L 1 + . . . P . . . . . . . . T ...... 0..... . LLI. L T . TID . . . . . . . . I • . . . . . 5 . . . . 1 - - . . . . . . . . . . . . . . . . . . . . . . ! . . . . . ...... . ... . OX MOOK A . . . . . . . . 1.00 02 OX . . . . .. . . . . 01. . C . . . . . ... 1 . . . . . . . . . . . . . . . L VAN . - - 9 . . 1 - * UL. . .. . . . . . 1 . . . . . . .. . ...... . . - O . . . . . . . . . . ... . . . . CONDENSATION ON THE INSIDE OF THE DOME . .. . . 16 . . . . . . . . . . . . . FROZEN CONDENSATION ON THE INSIDE . CAT 21. 1 .. . . • . _ _ _ . . . 01 UUDEAL.A _ _L _ LIL ' . . . . 1 . . . . . . T . P - O .I . T T - . . I . . . 2 . . . . . . . . . . . . 011 . . NOX . . . . .. . . AN . . . . NO DOO . OLEN - 0 . . .. . . . ..... 1 TO C •••... DO . " . . NO W . . % . P900 . 6 . 6 . . . . . . . 0 . . . . . 10 . ..... ... . . . 00 . . . . . 1 . . ! . . . . . . . . . . . . . . . . . .. ......... . 2 9 ............ . . . . . 112 . . . . ... .. D . . . .44 . . . . . . . . . . . . . 1. . . 4 . . . . SO . 11 . . . . . . . . . **** . . . O - . . . . ...... . 1 * . L ....... C . WR . . . TO SO . .. - 1 - - - - - . . . . . - - • . 40 000 1111 LLLL LLL 1 VI . 1 20. . . 20 . . • • • . . . . r . . . . . . 1 N . . . TE01 . X LU 0 . . U - - - - - - - . . . . . . . .. . 1 - - . . . . . . . . • - + - - . . . . . . . . . . . . . 1 . .. . . . . U.. . . . € ! OF THE DOME APPENDIX B . . . . . . . . . . . . ! . . . ... . . . . . . . . . . . . 38 . . . . . 1 . . . . . . . . . . . . . ► - 1 . O C . . . . . . . . . . C • . D . . . . . . ... . A . V SO ONIS. SON CO. . DIRTY DOME - BIRD DROPPINGS OBSTRUCTIONS - BIRDS RESTING L . . . . . . . . 21 PDT . . . L O C . . . . . . 1 . ► i.. ::.::::::: A DIRTY DOME - SIDE AND BOTTOM 82 APPENDIX B NEW CAMERA - IMAGE AREA HAS NON-GRAINY APPEARANCE NEW CAMERA- WRONG THRESHOLDS SET, OCCULTOR IS BACKLIT OLD CAMERA- IMAGE AREA HAS GRAINY APPEARANCE Sa Stano ht Sa : As AC t ' ht L । C . * * * * " HU * ,IC S . • RY R I • 10 Tv • ••• WVVY | NRUTY * * OW !! : Ovvvvv + + + O . । L . Y Y Y । ଏ + + + + + + on a o bo of a | | | | | | | I +10 . . } । + + + ht : L HD DOd SINE . 11 OD 20 App କୁ 0 { , No be + + ' + 4 YrY * + * • , via YP A | { * V OCA. । Nu N D Dh N JO Q . " | - it, + 10 + 14 + + + | s * . . . Y '' CT | ha + * * • + . . ) * : + . 1 ' ••••:: - . 83 APPENDIX B . . O . . O . - 18 . . . . . → . . . . . It NAAA . 12N _ _ _ *_ . . . . . . . DPT . . . . . . . . . . . . . . . . . . . . . . . . . . . + a 4 . . $ . . . . . . 1 . . 0 9 . 4 . . . C 2 10 . . . . . - . . . . 1 . + + + + 2 + 1 . 1114 - . . . . . . . . . . . . . . . . . . . . . 1 . . . . . + 1 1 1 1 1 . . . . 1 1 1 + + ” . . . 9 . . . . . .. . . . ! . . . . . . . . . . . . .. . . . . DAY 1 DAY 2 .. She üslauch hanno . . ! . . . . . . . . . . . . A . . . . . . 1 . . . . . . . . . 2 . . . 1 5 1991 1 . 1 . . . . . . . . . . 4 . . . . . . . . . . . . . . . . . . . 1 . . . . . P . . 1 . . . 1 .. . . . . . . . . . P . ) + . . + . . . . . . . . . . . + . . . . . . . . . . . . . . . . . . . . . . . . to DAY 3 DAY 4 84