From gmendell@ligo-wa.caltech.edu Wed Oct 25 21:50:15 2006 Date: Wed, 25 Oct 2006 18:52:53 -0700 From: Gregory Mendell To: Keith Riles Cc: LDAS_ADMIN_ALL Subject: gaps in raw and RDS data from the start of the run Hi Keith, Below are reports and segment lists for LHO and LLO respectively from the beginning of the run up to the time of the reports and segment lists I sent earlier today, in the same format. Following this are some further notes on these gaps. Cheers, Greg -------- Original Message -------- Subject: message from ./GapCheckCompareAndReport.tcl emailSegsFromRunStartLHOS5GapCheckCompareAndReport.rsc about reportSegsFromRunStartFrameDataGapsS5LHO.txt Date: Wed, 25 Oct 2006 17:58:32 -0700 (PDT) From: LDAS General Account To: ldas_admin_all@ligo.caltech.edu Gaps or warnings were found when running ./GapCheckCompareAndReport.tcl emailSegsFromRunStartLHOS5GapCheckCompareAndReport.rsc. Check: http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/reportSegsFromRunStartFrameDataGapsS5LHO.txt.Wed_Oct_25_17_53_37_PDT_2006. The missing GPS segments are: http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/MISSING_R.Wed_Oct_25_17_53_37_PDT_2006.txt http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/MISSING_RDS_R_L1.Wed_Oct_25_17_53_37_PDT_2006.txt http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/MISSING_RDS_R_L3.Wed_Oct_25_17_53_37_PDT_2006.txt http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/MISSING_H1_RDS_R_L4.Wed_Oct_25_17_53_37_PDT_2006.txt http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/GapChecker/S5LHO/archive/MISSING_H2_RDS_R_L4.Wed_Oct_25_17_53_37_PDT_2006.txt -------- Original Message -------- Subject: message from ./GapCheckCompareAndReport.tcl emailSegsFromRunStartLLOS5GapCheckCompareAndReport.rsc about reportSegsFromRunStartFrameDataGapsS5LLO.txt Date: Wed, 25 Oct 2006 20:02:43 -0500 (CDT) From: LDAS General Account To: ldas_admin_all@ligo.caltech.edu Gaps or warnings were found when running ./GapCheckCompareAndReport.tcl emailSegsFromRunStartLLOS5GapCheckCompareAndReport.rsc. Check: http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/GapChecker/S5LLO/archive/reportSegsFromRunStartFrameDataGapsS5LLO.txt.Wed_Oct_25_19_54_31_CDT_2006. The missing GPS segments are: http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/GapChecker/S5LLO/archive/MISSING_R.Wed_Oct_25_19_54_31_CDT_2006.txt http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/GapChecker/S5LLO/archive/MISSING_RDS_R_L1.Wed_Oct_25_19_54_31_CDT_2006.txt http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/GapChecker/S5LLO/archive/MISSING_RDS_R_L3.Wed_Oct_25_19_54_31_CDT_2006.txt http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/GapChecker/S5LLO/archive/MISSING_L1_RDS_R_L4.Wed_Oct_25_19_54_31_CDT_2006.txt NOTES: Key: L0 = raw data; frame type = R L1 = Level 1 RDS data; frame type = RDS_R_L1 (not the L1 IFO!) L3 = Level 3 RDS data; frame type = RDS_R_L3 L4 = Level 4 RDS data; frame type = H1_RDS_R_L4 (each IFO has own type) frame type = H2_RDS_R_L4 (each IFO has own type) frame type = L1_RDS_R_L4 (each IFO has own type) All of the gaps shown above in the S5 raw or RDS data are due to one of 4 types of problem: (1) times when both framebuilders crashed, rebooted, or were down for maintenance, (2) power failures, (3) bad metadata in the frames, and (4) data corruption after copying from CDS but before archiving onto tape. Type (1) and (2) problems should drop us from science mode and start a new segment number. Type (3) and (4) problem are more worrysome, but have been very rare. Here are all instances of these: 1. On Dec. 31, 2005 the leap second was added, producing raw frames at LLO with inconsistent leap seconds. LDAS did not reduce this data because of bad metadata errors. LHO did not generate any data during this time. In any case, this is the source of the Dec. 31, 2005 gaps. 2. On Feb. 21, 2005 at LLO gaps occur because some channels in the raw LLO frames were accidentally given channel names that started with H. LDAS did not reduce this data because of bad metadata errors, and one raw frame is missing I think from the time Lisa fixed this. 3. These LHO raw data gaps where caused accidentally lost due to human error when reconfiguring the disk at LHO: 823201120 823201152 32 823209536 823209568 32 823224224 823224256 32 823225568 823225600 32 823261728 823261760 32 823285088 823285120 32 823285376 823285408 32 823286016 823286048 32 4. These LLO raw data gaps were caused, we think, by corruption during copying from CDS to LDAS: 828206624 828206656 32 833230752 833230784 32 833553632 833553664 32 Cheers, Greg -- Gregory Mendell | Ph: 509-372-8300 ext. 189 | Fax: 509-372-8137 LIGO Hanford Observatory, PO Box 159, MS S9-02, Richland WA 99352 http://www.ligo.caltech.edu | http://www.ligo-wa.caltech.edu