S4 Segment Data Quality Repository

Peter Shawhan, Keith Riles

Quick link: most recent version of segment lists (at bottom of page)

This page has links to files containing information about science-mode segments in each detector during the S4 run. Science mode segment numbers for each interferometer were incremented each time a control room operator pushed the "GO" button to indicate start of science mode conditions. As in the past, the segment numbers will be permanent, and many e-log entries refer to them by IFO and segment index (e.g., H1-27). This repository provides data quality summary information on individual segments, based on the work of many investigators. Data quality flags are listed for time intervals, and links to more detailed information are provided, where appropriate. Links to segment manipulation tools (e.g, segwizard) are also included. An extensive set of data quality investigations are described in detail on John Zweizig's data quality investigation page .

For each detector, there is an ASCII file ( S4H1_seginfo_work.txt , S4H2_seginfo_work.txt , S4L1_seginfo_work.txt , S4G1_seginfo_work.txt , S4A1_seginfo_work.txt) which details any information learned about each segment which indicates that it is bad or potentially bad data. These files are maintained by hand. As information is learned and added to these files, they are periodically copied to different names incorporating a specific version number, and the information is also distilled and presented in a few other files:

S4*v*_seginfo.html : a copy of the seginfo file with some HTML mark-up.
S4*v*_segs.html : a more compact, fixed-format list, consisting of:

Segment index (hyperlinked to the seginfo file)
Start time
End time
Duration
Bitmask value representing bad-flags which apply to this time interval
List of bad-flag names, if any, which apply to this time interval

bad-flags

S4*v*_segs.txt : like S4*v*_segs.html , but without the hyperlinks.

Note that any given segment will retain the same numerical index in all versions of the lists, but it may acquire bad-flags indicating that it is bad or potentially bad.

The goal of this effort is to determine what data is suitable for searching for gravitational waves, and to provide this information in a machine-readable form. The success of this effort will depend on individuals examining the data, identifying effects which might cause the data to be bad, and then evaluating which effects are serious enough to disqualify data. Contributions are eagerly awaited; Keith Riles (kriles@umich.edu ) will collect this information and maintain the segment info files.

Caution:

Please do not apply DQ flags in your analysis indiscriminately. The severity of DQ flags varies considerably. Some flags (e.g., OUT_OF_LOCK or ADC_OVERFLOW) should be applied by every analysis, but other flags (e.g., 120HZ_UPCONVERSION) may be unimportant to some analyses. Also, for analyses requiring large contiguous blocks of good data, e.g., for spectral noise estimation, it may be wiser to apply short-lived DQ flags (e.g., LIGHTDIP_5PERCENT) as post-processing vetoes rather than to fragment the data prior to processing.

Version 00 files -- Generated in real-time
(Files were physically at Hanford and Livingston until the end of the run.)

This release is a bare-bones derivation from the real-time segment lists generated during the run, with no bad flags yet defined. Information will be compiled week-by-week, however, for interim versions, that include known DQ flag information up to that point in the run.

Single IFO:
Segment lists (ASCII): S4H1v00_segs.txt , S4H2v00_segs.txt S4L1v00_segs.txt

Version 01 files -- March 3, 2005

This release takes explicit account of the following issues and applies to data taken during the first week of S4
(Tues Feb 22 noon CST to Tues Mar 1 noon CST, GPS: 793130413-793735213).

Periods outside of official S4 run
Hardware signal injections (Peter Shawhan)
Photodiode ADC overflow errors (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Interferometer out of lock - elog
Dust in vicinity of an optical table (following human intrusion) - elog
Strong upconversion of low-frequency noise near 120 Hz - elog
Badly misbehaving Thermal Compensation System (TCS) servo - elog
Very high micro-seismic noise - elog

Please note: There is evidence that when H1 is in lock and H2 out of lock, light from H1 can be reflected from a swinging H2 mirror so as to cause glitches in H1. The corresponding phenomenon can occur when H2 is in lock and H1 out of lock. Analysts looking for astrophysical bursts in one IFO should require both to be in lock. For the time being, look at only data with both H1 and H2 in science mode.

Also: Hourly glitches of characteristic frequency 400 Hz have been picked up by a radio antenna in the Livingston corner station starting from a power outage on February 24. The glitches last from about 50 seconds after each hour to about 250 seconds after the hour. There is some preliminary evidence that some of the glitches affect the L1 gravitational channel. After further investigation, it is possible that a DQ flag will be defined for a version 2 release next week. The source of the glitches is under investigation.

Single-IFO:
Segment lists (html): S4H1v01_segs.html , S4H2v01_segs.html , S4L1v01_segs.html
Segment lists (ASCII): S4H1v01_segs.txt , S4H2v01_segs.txt , S4L1v01_segs.txt
Full segment info (html): S4H1v01_seginfo.html , S4H2v01_seginfo.html , S4L1v01_seginfo.html
Full segment info (ASCII): S4H1v01_seginfo.txt , S4H2v01_seginfo.txt , S4L1v01_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v01_segs.txt S4H1L1v01_segs.txt S4H2L1v01_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v01_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 02 files -- March 11, 2005

This release takes explicit account of the following issues and applies to data taken during the first two weeks of S4
(Tues Feb 22 noon CST to Tues Mar 8 noon CST, GPS: 793130413-794340013).

Week 2 hardware signal injections (Peter Shawhan)
Week 2 photodiode ADC overflow errors (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Week 2 dust in vicinity of an optical table (following human intrusion) - elog
Week 2 badly misbehaving Thermal Compensation System (TCS) servo - elog
Weeks 1-2 short-lived calib-line dropouts causing glitches in AS_Q - L1 only
(Gaby Gonzalez, Myungkee Sung, Alessandra Di Credico)
Weeks 1-2 high BurstMon pixel fraction - Notes (John Zweizig)
- Computed up to 1 kHz: H1 H2 L1
- Computed up to 2 kHz: H1 H2 L1

Single-IFO:
Segment lists (html): S4H1v02_segs.html , S4H2v02_segs.html , S4L1v02_segs.html
Segment lists (ASCII): S4H1v02_segs.txt , S4H2v02_segs.txt , S4L1v02_segs.txt
Full segment info (html): S4H1v02_seginfo.html , S4H2v02_seginfo.html , S4L1v02_seginfo.html
Full segment info (ASCII): S4H1v02_seginfo.txt , S4H2v02_seginfo.txt , S4L1v02_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v02_segs.txt S4H1L1v02_segs.txt S4H2L1v02_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v02_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 03 files -- March 18, 2005

This release takes explicit account of the following issues and applies to data taken during the first three weeks of S4
(Tues Feb 22 noon CST to Tues Mar 15 noon CST, GPS: 793130413-794944813).

Week 3 hardware signal injections (Peter Shawhan)
Week 3 photodiode ADC overflow errors (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Week 3 dust in vicinity of an optical table (following human intrusion) - elog
Week 3 Very high micro-seismic noise - elog
Weeks 1-3 (H1 H2) and week 3 (L1) short-lived calib-line dropouts causing glitches in AS_Q -
(Gaby Gonzalez, Myungkee Sung)
Weeks 1-3 high BurstMon pixel fraction - Notes (John Zweizig)
- Computed up to 1 kHz: H1 H2 L1
- Computed up to 2 kHz: H1 H2 L1

Single-IFO:
Segment lists (html): S4H1v03_segs.html , S4H2v03_segs.html , S4L1v03_segs.html
Segment lists (ASCII): S4H1v03_segs.txt , S4H2v03_segs.txt , S4L1v03_segs.txt
Full segment info (html): S4H1v03_seginfo.html , S4H2v03_seginfo.html , S4L1v03_seginfo.html
Full segment info (ASCII): S4H1v03_seginfo.txt , S4H2v03_seginfo.txt , S4L1v03_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v03_segs.txt S4H1L1v03_segs.txt S4H2L1v03_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v03_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 04 files -- March 25, 2005

This release takes explicit account of the following issues and applies to data taken during the entire 29.5 days of S4
(Tues Feb 22 noon CST to Wed Mar 23 midnight CST, GPS: 793130413-795679213). In addition, partial information is provided to assist analysis of post-run periods hardware signal injections.

Periods outside of official S4 run
Week 4 hardware signal injections (Peter Shawhan)
Week 4 photodiode ADC overflow errors (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Week 4 (and residual weeks 1-3) (H1 H2 L1) short-lived calib-line dropouts causing glitches in AS_Q -
(John Zweizig)
Week 4 high BurstMon pixel fraction - Notes (John Zweizig)
- Computed up to 1 kHz: H1 H2 L1
- Computed up to 2 kHz: H1 H2 L1
LHO and LLO information on non-standard frame files (Greg Mendell)
Week 4 high winds causing seismic disturbances - elog
Week 4 jet aircraft overhead - elog
Week 4 unstable laser conditions - elog

Single-IFO:
Segment lists (html): S4H1v04_segs.html , S4H2v04_segs.html , S4L1v04_segs.html
Segment lists (ASCII): S4H1v04_segs.txt , S4H2v04_segs.txt , S4L1v04_segs.txt
Full segment info (html): S4H1v04_seginfo.html , S4H2v04_seginfo.html , S4L1v04_seginfo.html
Full segment info (ASCII): S4H1v04_seginfo.txt , S4H2v04_seginfo.txt , S4L1v04_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v04_segs.txt S4H1L1v04_segs.txt S4H2L1v04_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v04_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 05 files -- April 29, 2005

This release takes explicit account of the following issues:

Corrections to signal injection intervals (Vuk Mandic, Peter Shawhan)
Seismic transients in 2-20 Hz band affecting H1, H2 and L1 Nelson Christensen)
Rax xml files: H1 H2 L1
Calibration constants outside nominal range for H1 and L1 (Myungkee Sung, Gaby Gonzalez)
H1-H2 cross talk - one in-science and the other unlocked H1 H2 - note) (John Zweizig)
High winds affecting H1 and H2 (John Zweizig)
- Summaries: H1 H2
- Details: H1 H2
Elevated seismic noise in 0.8-2.0 Hz band affecting H1, H2 and L1 (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Elevated acoustic noise affecting H1, H2, and L1 (John Zweizig)
- Summaries: H1 H2 L1
- Details: H1 H2 L1
Seismic transients in narrow bands affecting H1 and H2 (note) (Justin Garofali, Fred Raab)
Culprits: LVEA_X (0.9-1.1 Hz) LVEA_Y (0.9-1.1 Hz) EX_X (0.4-0.9 Hz) EY_Y (1.8-2.4 Hz)
Strong correlated broadband noise in H1 and H2 - use with caution (Vuk Mandic)

Also of interest:

Updated LHO and LLO missing data or reduced data (Greg Mendell)
Spread sheet of H1 downtime causes (Betsy Bland)

Single-IFO:
Segment lists (html): S4H1v05_segs.html , S4H2v05_segs.html , S4L1v05_segs.html
Segment lists (ASCII): S4H1v05_segs.txt , S4H2v05_segs.txt , S4L1v05_segs.txt
Full segment info (html): S4H1v05_seginfo.html , S4H2v05_seginfo.html , S4L1v05_seginfo.html
Full segment info (ASCII): S4H1v05_seginfo.txt , S4H2v05_seginfo.txt , S4L1v05_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v05_segs.txt S4H1L1v05_segs.txt S4H2L1v05_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v05_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 06 files -- May 26, 2005

This release takes explicit account of the following issues:

Replaced hyphens with underscores in all seismic DQ flag names
Fixed missing hyphens in ranges for NO_DATA, NO_RDS flags (affects only L1 segment 17)
Fixed two intervals with corrupted H1UP_H2UNLOCKED & H2UP_H1UNLOCKED flags (notes 1 2)
Incorporated ALLEGRO segments (Phillip Miller)
Incorporated GEO segments and calibration chi**2 flag (note1 note2) (Martin Hewitson, Steffen Grunewald)
Three additional intervals with strong correlated broadband noise in H1 and H2 - note (Vuk Mandic)
Pre-lock-loss intervals -- note (Peter Shawhan)
- 10 seconds preceding lock loss: H1 H2 L1
- 30 seconds preceding lock loss: H1 H2 L1 <-- Peter's recommendation
- 60 seconds preceding lock loss: H1 H2 L1
- 120 seconds preceding lock loss: H1 H2 L1
Calibration constants outside nominal range - version 3 calibration (Myungkee Sung, Gaby Gonzalez)
- Intervals for once per minute coefficients: H1 H2 L1
- Intervals for once per second coefficients: H1 H2 L1

Also of interest:

Ongoing light-dip studies - future DQ flags (Peter Shawhan)
Spread sheet of H2 downtime causes (Betsy Bland)

Single-IFO:
Segment lists (html): S4H1v06_segs.html , S4H2v06_segs.html , S4L1v06_segs.html , S4G1v06_segs.html , S4A1v06_segs.html
Segment lists (ASCII): S4H1v06_segs.txt , S4H2v06_segs.txt , S4L1v06_segs.txt , S4G1v06_segs.txt , S4A1v06_segs.txt
Full segment info (html): S4H1v06_seginfo.html , S4H2v06_seginfo.html , S4L1v06_seginfo.html , S4G1v06_seginfo.html , S4A1v06_seginfo.html
Full segment info (ASCII): S4H1v06_seginfo.txt , S4H2v06_seginfo.txt , S4L1v06_seginfo.txt , S4G1v06_seginfo.txt , S4A1v06_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v06_segs.txt S4H1L1v06_segs.txt S4H2L1v06_segs.txt S4H1G1v06_segs.txt S4H2G1v06_segs.txt S4L1G1v06_segs.txt S4L1A1v06_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v06_segs.txt S4H1H2G1v06_segs.txt S4H1L1G1v06_segs.txt S4H2L1G1v06_segs.txt

Quadruple-IFO:
Segment lists (ASCII): S4H1H2L1G1v06_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 07 files -- July 14, 2005

This release takes explicit account of the following issues:

Added Allegro orientation flags - XARM YARM NULL (Phillip Miller)
Refined dust intervals (Andri Gretarsson, Alessandra Di Credico)
- H1: Low threshold High threshold
- H2: Low threshold High threshold
- L1: Andri's notes on L1
- Alessandra's veto studies page -- notes

Single-IFO:
Segment lists (html): S4H1v07_segs.html , S4H2v07_segs.html , S4L1v07_segs.html , S4G1v07_segs.html , S4A1v07_segs.html
Segment lists (ASCII): S4H1v07_segs.txt , S4H2v07_segs.txt , S4L1v07_segs.txt , S4G1v07_segs.txt , S4A1v07_segs.txt
Full segment info (html): S4H1v07_seginfo.html , S4H2v07_seginfo.html , S4L1v07_seginfo.html , S4G1v07_seginfo.html , S4A1v07_seginfo.html
Full segment info (ASCII): S4H1v07_seginfo.txt , S4H2v07_seginfo.txt , S4L1v07_seginfo.txt , S4G1v07_seginfo.txt , S4A1v07_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v07_segs.txt S4H1L1v07_segs.txt S4H2L1v07_segs.txt S4H1G1v07_segs.txt S4H2G1v07_segs.txt S4L1G1v07_segs.txt S4L1A1v07_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v07_segs.txt S4H1H2G1v07_segs.txt S4H1L1G1v07_segs.txt S4H2L1G1v07_segs.txt

Quadruple-IFO:
Segment lists (ASCII): S4H1H2L1G1v07_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 08 files -- August 26, 2005

This release takes explicit account of the following issues:

Higher-threshold H1 & H2 (30-35 mph) wind-speed flags - More info (John Zweizig)
- Summaries: H1 H2
- Details: H1 H2
Significant dips in arm cavity light - More info (Peter Shawhan)
- H1: (4%) (6%)
- H2: (5%) (7%) (10%)
- L1: (5%) (7%)
High H1 and L1 AS_DC power - More info (Andri Gretarrson, Alessandra Di Credico)
- H1 thresholds: high middle low
- L1 thresholds: high middle low
Allegro data quality flags: (Martin McHugh)
- No calibration info
- Phase of reference oscillator under adjustment
Corrected L1 bad-calibration flags for V03 calibration (Myungkee Sung)

Single-IFO:
Segment lists (html): S4H1v08_segs.html , S4H2v08_segs.html , S4L1v08_segs.html , S4G1v08_segs.html , S4A1v08_segs.html
Segment lists (ASCII): S4H1v08_segs.txt , S4H2v08_segs.txt , S4L1v08_segs.txt , S4G1v08_segs.txt , S4A1v08_segs.txt
Full segment info (html): S4H1v08_seginfo.html , S4H2v08_seginfo.html , S4L1v08_seginfo.html , S4G1v08_seginfo.html , S4A1v08_seginfo.html
Full segment info (ASCII): S4H1v08_seginfo.txt , S4H2v08_seginfo.txt , S4L1v08_seginfo.txt , S4G1v08_seginfo.txt , S4A1v08_seginfo.txt

Double-IFO:
Segment lists (ASCII): S4H1H2v08_segs.txt S4H1L1v08_segs.txt S4H2L1v08_segs.txt S4H1G1v08_segs.txt S4H2G1v08_segs.txt S4L1G1v08_segs.txt S4L1A1v08_segs.txt

Triple-IFO:
Segment lists (ASCII): S4H1H2L1v08_segs.txt S4H1H2G1v08_segs.txt S4H1L1G1v08_segs.txt S4H2L1G1v08_segs.txt

Quadruple-IFO:
Segment lists (ASCII): S4H1H2L1G1v08_segs.txt

Notes on coincidence segment lists

Notes on missing segments

Graphical summaries of segment data quality

Version 09 files -- December 20, 2005

This release takes explicit account of the following issues:

Calibration constants outside nominal range - version 4 calibration (Myungkee Sung, Gaby Gonzalez)
- Intervals for once per minute coefficients: H1 H2 L1
- Intervals for once per second coefficients: H1 H2 L1
Please note that these intervals do NOT include a large number of short calibration line dropouts. Many analysts should also veto intervals with the CALIB_LINE_DROPOUT flag set.
Strong pulsar injections (short-lived high-SNR binary pulsars centered on 376.1 Hz and 501.2 Hz).