• Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Dark Energy Spectroscopic Instrument (DESI)

  • / science /
    • science overview
    • cosmology and dark energy
    • redshifts and distance
    • mapping the universe
    • the DESI science mission
    • the DESI survey
    • imaging surveys
  • / instrument /
    • instrument overview
    • telescope
      • tohono o’odham
    • corrector
    • focal plane system
    • fiber system
    • spectrograph
    • instrument control system
    • data systems
    • bringing DESI to life
      • commissioning Instrument
      • protoDESI
  • / collaboration /
    • DESI team
    • DESI builders
    • collaborating institutions
    • sponsors
    • vendors
    • diversity, equity, and inclusion
    • collaboration policies
  • / press /
    • announcements
    • in the news
    • press releases
    • blog
    • tweets by desisurvey
    • acknowledgement statement
  • / galleries /
    • image gallery
    • videos
  • / for scientists /
    • instrument design
    • imaging data
    • target selection and survey validation
    • theory and simulations
    • other DESI science
    • all DESI papers
    • team login
    • request a DESI speaker
    • internal
  • / education & outreach /
    • meet a DESI member
    • blog
    • planetarium show
    • DESI high
    • interactive visualizations
    • swag shop

data systems

NERSC Cray Cori supercomputer at Wang Hall—graphic panels installation, 9 November 2015

DESI’s data systems are responsible for target selection, survey planning, data processing pipelines, and the transfer, archiving, and distribution of its data products. Lists of targets for DESI to observe are created with data from the Legacy Imaging surveys, and the WISE and Gaia satellites.

Mock survey simulations help determine the most efficient target allocations and field selection for survey operations. During operations, the ‘Next Field Selector’ will use these algorithms to choose the optimal field to observe in realtime to maximize overall survey efficiency.

At Kitt Peak, a “quicklook” pipeline will process the data within 3 minutes for quality assurance monitoring by the observers. The raw data will be transferred in realtime to the National Energy Research Scientific Computing Center (NERSC) at Berkeley Lab for more detailed processing, science analyses, and archiving. The spectroscopic data processing pipeline extracts the spectra from the raw data, subtracts the sky model, flux calibrates them, and measures their classifications and redshifts. There will be about 10 terabytes (TB) of raw data per year transferred from Kitt Peak National Observatory to NERSC, as well as a separate archival copy at the NSF’s National Optical-Infrared Astronomy Research Laboratory (NSF’s OIR Lab) in Tucson, Arizona.

After running the data through the pipelines at NERSC (using millions of CPU hours), there will be about 100 TB year of data products that will be made available as data releases approximately once per year throughout DESI’s 5 years of operations.

bringing DESI to life »

Primary Sidebar

  • instrument overview
  • telescope
    • tohono o’odham
  • corrector
  • focal plane system
  • fiber system
  • spectrograph
  • instrument control system
  • data systems
  • bringing DESI to life
    • commissioning instrument
    • protoDESI

Footer

TEAM LOGIN

twitter   instagram   facebook

Copyright © 2018 Dark Energy Spectroscopic Instrument [DESI]

Copyright © 2023 · Parallax Pro DESI on Genesis Framework · WordPress · Log in