Swam Michael S.

Abstract Reference: 31132
Identifier: P3.11
Presentation: Poster presentation
Key Theme: 3 New Trends in HPC and Distributed Computing

HST/JWST Data Processing Performance under HTCondor/OWL

Authors:
Swam Michael S., Romelfanger Mary

The workflow management system now used by the science data processing pipelines for the Hubble Space Telescope (HST) and the James Webb Space Telescope (JWST) is called HTCondor/OWL, and consists of the widely-used HTCondor batch processing software, and the Open Workflow Layer (OWL), developed at the Space Telescope Science Institute (STScI).  This paper will describe early performance results obtained under the new HTCondor/OWL system when processing large subsets of the HST archive collection, and JWST ground test data.  Description of the computer hardware configurations and data, the performance metrics gathered, and analysis of the overheads and efficiency measures for the system will be presented, along with a summary of current issues and future development plans.