Level 0 Data Processing
- The contents of delivered L0 files are inserted into a time-based archive.
- Granularity is 1 file / apid / hour.
- Archiving software merges new data into existing archive files to preserve ordering and eliminate duplicate packets.
- Summary data for each file stored in Oracle
- Science datagrams are identified by APID and CCSDS grouping flags.
- Retrieval is by timespan, SCID, and APID.
- Packets are fetched by APID&hour, ordered by time, and presented to a user-specified callback object.
- A cron-based dispatcher scans for HSK/DIAG transfer packages that have completed raw-archive ingest and executes the "ProcessHSK" application over the resulting timespan
- ProcessHSK builds a decom/EU conversion stack from the T&C database for the APID's received, then pushes the retrieved packets through it.
- Each mnemonic is represented by an object that accumulates a set of value changes, 5-minute statistics, and limit state changes from the sequence of decommutated values.
- The value-changes and statistics are posted to trending tables, and limit-state changes are sent to the logging system.
- A cron-based dispatcher scans for SCI transfer packages that have completed raw-archive ingest and executes the "ProcessSCI" application over the resulting timespan.
- ProcessSCI does the following:
- Assigns a "downlink id" composed of the package-receipt date and ordinal package number.
- Finds the set of complete science datagrams resulting from the incoming package (including "leftover" packets from previous downlinks)
- Divides the datagrams into a configurable number of "chunks", creates a working directory, and writes a set of raw-archive retrieval-definition files.
- Injects a new instance of the Level-1 processing task into the processing pipeline.
