Reprocess Workflow

Reprocessing lets operators recalibrate existing raw RINEX RINEX
Receiver Independent Exchange Format — standard GNSS observation file format synced from GeoNet and calibrated by the processor. with parameter overrides. Jobs route through Reprocess_Queue Reprocess_Queue
SQS standard queue — buffers reprocessing job messages from the Reprocess API with lower concurrency than ingest. with lower concurrency than ingest.

Submit a reprocessing job

From the demo repo root:

export API_URL="$(terraform -chdir=terraform output -raw api_url)"

JOB=$(curl -s -X POST "${API_URL}/reprocess" \
  -H "Content-Type: application/json" \
  -d '{"station": "auck", "year": 2026, "doy": 179, "parameters": {"NAV_DAY_OFFSET": 2}}')
echo "$JOB"

Expected response:

{ "job_id": "...", "status": "queued", "trace_id": "..." }

Poll job status

JOB_ID=$(echo "$JOB" | python3 -c "import sys,json; print(json.load(sys.stdin)['job_id'])")

curl "${API_URL}/reprocess/${JOB_ID}"

Status progresses: queued → processing → completed or failed.

Verify message on Reprocess_Queue

aws sqs get-queue-attributes \
  --queue-url "$(terraform -chdir=terraform output -raw reprocess_queue_url)" \
  --attribute-names ApproximateNumberOfMessages

Jobs land on Reprocess_Queue, not Process_Queue Process_Queue
SQS standard queue — receives S3 ObjectCreated notifications for new raw RINEX files; triggers processor Lambda ingest path. .

Supported parameters

Parameter	Type	Default	Description
NAV_DAY_OFFSET	Integer	1	Days before observation DOY DOY Day of year — three-digit value (001–366) used in RINEX paths and processed output keys. for nav files
SAVE_PARQUET	Boolean	true	Write Parquet Parquet Columnar file format — primary processed output for efficient Query API range scans; JSON is a fallback when `pyarrow` is unavailable. output
SAVE_CSV	Boolean	true	Write CSV output
SAVE_JSON	Boolean	true	Write JSON output
SAVE_STATIC_PLOTS	Boolean	false	Generate PNG plots
SAVE_INTERACTIVE_PLOTS	Boolean	false	Generate HTML plots

Any other parameter key returns HTTP 400.

See SQS Message Schemas and DynamoDB Jobs Table.

Idempotent output

Reprocessing overwrites existing output keys deterministically — the same input always produces the same output path per format.