Environment Variables
Environment variables are set by Terraform
HashiCorp Terraform — provisions all platform infrastructure through five modules in `terraform/`. modules at deploy time. Override behavior via Terraform variables or reprocess job parameters where noted.
Ingest_Sync_Lambda
Section titled “Ingest_Sync_Lambda”| Variable | Source | Description |
|---|---|---|
LOOKBACK_HOURS |
| UTC rolling window for sync (1–168) |
DATA_LAKE_BUCKET | ingest module | Private data lake |
SOURCE_BUCKET |
| GeoNet |
SOURCE_PREFIX |
| Source prefix in public bucket |
Processor Lambda (container)
Section titled “Processor Lambda (container)”| Variable | Default | Description |
|---|---|---|
PROCESSOR_MODE | lambda | Execution mode |
SOURCE_BUCKET | data lake bucket | Bucket for raw RINEX |
SOURCE_PREFIX | raw/rinexhourly/ | Raw input prefix |
DESTINATION_BUCKET | data lake bucket | Bucket for processed output |
DESTINATION_PREFIX | processed/tec/ | Processed output prefix |
NAV_DAY_OFFSET | 1 | Default nav file day offset (overridable per reprocess message) |
NUMBA_CACHE_DIR | /tmp/numba-cache | Numba JIT cache directory |
SAVE_PARQUET | true | Write Parquet |
SAVE_CSV | true | Write CSV output |
SAVE_JSON | true | Write JSON output |
SAVE_STATIC_PLOTS | false | Generate PNG plots |
SAVE_INTERACTIVE_PLOTS | false | Generate HTML plots |
JOBS_TABLE_NAME | DynamoDB table name | Jobs table |
Per-job overrides (NAV_DAY_OFFSET, SAVE_*) are passed via reprocess SQS
Amazon Simple Queue Service — buffers ingest and reprocess messages between S3/API and the processor Lambda. messages. See SQS Message Schemas.
Query_API Lambda
Section titled “Query_API Lambda”| Variable | Default | Description |
|---|---|---|
DATA_LAKE_BUCKET | data lake bucket | Bucket for processed output reads |
QUERY_MAX_ROWS | 2000 | Row cap before response serialization |
QUERY_READ_WORKERS | 8 | Parallel S3 read workers per request |
CORS_ALLOW_ORIGIN | Amplify hostname | Browser CORS origin (set via |
Reprocess_API Lambda
Section titled “Reprocess_API Lambda”| Variable | Description |
|---|---|
REPROCESS_QUEUE_URL | Reprocess_Queue |
JOBS_TABLE_NAME | DynamoDB Jobs table name |
DATA_LAKE_BUCKET | Data lake bucket for raw key lookup |
CORS_ALLOW_ORIGIN | Browser CORS origin |
Terraform variables mapping
Section titled “Terraform variables mapping”Processor concurrency, timeouts, and alarm thresholds are Terraform variables — not Lambda environment variables:
| Terraform variable | Default | Effect |
|---|---|---|
processor_maximum_concurrency | 15 | Ingest queue ESM concurrency |
reprocess_maximum_concurrency | 2 | Reprocess queue ESM concurrency |
processor_timeout_seconds | 900 | Lambda |
processor_memory_mb | 2048 | Lambda memory |
See Terraform Variables.