Processor Lambda
The processor Lambda
Processor Lambda container — runs PyTECGg calibration per SQS message; adopted when a Batch on Fargate parallel-execution quota increase was rejected. Image from `ghcr.io/platformfuzz/tec-processor-image` mirrored to ECR. container consumes one SQS
Amazon Simple Queue Service — buffers ingest and reprocess messages between S3/API and the processor Lambda. message per invocation from Process_Queue
SQS standard queue — receives S3 ObjectCreated notifications for new raw RINEX files; triggers processor Lambda ingest path. and Reprocess_Queue
SQS standard queue — buffers reprocessing job messages from the Reprocess API with lower concurrency than ingest. . Monitor its health and throughput during verification.
Check Lambda configuration
Section titled “Check Lambda configuration”From the demo repo root:
aws lambda get-function-configuration --function-name processor \ --query '{State:State,LastUpdateStatus:LastUpdateStatus,PackageType:PackageType,Timeout:Timeout,MemorySize:MemorySize}'Expect:
State:ActivePackageType:ImageTimeout: 900MemorySize: 2048
Monitor queue consumption
Section titled “Monitor queue consumption”aws sqs get-queue-attributes \ --queue-url "$(terraform -chdir=terraform output -raw queue_url)" \ --attribute-names ApproximateNumberOfMessages ApproximateNumberOfMessagesNotVisible
aws sqs get-queue-attributes \ --queue-url "$(terraform -chdir=terraform output -raw reprocess_queue_url)" \ --attribute-names ApproximateNumberOfMessagesConcurrency limits
Section titled “Concurrency limits”Effective throughput is capped by:
- Per-queue concurrency —
processor_maximum_concurrency(default 15) on ingest;reprocess_maximum_concurrency(default 2) on reprocess - Account-level Lambda quota — shared across all functions in the region
If ingest messages accumulate while the processor shows throttles, request a Lambda
AWS Lambda — serverless compute for ingest-sync, query-api, reprocess-api, and the processor container image. concurrency quota increase for your account/region.
Check for errors and throttles
Section titled “Check for errors and throttles”aws cloudwatch describe-alarms --alarm-names \ processor-lambda-errors processor-lambda-throttles \ --query 'MetricAlarms[].{Name:AlarmName,State:StateValue}'Verify image URI
Section titled “Verify image URI”terraform -chdir=terraform output -raw processor_image_uriShould point to your ECR
Amazon Elastic Container Registry — stores the mirrored processor Lambda container image at deploy time. repository with the tag synced in ECR and Processor Image.
Next step
Section titled “Next step”After processor runs complete, verify output in S3 Processed Output.