Skip to main content

LambdaLLM

Serverless-native LLM orchestration for AWS Lambda

Released

The first LLM framework purpose-built for Lambda's stateless, cold-start-optimized execution model. Sub-5MB core with sub-100ms overhead.

1
Stars
0
Forks
0
Issues

Key Features

  • ✓ Cold-start optimized (<5MB core)
  • ✓ Automatic state persistence to DynamoDB
  • ✓ Cost-aware model routing with fallback
  • ✓ Timeout-safe checkpoint/resume
  • ✓ One-command deploy to AWS
  • ✓ Multi-model chains with conditional routing

Tech Stack

Python TypeScript AWS Lambda Bedrock DynamoDB