Skip to main content

LambdaLLM

Serverless-native LLM orchestration for AWS Lambda

Released

The first LLM framework purpose-built for Lambda's stateless, cold-start-optimized execution model. Sub-5MB core with sub-100ms overhead.

1
Stars
0
Forks
0
Issues

Key Features

  • Cold-start optimized (<5MB core)
  • Automatic state persistence to DynamoDB
  • Cost-aware model routing with fallback
  • Timeout-safe checkpoint/resume
  • One-command deploy to AWS
  • Multi-model chains with conditional routing

Tech Stack

Python TypeScript AWS Lambda Bedrock DynamoDB