Skip to main content

GenAI frameworks built for serverless

Open-source, enterprise-grade tools purpose-built for AWS Lambda. We solve the fundamental incompatibility between existing LLM frameworks and serverless constraints.

Framework Ecosystem

View all →

LambdaLLM

Released

Serverless-native LLM orchestration for AWS Lambda

  • Cold-start optimized (<5MB core)
  • Automatic state persistence to DynamoDB
  • Cost-aware model routing with fallback
Python TypeScript AWS Lambda Bedrock DynamoDB
View LambdaLLM details

GuardrailGraph

Released

Composable AI safety pipelines for production GenAI

  • Graph-based safety pipeline composition
  • Built-in PII detection and redaction
  • HIPAA, SOX, GDPR, FedRAMP compliance packs
Python TypeScript AWS Lambda Bedrock Guardrails
View GuardrailGraph details

CostSentinel

Released

Real-time GenAI cost governance and budget enforcement

  • Real-time token cost tracking
  • Per-endpoint budget enforcement
  • Automatic model downgrade on budget breach
Python TypeScript CloudWatch DynamoDB
View CostSentinel details

PromptOps

Released

Infrastructure-as-Code for prompt management

  • Git-based prompt versioning
  • A/B testing with traffic splitting
  • Automated regression testing
Python TypeScript S3 DynamoDB Step Functions
View PromptOps details

Latest Articles

All posts →

Built by Gaurav Kumar Sinha

SubstrAI is an initiative to bring enterprise-grade GenAI tooling to the serverless ecosystem. Every framework is designed from first principles around Lambda's constraints — cold starts, statelessness, timeouts, and pay-per-use pricing.

Learn more →