Agent Deployment and Hosting🚀 production
AWS Bedrock AgentCoreawslabs/agentcore-samples
Managed AWS infrastructure for Bedrock-based agents with compliance, scaling, and monitoring built in.
TypeScript#Compliance
GitHub ↗Ultra-fast LPU-based LLM inference for Mixtral, Llama, and Gemma with a free API tier.
Managed AWS infrastructure for Bedrock-based agents with compliance, scaling, and monitoring built in.
Fastest LLM inference delivering 1000+ tokens per second on Llama 3.3 70B with a free tier.
Serverless LLM inference with fine-tuning, RAG support, and free credits for rapid prototyping.