Skip to main content
Version: 2.0.0

LLMWhisperer AWS Marketplace Edition

LLMWhisperer AWS Marketplace Edition is a self-hosted appliance that you subscribe to on AWS Marketplace and run in your own AWS account. The complete LLMWhisperer stack runs on a single EC2 instance, with Docker Compose, so your documents are processed on that instance and are not sent to Unstract. You pay per page processed through your AWS bill.

It suits teams that want LLMWhisperer inside their own AWS account without running Kubernetes. For a multi-node deployment on Kubernetes in AWS, Azure or GCP, see the On-Prem Edition.

Key Features​

  • One EC2 instance, the whole stack — the document API, the processing workers, the OCR engines, the database and the dashboard all run on the instance
  • Same v2 API as LLMWhisperer Cloud, so the API reference, the Python client and the JavaScript client work with your instance's address
  • Five extraction modes — native_text, low_cost, high_quality, form and table (see Modes)
  • No manual activation — on first boot the instance obtains a license tied to your AWS Marketplace subscription, generates its own API key and dashboard login, and starts the stack
  • Sized to the instance — on first boot the appliance plans its workers and OCR engines for the instance type you launched
  • Pay per page — usage is reported to AWS Marketplace every hour and appears on your AWS bill

Delivery Options​

OptionWhat you get
CloudFormationA template that creates the instance, an IAM instance role, a security group limited to the address ranges you enter, and an encrypted root volume. Recommended.
AMIThe appliance image only. You launch it from the EC2 console and attach the IAM instance role and security group yourself.

Billing​

  • You are billed per page processed, at the rate for the extraction mode used: native_text, low_cost, high_quality, form or table. The rates are on the listing.
  • Each PDF or image page counts as one page. Excel files (XLS/XLSX) are billed in form mode: each sheet counts as one page per 3,000 words of content, and at least one page.
  • There is no monthly cap, minimum or commitment.
  • EC2 charges for the instance and its storage are billed separately by AWS.

External Dependencies​

The appliance needs ongoing outbound HTTPS (TCP 443) to:

  • The Unstract license service, which issues the license on first boot and renews it automatically. If the instance loses access to it, the high_quality, form and table modes stop processing after roughly 100 to 150 minutes; native_text and low_cost keep working until the current license expires, and then the appliance stops processing documents.
  • The AWS Marketplace Metering Service, which receives the hourly page counts.

All software is included in the AMI; nothing is downloaded at deployment.

Deployment​

Subscribe on the LLMWhisperer AWS Marketplace listing. For step-by-step instructions, including every CloudFormation parameter, the first-boot status check, getting your credentials and calling the API, see the AWS Marketplace Deployment Guide. For logs and common issues, see AWS Marketplace Troubleshooting.