Models Agents Infrastructure Pricing Docs Security

Models Agents Infrastructure Pricing Docs Security

LitAI

Platform

Lightning AIDevelop, train and deploy on Lightning AI Python SDKProgrammatic access to the Lightning AI platform CLIAccess the Lightning AI platform from the command line

Open Source Libraries

PyTorch LightningFinetune and pretrain AI models. Focus on science, not engineering.Lightning FabricScale foundation models to 1000s of GPUs with expert-level control TorchMetrics90+ PyTorch metrics, optimized for distributed training ThunderCompiler for PyTorch: Make PyTorch models faster!LitLoggerExperiment tracking built into Lightning AI LitDataStream and process datasets at scale LitServeEasily serve AI models — Lightning fast LitAILLM router and minimal agent framework in one LitGPT20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Home Install Quick start Why LitAI?

Async LLM generation Fallback and retry Manage models Multi-turn conversation Streaming Tools Granular billing

Docs/LitAI/Features

Features

Async LLM generation
Fallback and retry
Manage models
Multi-turn conversation memory
Streaming

Async LLM generationIn applications that handle multiple users, API calls, or agents, blocking LLM requests can become a bottleneck. Python’…Fallback and retryIn production environments, LLM APIs can fail due to rate limits, timeouts, or provider outages. Manually handling retri…Manage modelsIn most LLM applications, switching between models or providers involves setting up separate APIs, handling varied param…Multi-turn conversationLLMs are stateless by default. Every API call is treated independently so they forget previous questions, answers, or fo…StreamingMost LLM APIs return full responses only after the entire output is generated, which can slow down UX and delay response…ToolsAI models (LLMs) today can only respond with text - they can’t look up live information or take actions - so apps built …Granular billingOrganize billing for API calls at organization, teamspace and user level. Your API key decides where the cost of API cal…

Was this page helpful?

Thanks for the feedback.

What went wrong?

Inaccurate or out of dateHard to understandMissing informationHard to find things / poorly organizedCode sample didn't workSomething is broken (link, image, layout)

Share with AI

Open in ChatGPT Open in Claude

Was this helpful?

Thanks for the feedback.

What went wrong?

Inaccurate or out of dateHard to understandMissing informationHard to find things / poorly organizedCode sample didn't workSomething is broken (link, image, layout)

↑↓ Navigate↵ Open⌘↵ New tabesc Close