OctoAI

Optimizing machine learning using machine learning

Overview
Repositories
Projects
Packages
People

README.md

OctoAI is making AI fast, easy, and accessible

OctoAI delivers generative AI infrastructure to run, tune, and scale models that power AI applications. With the fastest foundation models on the market, OctoAI brings together cost savings, ease of use, and the power of open source models. You can sign up and try OctoAI for free.

Pinned Loading

octocloud-templates octocloud-templates Public

Python 3 3
octoai-textgen-cookbook octoai-textgen-cookbook Public

Simple getting-started code examples for LLM applications powered by OctoAI

Python 49 21

Repositories

Type Language

Select language

All C C++ Cuda Dockerfile Go HCL HTML Jinja Jupyter Notebook MDX Python Ruby Rust Shell Smarty TypeScript Verilog

Sort

llama-recipes Public archive Forked from meta-llama/llama-cookbook
Examples and recipes for Llama 2 model

octoml/llama-recipes's past year of commit activity

Jupyter Notebook 1 2,979 0 0 Updated Jul 20, 2025
fern-config Public
Configuration for generating SDKs and Documentation.

octoml/fern-config's past year of commit activity

MDX 2 5 0 6 Updated Oct 7, 2024
homebrew-tap Public
Homebrew Tap of OctoML products and tools.

octoml/homebrew-tap's past year of commit activity

Ruby 0 Apache-2.0 0 0 0 Updated Sep 26, 2024
EAGLE Public Forked from SafeAILab/EAGLE
OctoML Implementation of EAGLE-1 and EAGLE-2

octoml/EAGLE's past year of commit activity

Python 1 Apache-2.0 300 0 0 Updated Sep 12, 2024
octoai-solutions Public
A collection of reference solutions built on top of OctoAI SaaS

octoml/octoai-solutions's past year of commit activity

Python 0 MIT 0 0 0 Updated Sep 11, 2024
octoai-textgen-cookbook Public
Simple getting-started code examples for LLM applications powered by OctoAI

octoml/octoai-textgen-cookbook's past year of commit activity

Python 49 MIT 21 1 0 Updated Sep 10, 2024
mlc-llm Public Forked from mlc-ai/mlc-llm
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

octoml/mlc-llm's past year of commit activity

Python 5 Apache-2.0 2,193 12 1 Updated Sep 10, 2024
flashinfer Public Forked from flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving

octoml/flashinfer's past year of commit activity

Cuda 2 Apache-2.0 1,353 0 0 Updated Sep 9, 2024
sagemaker-examples Public

octoml/sagemaker-examples's past year of commit activity

Jupyter Notebook 0 0 0 0 Updated Sep 8, 2024
multicloud-asset-code-review-example Public
Multicloud Asset Code Review Public Repo example.

octoml/multicloud-asset-code-review-example's past year of commit activity

Python 0 MIT 0 0 1 Updated Sep 5, 2024