Workers AI
Workers AI allows you to run machine learning models, on the Cloudflare network, from your own code – whether that be from Workers, Pages, or anywhere via REST API.
Designed for developers
You shouldn’t have to understand the ins and outs of machine learning to leverage the power of it. With a focus on developer experience, it’s powerful, yet simple, and only a few lines of code to get started:
import { Ai } from '@cloudflare/ai';
const ai = new Ai(env.AI)
const output = await ai.run('@cf/meta/llama-2-7b-chat-int8', { prompt: 'Tell me about Workers AI'
})
Models you know and love
Workers AI comes with a curated set of popular open-source models that just work.
Supporting multiple classes of models, here are some AI tasks you can unlock with Workers AI:
- Natural language processing - text generation + summarization + classification + translation, similarity analysis, question answering
- Image generation - text to image generation tasks
- Computer Vision - image classification, object detection
- Audio - Automatic speech recognition (ASR)
Runs on a global network of GPUs
With the launch of Workers AI, Cloudflare is slowly rolling out GPUs to its global network. This enables you to build and deploy ambitious AI applications that run near your users, wherever they are.
Batteries included with a vector database
Adding Vectorize, Cloudflare’s new vector database, is a single click or CLI command away. This addon enables you to perform tasks such as semantic search, recommendations, anomaly detection or can be used to provide context + memory to an LLM. Head over to the Vectorize docs to learn more.
