models

/

aya-101-15B

Version: 15B GPU F32

You can quickly deploy aya-101-15B to an endpoint using our MAX container. It includes the latest version of MAX with GPU support and our Python-based inference server called MAX Serve.

With the following Docker command, you’ll get an OpenAI-compatible endpoint running aya-101-15B:

docker run --gpus 1 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_HUB_ENABLE_HF_TRANSFER=1" \
    --env "HF_TOKEN=" \
    -p 8000:8000 \
    docker.modular.com/modular/max-openai-api:nightly \
    --huggingface-repo-id CohereForAI/aya-101

In order to download the model from Hugging Face, you just need to fill in the HF_TOKEN value with your access token, unless the model is from https://huggingface.co/modularai.

Learn more

For more information about the container image, see the MAX container documentation.

To learn more about how to deploy MAX to the cloud, check out our MAX Serve tutorials.

DETAILS

ChatMODEL CLASS
PyTorch
HARDWARE
GPU
QUANTIZATION
F32
ARCHITECTURE
PyTorch

MAX GITHUB

Modular / MAX

MODEL

CohereForAI

CohereForAI/aya-101

QUESTIONS ABOUT THIS MODEL?

Leave a comment

PROBLEMS WITH THE CODE?

File an Issue

TAGS

transformers

/

safetensors

/

t5

/

text2text-generation

/

afr

/

amh

/

ara

/

aze

/

bel

/

ben

/

bul

/

cat

/

ceb

/

ces

/

cym

/

dan

/

deu

/

ell

/

eng

/

epo

/

est

/

eus

/

fin

/

fil

/

fra

/

fry

/

gla

/

gle

/

glg

/

guj

/

hat

/

hau

/

heb

/

hin

/

hun

/

hye

/

ibo

/

ind

/

isl

/

ita

/

jav

/

jpn

/

kan

/

kat

/

kaz

/

khm

/

kir

/

kor

/

kur

/

lao

/

lav

/

lat

/

lit

/

ltz

/

mal

/

mar

/

mkd

/

mlg

/

mlt

/

mon

/

mri

/

msa

/

mya

/

nep

/

nld

/

nor

/

nso

/

nya

/

ory

/

pan

/

pes

/

pol

/

por

/

pus

/

ron

/

rus

/

sin

/

slk

/

slv

/

smo

/

sna

/

snd

/

som

/

sot

/

spa

/

sqi

/

srp

/

sun

/

swa

/

swe

/

tam

/

tel

/

tgk

/

tha

/

tur

/

twi

/

ukr

/

urd

/

uzb

/

vie

/

xho

/

yid

/

yor

/

zho

/

zul

/

dataset:CohereForAI/xP3x

/

dataset:CohereForAI/aya_dataset

/

dataset:CohereForAI/aya_collection

/

dataset:DataProvenanceInitiative/Commercially-Verified-Licenses

/

dataset:CohereForAI/aya_evaluation_suite

/

arxiv:2402.07827

/

license:apache-2.0

/

autotrain_compatible

/

text-generation-inference

/

endpoints_compatible

/

region:us

Resources & support for
running aya-101-15B

@ Copyright - Modular Inc - 2025