aya-8b

PyTorch

2 versions

Aya 23, released by Cohere, is a new family of state-of-the-art, multilingual models that support 23 languages.

Run this model

  1. Install our magic package manager:

    curl -ssL https://magic.modular.com/ | bash

    Then run the source command that's printed in your terminal.

  2. Install Max Pipelines in order to run this model.

    magic global install max-pipelines
  3. Start a local endpoint for aya/8b:

    max-serve serve --huggingface-repo-id CohereForAI/aya-expanse-8b

    The endpoint is ready when you see the URI printed in your terminal:

    Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
  4. Now open another terminal to send a request using curl:

    curl -N http://0.0.0.0:8000/v1/chat/completions -H "Content-Type: application/json" -d '{
        "model": "aya/8b",
        "stream": true,
        "messages": [
            {"role": "system", "content": "You are a helpful assistant."},
            {"role": "user", "content": "Who won the World Series in 2020?"}
        ]
    }' | grep -o '"content":"[^"]*"' | sed 's/"content":"//g' | sed 's/"//g' | tr -d '
    ' | sed 's/\n/
    /g'
  5. 🎉 Hooray! You’re running Generative AI. Our goal is to make this as easy as possible.

About

image.png

Aya 23, released by Cohere, is a cutting-edge family of multilingual, generative large language models (LLMs) supporting 23 languages. It is designed to advance research in multilingual natural language generation and understanding.

The model is available in two parameter sizes: 8 billion (8B) and 35 billion (35B). Aya 23 demonstrates strong performance across diverse multilingual benchmarks, outperforming other leading models in specific tasks and use cases.

Multilingual Benchmarks

aya win rates vs other models

Developed with open weights, Aya 23 represents Cohere's commitment to driving progress in multilingual AI research and accessibility, enabling new applications and advancements across global languages.

DETAILS

MODEL CLASS
PyTorch

MODULAR GITHUB

Modular

CREATED BY

CohereForAI

MODEL

CohereForAI/aya-expanse-8b

TAGS

ar
arxiv:2406.18682
arxiv:2407.02552
arxiv:2408.14960
arxiv:2410.10801
arxiv:2412.04261
autotrain_compatible
cohere
conversational
cs
de
el
en
es
fa
fr
he
hi
id
it
ja
ko
license:cc-by-nc-4.0
nl
pl
pt
region:us
ro
ru
safetensors
text-generation
text-generation-inference
tr
transformers
uk
vi
zh

@ Copyright - Modular Inc - 2024