codegeex4-9b

PyTorch

1 versions

A versatile model for AI software development scenarios, including code completion.

Run this model

  1. Install our magic package manager:

    curl -ssL https://magic.modular.com/ | bash

    Then run the source command that's printed in your terminal.

  2. Install Max Pipelines in order to run this model.

    magic global install max-pipelines
  3. Start a local endpoint for codegeex4/9b:

    max-serve serve --huggingface-repo-id THUDM/codegeex4-all-9b

    The endpoint is ready when you see the URI printed in your terminal:

    Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
  4. Now open another terminal to send a request using curl:

    curl -N http://0.0.0.0:8000/v1/chat/completions -H "Content-Type: application/json" -d '{
        "model": "codegeex4/9b",
        "stream": true,
        "messages": [
            {"role": "system", "content": "You are a helpful assistant."},
            {"role": "user", "content": "Who won the World Series in 2020?"}
        ]
    }' | grep -o '"content":"[^"]*"' | sed 's/"content":"//g' | sed 's/"//g' | tr -d '
    ' | sed 's/\n/
    /g'
  5. 🎉 Hooray! You’re running Generative AI. Our goal is to make this as easy as possible.

About

logo.jpg

CodeGeeX4 is an advanced multilingual code generation model built upon the GLM-4-9B framework, delivering significant improvements in code generation capabilities. It has been designed to support numerous programming languages and excels in generating high-quality, functional code snippets across diverse use cases.

CodeGeeX4-ALL-9B, with less than 10 billion parameters, demonstrates exceptional performance on industry-standard benchmarks like BigCodeBench and NaturalCodeBench. It outperforms larger general-purpose models, achieving a remarkable balance between inference speed and output quality. This positions CodeGeeX4 as the leading choice for efficient and effective multilingual code generation within its parameter range.

For developers seeking a powerful and accessible tool for code generation, CodeGeeX4 offers a state-of-the-art solution with impressive results across varied programming contexts.

References

GitHub

Hugging Face

DETAILS

MODEL CLASS
PyTorch

MODULAR GITHUB

Modular

CREATED BY

THUDM

MODEL

THUDM/codegeex4-all-9b

TAGS

chatglm
codegeex
custom_code
en
glm
license:other
region:us
safetensors
text-generation
thudm
transformers
zh

@ Copyright - Modular Inc - 2024