Choose Version

(2 versions)

MAX Model

BF16

GPU

This version is not quantized and a GPU is recommended.

Install our magic package manager:
```
curl -ssL https://magic.modular.com/ | bash
```
Then run the source command that's printed in your terminal.

Install Max Pipelines in order to run this model.

magic global install max-pipelines && magic global update

Start a local endpoint for DeepSeek-R1-Distill-Qwen-abliterated-v2/7B:

max-pipelines serve --huggingface-repo-id=huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

The endpoint is ready when you see the URI printed in your terminal:

Server ready on http://0.0.0.0:8000 (Press CTRL+C to quit)

Now open another terminal to send a request using curl:

curl -N http://0.0.0.0:8000/v1/chat/completions -H "Content-Type: application/json" -d '{
    "model": "huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2",
    "stream": true,
    "messages": [
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Who won the World Series in 2020?"}
    ]
}' | grep -o '"content":"[^"]*"' | sed 's/"content":"//g' | sed 's/"//g' | tr -d '
' | sed 's/\n//g'

🎉 Hooray! You’re running Generative AI. Our goal is to make this as easy as possible.

Deploy this model to cloud

huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

This uncensored model version builds on deepseek-ai/DeepSeek-R1-Distill-Qwen-7B, utilizing abliteration to remove refusals from a language model, without relying on additional tools like TransformerLens. This is a preliminary example highlighting how refusals can be eliminated from a large language model (LLM).

Important Note: Enhancements have been made from the prior version huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated.

Metadata

architectures.0	Qwen2ForCausalLM
model_type	qwen2

Version: 7B GPU BF16

This code works on compatible Linux machines.
We are actively working on enabling MAX Serve for MacOS ARM64 as well.

You can quickly deploy DeepSeek-R1-Distill-Qwen-abliterated-v2-7B to an endpoint using our MAX container. It includes the latest version of MAX with GPU support and our Python-based inference server called MAX Serve.

With the following Docker command, you’ll get an OpenAI-compatible endpoint running DeepSeek-R1-Distill-Qwen-abliterated-v2-7B:

docker run --gpus 1 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_HUB_ENABLE_HF_TRANSFER=1" \
    --env "HF_TOKEN=" \
    -p 8000:8000 \
    docker.modular.com/modular/max-openai-api:nightly \
    --huggingface-repo-id huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

In order to download the model from Hugging Face, you just need to fill in the HF_TOKEN value with your access token, unless the model is from https://huggingface.co/modularai.

Learn more

For more information about the container image, see the MAX container documentation.

To learn more about how to deploy MAX to the cloud, check out our MAX Serve tutorials.

MIT License

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

DETAILS

ChatMODEL CLASS

MAX Model

MAX Models are popular open-source models converted to MAX’s native graph format. Anything with the label is either SOTA or being worked on. Learn more about MAX Models.

Browse all MAX Models

HARDWARE

GPU

QUANTIZATION

BF16

ARCHITECTURE

MAX Model

MAX GITHUB

Modular / MAX

MODEL

huihui-ai

huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

QUESTIONS ABOUT THIS MODEL?

Resources & support for
running DeepSeek-R1-Distill-Qwen-abliterated-v2-7B

Browse 27+ Tutorials

View Tutorials

Get help using MAX

Modular Forum

Read Documentation

Go to Docs

DeepSeek-R1-Distill-Qwen-abliterated-v2-7B

huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

Metadata

Learn more

Resources & support for running DeepSeek-R1-Distill-Qwen-abliterated-v2-7B

Resources & support for
running DeepSeek-R1-Distill-Qwen-abliterated-v2-7B