DeepSeek open-sources DeepInfer: what it is and who can run it
DeepInfer is the engine DeepSeek uses to serve its own models. It is Apache 2.0, but it runs only on B200-class Nvidia GPUs and Huawei Ascend 950 chips.
Tag
1 article
DeepInfer is the engine DeepSeek uses to serve its own models. It is Apache 2.0, but it runs only on B200-class Nvidia GPUs and Huawei Ascend 950 chips.