Text Generation
Transformers
PyTorch
Chinese
bloom
text-generation-inference
Inference Endpoints

4张32G的V100可以跑起来吗

#4
by szhhh - opened

4张32G的V100可以跑起来吗

加起来显存只有128G 放不下的

xyz-nlp changed discussion status to closed

可以cpu和GPU同时加载吗

Sign up or log in to comment