igea-instruct

Sleeping

Detsutut commited on Jun 27

Commit

1d83c48

•

1 Parent(s): efe183a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -12,7 +12,6 @@ pipeline = transformers.pipeline(
     "text-generation",
     model=model_id,
     model_kwargs={"torch_dtype": torch.bfloat16},
-    device_map="auto",
     token=hf_key
 )

     "text-generation",
     model=model_id,
     model_kwargs={"torch_dtype": torch.bfloat16},
     token=hf_key
 )