Tonic commited on
Commit
4bfcc47
1 Parent(s): 7d76024

add flash attention

Browse files
Files changed (1) hide show
  1. requirements.txt +4 -1
requirements.txt CHANGED
@@ -11,7 +11,10 @@ langchain-chroma
11
  unstructured[all-docs]
12
  libmagic
13
  gradio
14
- flash-attn
 
 
 
15
  # poppler
16
  # tesseract
17
  # libxml2
 
11
  unstructured[all-docs]
12
  libmagic
13
  gradio
14
+ torch==2.2.0+cu121 # Ensure you're using the right PyTorch version with CUDA support
15
+ flash-attn==2.6.3 # Flash attention module
16
+ numpy<2 # Downgrade to avoid NumPy 2.0.1 conflicts
17
+ pybind11>=2.12 # Ensure compatibility for modules needing pybind11
18
  # poppler
19
  # tesseract
20
  # libxml2