InstaDeepAI
/

nucleotide-transformer-v2-50m-multi-species

Inference Endpoints

Model card Files Files and versions Community

hdallatorre commited on Sep 19, 2023

Commit

50add8c

•

1 Parent(s): 63c1106

Update modeling_esm.py

Files changed (1) hide show

modeling_esm.py +1 -0

modeling_esm.py CHANGED Viewed

@@ -551,6 +551,7 @@ class EsmIntermediate(nn.Module):
         self.activation_fn = SiLU()
     def forward(self, hidden_states: torch.Tensor) -> torch.Tensor:
         hidden_states = self.dense(hidden_states)
         # GLU

         self.activation_fn = SiLU()
     def forward(self, hidden_states: torch.Tensor) -> torch.Tensor:
+        print("Forwarding in the custom ESM Intermediate!")
         hidden_states = self.dense(hidden_states)
         # GLU