![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-ai-platform
company
AI & ML interests
None defined yet.
Organization Card
Foundation Model Stack
Foundation Model Stack (fms) is a collection of components developed out of IBM Research used for development, inference, training, and tuning of foundation models leveraging PyTorch native components.
Optimizations
In FMS, we aim to bring the latest optimizations for pre-training/inference/fine-tuning to all of our models. A few of these optimizations include, but are not limited to:
- fully compilable models with no graph breaks
- full tensor-parallel support for all applicable modules developed in fms
- training scripts leveraging FSDP
- state of the art light-weight speculators for improving inference performance
Usage
FMS is currently being deployed in Text Generation Inference Server
Repositories
- foundation-model-stack: Main repository for which all fms models are based
- fms-extras: New features staged to be integrated with foundation-model-stack
- fms-fsdp: Pre-Training Examples using FSDP wrapped foundation models
- fms-hf-tuning: Basic Tuning scripts for fms models leveraging SFTTrainer
Collections
1
spaces
1
models
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/llama3-70b-accelerator
Updated
•
1.17k
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/llama2-70b-accelerator
Updated
•
9
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/llama-160m-accelerator
Updated
•
34.5k
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/codellama-34b-accelerator
Updated
•
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/codellama-13b-accelerator
Updated
•
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/granite-7b-lab-accelerator
Updated
•
11
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/llama-13b-accelerator
Updated
•
145
•
2
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660eeae04f7a69c50cf2ab99/mutmOPu-hv2RTKg5xihuy.jpeg)
ibm-fms/llama3-8b-accelerator
Updated
•
5.61k
•
13
datasets
None public yet