## Quick Start ### Install 1. Clone this repository and navigate to IVM folder ```bash git clone https://github.com/2toinf/IVM.git cd IVM ``` 2. Install Package ```bash conda create -n IVM python=3.10 -y conda activate IVM pip install -e . ``` ### Usage ```python from IVM import load from PIL import Image model = load(ckpt_path, low_gpu_memory = False) # Set `low_gpu_memory=True` if you don't have enough GPU Memory image = Image.open("image/demo/robot.jpg") instruction = "pick up the red cup" result = model.forward_batch([image], [instruction]) ''' result content: 'soft': heatmap 'bbox': crop bbox 'blur_image': rbg 'highlight_image': rbg 'cropped_blur_img': rgb 'cropped_highlight_img': rgb 'alpha_image': rgba ''' ```