Quantizing Larger Models

[4t0m]

Hi, I'm confused about how to quantize larger models with the recent changes. I think it would be helpful to include a walkthrough like the one for 7B models in the readme (or elsewhere), since the steps seem to be a bit different when dealing with multiple .bin files.