feat: get VRAM state

[giladgd]

Description of change

• feat: get VRAM state
• feat: chatWrapper getter on a LlamaChatSession
• fix(resolveChatWrapperBasedOnModel): use llamaChat wrapper for llama models only if there's a chat sub-variant
• fix: update latest build on postinstall compilation

How to get the current VRAM state

import {getLlama} from "node-llama-cpp";

const llama = await getLlama();
const vramState = llama.getVramState();

console.log("Total VRAM:", vramState.total);
console.log("Used VRAM:", vramState.used);
console.log("Free VRAM:", vramState.free);

Pull-Request Checklist

• Code is up-to-date with the master branch
• npm run format to apply eslint formatting
• npm run test passes with this change
• This pull request links relevant issues as Fixes #0000
• There are new or updated unit tests validating the change
• Documentation has been updated to reflect this change
• The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

[ido-pluto]

LGTM

[github-actions]

🎉 This PR is included in version 3.0.0-beta.10 🎉

The release is available on:

• npm package (@beta dist-tag)
• GitHub release
• v3.0.0-beta.10

Your semantic-release bot 📦🚀

[github-actions]

🎉 This PR is included in version 3.0.0 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release
• v3.0.0

Your semantic-release bot 📦🚀