Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: flash attention in model selection #266

Merged
merged 4 commits into from
Jul 8, 2024
Merged

Conversation

giladgd
Copy link
Contributor

@giladgd giladgd commented Jul 5, 2024

Description of change

  • feat: flash attention in model selection
  • fix: adapt to llama.cpp breaking changes
  • fix: Llama 3 function calling

Fixes #267

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

@giladgd giladgd requested a review from ido-pluto July 5, 2024 23:57
@giladgd giladgd self-assigned this Jul 5, 2024
giladgd and others added 2 commits July 6, 2024 02:58

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
@giladgd giladgd changed the title fix: adapt to llama.cpp breaking changes feat: flash attention in model selection Jul 8, 2024
@giladgd giladgd merged commit c35ff5a into beta Jul 8, 2024
17 checks passed
@giladgd giladgd deleted the gilad/adaptToLlamaChanges branch July 8, 2024 21:27
Copy link

github-actions bot commented Jul 9, 2024

🎉 This PR is included in version 3.0.0-beta.38 🎉

The release is available on:

Your semantic-release bot 📦🚀

Copy link

github-actions bot commented Sep 24, 2024

🎉 This PR is included in version 3.0.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant