Skip to content

Pull requests: mlfoundations/open_lm

New pull request New
36 Open 203 Closed
36 Open 203 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Avoid failing on fname not in keys
#302 opened Aug 22, 2024 by jmercat Loading…
Update strip to rstrip
#300 opened Aug 19, 2024 by Yu-Shi Loading…
Faster eval2
#299 opened Jul 31, 2024 by jmercat Loading…
Faster eval
#298 opened Jul 31, 2024 by jmercat Loading…
Adjust Attention Mechanism and Dataset Handling
#295 opened Jul 25, 2024 by OLMResearch Loading…
Build wheel
#294 opened Jul 23, 2024 by jmercat Loading…
Patches for remote sync waiting and log_local checkpointing
#290 opened Jul 4, 2024 by jeffreywpli Loading…
fix: adopt latest state_dict processing
#286 opened Jun 12, 2024 by ruixin31 Loading…
1
Allow tokenization for gzipped json files in datapreprocess
#285 opened Jun 3, 2024 by taidnguyen Loading…
fix for EOS/PAD tokens when not gpt-neox
#283 opened May 24, 2024 by jeffreywpli Loading…
Add option to predownload data from s3 at the start of each checkpoint.
#280 opened May 18, 2024 by GeorgiosSmyrnis Loading…
3
Parameter input rotary-freq
#263 opened Apr 30, 2024 by jmercat Loading…
1
Add loss like Rho-1
#260 opened Apr 27, 2024 by GeorgiosSmyrnis Loading…
Add dMoE
#257 opened Apr 25, 2024 by Muennighoff Loading…
Checkpoint skipping.
#256 opened Apr 21, 2024 by GeorgiosSmyrnis Loading…
Mamba update
#254 opened Apr 18, 2024 by jmercat Loading…
2
HF Integration
#248 opened Apr 12, 2024 by sedrick-keh-tri Loading…
1
Bug fix to import Llama in OpenLM.
#245 opened Apr 11, 2024 by kushal-tri Loading…
adding cosine rewarmed scheduler
#243 opened Apr 10, 2024 by Tomerporian Loading…
Change GeGLU and add MQA.
#239 opened Mar 31, 2024 by GeorgiosSmyrnis Loading…
Add unit test for source mixing + Fix naming within tars.
#233 opened Mar 12, 2024 by GeorgiosSmyrnis Loading…
3
Allow mixing for pretokenized data.
#230 opened Mar 8, 2024 by GeorgiosSmyrnis Loading…
@GeorgiosSmyrnis
1
Adding depth scale init support
#225 opened Mar 4, 2024 by kalyani7195 Loading…
[WIP] Adding support for FP8 training
#218 opened Feb 21, 2024 by shahromil16 Loading…
@shahromil16
20
[WIP] Attention across documents.
#213 opened Jan 31, 2024 by GeorgiosSmyrnis Loading…
8
ProTip! Updated in the last three days: updated:>2024-12-12.