mschoi/luminal
1
0
Fork 0
forked from Rust-related/luminal
Code Pull Requests Activity
1,193 Commits 2 Branches 2 Tags
main
Commit Graph

1193 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Joe Fioti
f0d6a58a7f Added llama3 2024-04-19 11:34:52 -05:00
Joe Fioti
396cae039b Fixed speed 2024-04-19 11:08:53 -05:00
Joe Fioti
9c63b6456f Falliable symbolic ops 2024-04-19 09:07:34 -05:00
Joe Fioti
4a0bd46d4d Minor changes 2024-04-12 23:39:10 -05:00
Joe Fioti
a94c97e724 Update README.md 2024-04-12 13:03:12 -05:00
Joe Fioti
d603aac3f2 Simplified mistral example 2024-04-10 16:38:31 -05:00
Joe Fioti
90e350b6fb Removed serialization and TraitObjEq 2024-04-10 16:16:22 -05:00
Joe Fioti
2126556f25 Removed print 2024-04-09 20:09:41 -04:00
Joe Fioti
a15a79bff6 Fixed elementwise fusion 2024-04-09 19:54:18 -04:00
Joe Fioti
da68799982 Fixed elementwise replacements 2024-04-08 19:29:34 -04:00
Joe Fioti
ddd001ef0e Fixed cpu gather op 2024-04-08 10:02:55 -04:00
Joe Fioti
acf1e4b465 small 2024-04-06 20:56:06 -04:00
Joe Fioti
589148707f New elementwise fusion 2024-04-06 20:05:53 -04:00
Joe Fioti
239af0df26 Simplified primop reductions 2024-04-03 16:09:51 -04:00
Joe Fioti
5fcee0050c Started whisper 2024-04-03 15:40:47 -04:00
Joe Fioti
481e416b0d Fixed metal again 2024-04-02 21:36:07 -04:00
Joe Fioti
a6eef04817 Metal training works 2024-04-02 20:19:00 -04:00
Joe Fioti
a4d033a9af Fixed metal 2024-04-02 11:21:52 -04:00
Joe Fioti
a68d8bd341 reorganized core 2024-04-02 11:07:07 -04:00
Joe Fioti
8ef34a5805 Cleaned up training example 2024-04-02 10:53:41 -04:00
Joe Fioti
9a34224891 First training examplegit add . 2024-04-01 21:17:23 -04:00
Joe Fioti
21c1e72d1f Reogranized nn module 2024-04-01 17:07:24 -04:00
Joe Fioti
784fe20f32 name change 2024-04-01 14:01:42 -04:00
Joe Fioti
355f1a4816 Reorganized into luminal_train 2024-04-01 13:54:16 -04:00
Joe Fioti
aff47d5960 Added losses 2024-04-01 13:47:46 -04:00
Joe Fioti
5d07fbc853 tweaks 2024-04-01 10:53:37 -04:00
Joe Fioti
9540ab1c88 working autograd on transformer 2024-04-01 10:39:13 -04:00
Joe Fioti
03a9dedb04 Autograd working for matmul reshape 2024-03-29 10:59:13 -04:00
Joe Fioti
bf64f3cc7b Merge branch 'main' of https://github.com/jafioti/luminal 2024-03-28 20:30:12 -04:00
Joe Fioti
c95c514c52 Autograd works for mlps, does not work with reshapes 2024-03-28 20:30:07 -04:00
Joe Fioti
a30212bb11 Merge pull request #45 from zeux/cuda-fix 
Fix CUDA build on Rust 1.77
 2024-03-24 13:59:39 -04:00
Arseny Kapoulkine
6ed065d4b7 Remove nn submodule imports and rely on prelude re-exporting symbols 2024-03-23 18:05:32 -07:00
Arseny Kapoulkine
00be879d6a Fix CUDA compilation by defining Output type for Compiler trait 2024-03-23 17:50:58 -07:00
Joe Fioti
72c2ff6c3c Cleaned up autograd more 2024-03-22 14:44:34 -04:00
Joe Fioti
ca1c7666cb Fixed autograd 2024-03-22 14:07:42 -04:00
Joe Fioti
dcb8b0de22 Fixed maxreduce autograd 2024-03-20 22:34:00 -04:00
Joe Fioti
f65b029249 Initial autograd 2024-03-20 22:24:39 -04:00
Joe Fioti
297b0c3a9d Fixed metla api 2024-03-18 10:29:48 -04:00
Joe Fioti
f0248d2954 More hl ops 2024-03-17 21:00:42 -04:00
Joe Fioti
eb87e69b0e Compiler return values 2024-03-15 23:22:00 -04:00
Joe Fioti
6a76c4a7d5 Changed simple example 2024-03-14 22:50:15 -05:00
Joe Fioti
59cd270b3f Merge 2024-03-14 19:42:56 -05:00
Joe Fioti
4219e5c0ef Changed mistral layers 2024-03-14 19:42:13 -05:00
Joe Fioti
0c1885fce7 Broken quantized cuda mistral 2024-03-14 19:41:42 -05:00
Joe Fioti
c7777ecc3a Small mistral tweak 2024-03-13 22:58:12 -05:00
Joe Fioti
f7e699d9d8 Merge pull request #42 from TheSeamau5/main 
Fix tokenizer issue by switching to HF Tokenizers
 2024-03-13 22:52:17 -05:00
Joe Fioti
371df9ecb0 Small change 2024-03-13 22:51:51 -05:00
Hassan Hayat
95438654ac Print total token count 2024-03-13 19:02:32 -05:00
Hassan Hayat
9b178b99ed Switch to hf tokenizers library for correct mistral tokenizer 2024-03-13 18:47:00 -05:00
Joe Fioti
aac542edcb More tests 2024-03-13 11:18:03 -05:00