wanghao
79e36e17e8
Fix: Remove attn_mask when using is_causal=True in Flash Attention
...
PyTorch's scaled_dot_product_attention cannot use attn_mask and
is_causal=True simultaneously. This commit sets attn_mask=None
when is_causal=True to avoid parameter conflicts.
2025-10-18 21:02:46 +08:00
jingyaogong
3812a16d20
[feat] update eval
2025-10-18 00:24:36 +08:00
jingyaogong
0682134e21
[feat] update requirements
2025-10-17 00:14:37 +08:00
jingyaogong
b8adffbe89
[fix] update model
2025-10-17 00:11:08 +08:00
jingyaogong
4e35fb9da8
[fix] update model
2025-10-17 00:09:32 +08:00
jingyaogong
36159fb2ab
update app
2025-10-16 23:33:35 +08:00
jingyaogong
561979c7e3
update torch version
2025-04-30 16:47:26 +08:00
jingyaogong
caae54a89e
fix bugs
2025-04-29 20:45:39 +08:00
jingyaogong
5ffde04b7c
update lora
2025-04-27 15:45:06 +08:00
jingyaogong
2e118e9d3d
update convert script
2025-04-27 15:44:40 +08:00
jingyaogong
29454c31af
fix bugs
2025-04-27 09:56:49 +08:00
jingyaogong
765c79c7a2
update readme
2025-04-26 10:37:46 +08:00
jingyaogong
00d145c481
update readme
2025-04-26 10:21:34 +08:00
jingyaogong
274483cb1b
250426
2025-04-26 10:07:55 +08:00
jingyaogong
a62faf34bd
250426
2025-04-26 10:05:47 +08:00
jingyaogong
7da201a944
update chat-openai-api
2025-04-18 12:43:57 +08:00
jingyaogong
d9453ed9a3
update moe note
2025-04-09 17:38:31 +08:00
jingyaogong
d503093ec4
update eval
2025-04-09 16:56:57 +08:00
jingyaogong
4a758564e4
fix top_p float bug
2025-04-09 16:52:20 +08:00
jingyaogong
4a7c1c49e8
update rlaif
2025-04-05 16:06:08 +08:00
jingyaogong
9e67798397
update generate
2025-04-05 15:53:55 +08:00
jingyaogong
399d526fbd
add hidden state
2025-04-05 14:39:56 +08:00
jingyaogong
885661f47d
update inference
2025-04-05 12:04:38 +08:00
jingyaogong
ed01c5d84a
update inference
2025-04-05 12:03:04 +08:00
jingyaogong
7fcc46b39a
update seed set
2025-04-04 11:39:41 +08:00
jingyaogong
08e9a22a25
update web_demo
2025-04-04 11:25:40 +08:00
jingyaogong
278ec760a1
update dpo_loss
2025-04-01 17:32:50 +08:00
jingyaogong
4f95e23a98
update structure image
2025-04-01 16:15:26 +08:00
jingyaogong
edc8d26189
update structure image
2025-04-01 16:11:54 +08:00
jingyaogong
bf81fd5f5e
rmsnorm float convert
2025-04-01 16:03:44 +08:00
jingyaogong
e369b33265
fix chat mask bug
2025-04-01 13:44:55 +08:00
jingyaogong
258507ff89
delete __pycache__
2025-04-01 11:51:54 +08:00
gongjy
04b56ea86c
update readme
2025-02-23 20:07:26 +08:00
gongjy
e34d4e9371
update tokenizer load
2025-02-19 23:24:29 +08:00
gongjy
45c0d12049
update images
2025-02-19 22:59:42 +08:00
gongjy
f475e4e407
update images
2025-02-19 22:54:57 +08:00
gongjy
ef7dff9fd4
update structure figure
2025-02-18 23:35:16 +08:00
gongjy
dcf5fcdb08
update structure figure
2025-02-18 23:24:51 +08:00
gongjy
844e79148c
update generate args
2025-02-15 23:56:09 +08:00
gongjy
19b388cd87
update generate args
2025-02-15 23:55:10 +08:00
gongjy
5b65bc767e
update cis init
2025-02-15 20:26:34 +08:00
gongjy
c1a77f5c0f
update web_demo
2025-02-14 19:38:55 +08:00
gongjy
d519d2a233
update web_demo
2025-02-14 19:37:27 +08:00
gongjy
e7ed05834b
fix bug
2025-02-13 21:07:43 +08:00
gongjy
b5d10d9a7d
fix bugs
2025-02-13 20:56:14 +08:00
gongjy
416cc90b58
update ckp-path
2025-02-12 20:34:47 +08:00
gongjy
bab480073e
update lr
2025-02-11 23:53:48 +08:00
gongjy
d2f5ef4355
update lr
2025-02-11 23:52:40 +08:00
gongjy
fea5b0eafc
update readme
2025-02-10 23:34:52 +08:00
gongjy
291c19dc5e
update markdown
2025-02-10 23:22:53 +08:00