PyTorch's scaled_dot_product_attention cannot use attn_mask and is_causal=True simultaneously. This commit sets attn_mask=None when is_causal=True to avoid parameter conflicts. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| model_lora.py | ||
| model_minimind.py | ||
| tokenizer.json | ||
| tokenizer_config.json | ||