From c9c99a96c0cca48b2ea9595bc0294a188270764e Mon Sep 17 00:00:00 2001 From: jingyaogong Date: Mon, 20 Apr 2026 16:55:17 +0800 Subject: [PATCH] [update] website content --- index.html | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/index.html b/index.html index c812818..b7645b1 100644 --- a/index.html +++ b/index.html @@ -528,7 +528,7 @@

- Train a 67M Vision-Language Model from zero.
+ Train a 65M Vision-Language Model from zero.
2 hours. ¥2.6. One 3090.
See the World.

@@ -537,7 +537,7 @@
-

67M

+

65M

Parameters

@@ -598,13 +598,13 @@ minimind-3v-moe - 202M-A67M + 200M-A65M 1.0 GB 2026.04.20 minimind-3v - 67M + 65M 0.5 GB 2026.04.20 @@ -634,9 +634,9 @@
    -
  • New checkpoints: minimind-3v (67M) / minimind-3v-moe (201M-A67M)
  • -
  • Projector: added LayerNorm, token merging switched to 2D pixel-shuffle
  • -
  • Vision Encoder switched to SiglipVisionModel (fixed 256×256)
  • +
  • New checkpoints: minimind-3v (65M) / minimind-3v-moe (200M-A65M)
  • +
  • Projector: added LayerNorm, removed reshape token merging (P32 natively outputs 64 tokens)
  • +
  • Vision Encoder switched to SiglipVisionModel (P32, fixed 256×256)
  • Training data moved to ALLaVA-4V (Pretrain 1.27M / SFT 2.9M, merged into single-stage SFT)
  • Freeze strategy: freeze_llm=1 unfreezes first + last layers; Pretrain/SFT defaults now 2/1; max_seq_len 360 → 450
  • Misc bugfixes and small tweaks
  • @@ -653,7 +653,7 @@
    • Added minimind-3v (67M) and minimind-3v-moe (201M-A67M) models
    • Unified 768+8 architecture, supporting both dense and moe modes
    • -
    • Switched Visual Encoder from CLIP to SigLIP2 (siglip2-base-p16-ve)
    • +
    • Switched Visual Encoder from CLIP to SigLIP2 (siglip2-base-p16-256-ve)
    • Replaced QFormer with MLP Projection + reshape compression
    • Dataset format updated to parquet, mixed data sources, updated tokenizer with image placeholder <|image_pad|>, new WebUI with dynamic model directory scanning and dropdown model switching
    • Model code refactored, LLM/VLM unified for Transformers format