Can't make this model work with oMLX
#1
by czyrichard - opened
First I got the error:
ModelConfig.init() missing 1 required positional argument: 'vision_config'
After I threw the config.json to Gemini and asked it to modify it, I got a new error:
Missing 393 parameters:
vision_tower.blocks.0.attn.proj.bias,
vision_tower.blocks.0.attn.proj.weight,
vision_tower.blocks.0.attn.qkv.bias,
vision_tower.blocks.0.attn.qkv.weight,
vision_tower.blocks.0.mlp.linear_fc1.bias,
vision_tower.blocks.0.mlp.linear_fc1.weight,
vision_tower.blocks.0.mlp.linear_fc2.bias,
vision_tower.blocks.0.mlp.linear_fc2.weight,
vision_tower.blocks.0.norm1.bias,
……