ValueError: Trying to set a tensor of shape torch.Size([131072, 1280]) in "weight" (which has shape torch.Size([131072, 5120]))
#2
by
treehugg3 - opened
I can't seem to run this using the inference examples found in https://huggingface.co/mistral-community/pixtral-12b, due to this error:
ValueError: Trying to set a tensor of shape torch.Size([131072, 1280]) in "weight" (which has shape torch.Size([131072, 5120])), this looks incorrect.