PaLI-Gemma 2
Google's vision encoder model for fine-tuning and transfer learning
Verdict
Excellent base for fine-tuning custom vision tasks. Strong transfer learning to detection, segmentation, and VQA. Multiple sizes for different deployment targets.
Other Multimodal & Vision
- BLIP-3 / xGen-MMExperimental
Salesforce's multimodal model for enterprise vision tasks
- CogVLM2Experimental
Zhipu AI's vision-language model with video understanding
- Florence-2Production
Microsoft's unified vision foundation model for multiple tasks
- GLM-OCRExperimental
Zhipu AI's specialised model for document OCR and extraction
- InternVL 2.5Stable
Open-source VLM rivalling GPT-4o on vision benchmarks
- LLaVA-NeXTStable
Leading open-source vision-language model with strong reasoning