Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.3k 111

  2. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 835 42

  3. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 832 61

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 622 48

  5. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 527 45

  6. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 493 61

Repositories

Showing 10 of 25 repositories
  • AIN Public

    AIN - The First Arabic Inclusive Large Multimodal Model. It is a versatile bilingual LMM excelling in visual and contextual understanding across diverse domains.

    mbzuai-oryx/AIN’s past year of commit activity
    HTML 31 MIT 0 0 0 Updated Mar 4, 2025
  • VideoGLaMM Public

    [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

    mbzuai-oryx/VideoGLaMM’s past year of commit activity
    Python 42 1 3 0 Updated Mar 3, 2025
  • CoVR-VidLLM-CVPRW25 Public

    Composed Video Retrieval Challenge CVPR Workshop 2025

    mbzuai-oryx/CoVR-VidLLM-CVPRW25’s past year of commit activity
    Python 1 1 0 0 Updated Mar 4, 2025
  • Awesome-LLM-Post-training Public

    Awesome Reasoning LLM Tutorial/Survey/Guide

    mbzuai-oryx/Awesome-LLM-Post-training’s past year of commit activity
    424 20 0 0 Updated Mar 3, 2025
  • KITAB-Bench Public

    A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understanding

    mbzuai-oryx/KITAB-Bench’s past year of commit activity
    Python 17 MIT 0 0 0 Updated Mar 2, 2025
  • GeoPixel Public

    GeoPixel: A Pixel Grounding Large Multimodal Model for Remote Sensing is specifically developed for high-resolution remote sensing image analysis, offering advanced multi-target pixel grounding capabilities.

    mbzuai-oryx/GeoPixel’s past year of commit activity
    Python 60 Apache-2.0 1 0 0 Updated Mar 1, 2025
  • ALM-Bench Public

    [CVPR 2025 🔥] ALM-Bench is a multilingual multi-modal diverse cultural benchmark for 100 languages across 19 categories. It assesses the next generation of LMMs on cultural inclusitivity.

    mbzuai-oryx/ALM-Bench’s past year of commit activity
    Python 32 2 0 0 Updated Feb 28, 2025
  • TimeTravel Public

    Time Travel is a Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts

    mbzuai-oryx/TimeTravel’s past year of commit activity
    Python 17 MIT 0 0 0 Updated Feb 24, 2025
  • PALO Public

    (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 83 Apache-2.0 5 5 0 Updated Feb 17, 2025
  • LlamaV-o1 Public

    Rethinking Step-by-step Visual Reasoning in LLMs

    mbzuai-oryx/LlamaV-o1’s past year of commit activity
    Python 259 Apache-2.0 16 4 2 Updated Jan 24, 2025
View all repositories

Top languages

Python HTML