Skip to content

Commit ca588dc

Browse files
authored
add deepseek vl2 notebook (#2756)
1 parent 6bece15 commit ca588dc

File tree

6 files changed

+2910
-0
lines changed

6 files changed

+2910
-0
lines changed

.ci/spellcheck/.pyspelling.wordlist.txt

+1
Original file line numberDiff line numberDiff line change
@@ -540,6 +540,7 @@ Modelscope
540540
ModelScope
541541
modelscope
542542
Mody
543+
MoE
543544
MONAI
544545
MONAI's
545546
Monodepth

notebooks/deepseek-vl2/README.md

+26
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
# Visual-language assistant using DeepSeek-VL2 and OpenVINO
2+
3+
DeepSeek-VL2 is an advanced series of large Mixture-of-Experts (MoE) Vision-Language models. . DeepSeek-VL2 demonstrates superior capabilities across various tasks, including but not limited to visual question answering, optical character recognition, document/table/chart understanding, and visual grounding.
4+
5+
More details can be found in the [paper](https://arxiv.org/abs/2412.10302) and original [repository](https://github.com/deepseek-ai/DeepSeek-VL2).
6+
7+
In this tutorial we consider how to convert and run DeepSeek-VL2 models using [OpenVINO](https://github.com/openvinotoolkit/openvino) and optimize it using [NNCF](https://github.com/openvinotoolkit/nncf).
8+
9+
## Notebook contents
10+
The tutorial consists from following steps:
11+
12+
- Install requirements
13+
- Convert and Optimize model
14+
- Run OpenVINO model inference
15+
- Launch Interactive demo
16+
17+
In this demonstration, you'll create interactive chatbot that can answer questions about provided image's content.
18+
19+
![cat_deepseek](https://github.com/user-attachments/assets/343c2906-b4ec-4191-8ef4-375d04005cf0)
20+
21+
22+
## Installation instructions
23+
This is a self-contained example that relies solely on its own code.</br>
24+
We recommend running the notebook in a virtual environment. You only need a Jupyter server to start.
25+
For details, please refer to [Installation Guide](../../README.md).
26+
<img referrerpolicy="no-referrer-when-downgrade" src="https://static.scarf.sh/a.png?x-pxid=5b5a4db0-7875-4bfb-bdbd-01698b5b1a77&file=notebooks/deepseek-vl2/README.md" />

0 commit comments

Comments
 (0)