Skip to content

Commit 100cabc

Browse files
Keras with OpenVINO backend (#2798)
CVS-159587
1 parent 2bed272 commit 100cabc

File tree

5 files changed

+378
-1
lines changed

5 files changed

+378
-1
lines changed

.ci/check_notebooks.py

+1
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@
2020
Path("notebooks/s3d-mil-nce-text-to-video-retrieval/s3d-mil-nce-text-to-video-retrieval.ipynb"), # only cpu
2121
Path("notebooks/explainable-ai-2-deep-dive/explainable-ai-2-deep-dive.ipynb"), # device-agnostic
2222
Path("notebooks/localai/localai.ipynb"), # can not change device in docker configuration on the fly
23+
Path("notebooks/keras-with-openvino-backend/keras-with-openvino-backend.ipynb"), # only cpu
2324
]
2425

2526

.ci/skipped_notebooks.yml

+7-1
Original file line numberDiff line numberDiff line change
@@ -504,4 +504,10 @@
504504
- os:
505505
- macos-13
506506
- ubuntu-22.04
507-
- windows-2019
507+
- windows-2019
508+
- notebook: notebooks/keras-with-openvino-backend/keras-with-openvino-backend.ipynb
509+
skips:
510+
- os:
511+
- windows-2019
512+
- python:
513+
- '3.12'

.ci/spellcheck/.pyspelling.wordlist.txt

+1
Original file line numberDiff line numberDiff line change
@@ -423,6 +423,7 @@ KD
423423
KDE
424424
keras
425425
KerasCV
426+
KerasHub
426427
keypoint
427428
keypoints
428429
KiTS
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
# Run inference in Keras 3 with the OpenVINO™ IR backend
2+
3+
Starting with release 3.8, [Keras](https://github.com/keras-team/keras) provides native integration with the OpenVINO backend for accelerated inference. This integration enables you to leverage OpenVINO performance optimizations directly within the Keras workflow, enabling faster inference on OpenVINO supported hardware.
4+
5+
6+
In this tutorial, we will show how to run inference of an end-to-end [BERT model for classification tasks](https://www.kaggle.com/models/keras/bert/) using the OpenVINO backend.
7+
8+
9+
>**Note**: The OpenVINO backend may currently lack support for some operations. This will be addressed in upcoming Keras releases as operation coverage is being expanded.
10+
11+
12+
## Notebook contents
13+
- Prerequisites
14+
- Load the model with the OpenVINO backend and inference
15+
- Sentiment Classification Example
16+
17+
18+
## Installation instructions
19+
This is a self-contained example that relies solely on its own code.</br>
20+
We recommend running the notebook in a virtual environment. You only need a Jupyter server to start.
21+
For details, please refer to [Installation Guide](../../README.md).
22+
<img referrerpolicy="no-referrer-when-downgrade" src="https://static.scarf.sh/a.png?x-pxid=5b5a4db0-7875-4bfb-bdbd-01698b5b1a77&file=notebooks/keras-with-openvino-backend/README.md" />

0 commit comments

Comments
 (0)