You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: python/llm/example/GPU/HuggingFace/LLM/mistral/README.md
-7Lines changed: 0 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,6 @@ In this directory, you will find examples on how you could apply IPEX-LLM INT4 o
4
4
## Requirements
5
5
To run these examples with IPEX-LLM on Intel GPUs, we have some recommended requirements for your machine, please refer to [here](../../../README.md#requirements) for more information.
6
6
7
-
**Important: According to [Mistral Troubleshooting](https://huggingface.co/mistralai/Mistral-7B-v0.1#troubleshooting), please make sure you have installed `transformers==4.34.0` to run the example.**
8
7
9
8
## Example: Predict Tokens using `generate()` API
10
9
In the example [generate.py](./generate.py), we show a basic use case for a Mistral model to predict the next N tokens using `generate()` API, with IPEX-LLM INT4 optimizations on Intel GPUs.
@@ -16,9 +15,6 @@ conda create -n llm python=3.11
16
15
conda activate llm
17
16
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
# Refer to https://huggingface.co/mistralai/Mistral-7B-v0.1#troubleshooting, please make sure you are using a stable version of Transformers, 4.34.0 or newer.
21
-
pip install transformers==4.34.0
22
18
```
23
19
24
20
#### 1.2 Installation on Windows
@@ -29,9 +25,6 @@ conda activate llm
29
25
30
26
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
# Refer to https://huggingface.co/mistralai/Mistral-7B-v0.1#troubleshooting, please make sure you are using a stable version of Transformers, 4.34.0 or newer.
34
-
pip install transformers==4.34.0
35
28
```
36
29
37
30
### 2. Configures OneAPI environment variables for Linux
0 commit comments