-
Notifications
You must be signed in to change notification settings - Fork 565
test-lora-310p-build #4187
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
test-lora-310p-build #4187
Conversation
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
…n vllm-ascend. vLLM version: v0.11.0 vLLM main: vllm-project/vllm Signed-off-by: liuchenbing <[email protected]>
|
👋 Hi! Thank you for contributing to the vLLM Ascend project. The following points will speed up your PR merge:
If CI fails, you can run linting and testing checks locally according Contributing and Testing. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request aims to adjust the conditional compilation for bfloat16_t support in several C++ kernels. However, the changes introduce compilation errors across all modified C++ files (bgmv_expand.cpp, bgmv_shrink.cpp, sgmv_expand.cpp, sgmv_shrink.cpp) due to an invalid preprocessor directive syntax and a typo in a macro name. I've left comments with suggestions to fix these critical issues. The change in vllm_ascend/lora/punica_npu.py appears to be a valid fix to ensure the correct data type for a kernel input.
| #ifndef __CCE_AI_CORE__ || __CCE_AI_CORE__ >= 200 | ||
| BGMV_EXPAND_TYPE_DECLARE(bfloat16_t); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This preprocessor directive contains a typo and uses invalid syntax. The macro name should be __CCE_AICORE__ (with a single underscore). Also, #ifndef A || B is not valid; you should use #if for compound conditions. The same issue exists in the other conditional compilation block in this file.
#if !defined(__CCE_AICORE__) || (__CCE_AICORE__ >= 200)
BGMV_EXPAND_TYPE_DECLARE(bfloat16_t);| #ifndef __CCE_AI_CORE__ || __CCE_AI_CORE__ >= 200 | ||
| BGMV_SHRINK_TYPE_DECLARE(bfloat16_t); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There's a typo in the macro name (__CCE_AI_CORE__ should be __CCE_AICORE__) and the preprocessor syntax is incorrect. #ifndef does not support ||. Please use #if !defined(...) || ... to fix the compilation error. This correction is needed in both conditional blocks in this file.
#if !defined(__CCE_AICORE__) || (__CCE_AICORE__ >= 200)
BGMV_SHRINK_TYPE_DECLARE(bfloat16_t);| #ifndef __CCE_AI_CORE__ || __CCE_AI_CORE__ >= 200 | ||
| SGMV_EXPAND_TYPE_DECLARE(bfloat16_t); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This preprocessor directive will cause a compilation failure. There is a typo in the macro name (__CCE_AI_CORE__ should be __CCE_AICORE__), and #ifndef cannot be used with a logical OR. Please rewrite it using #if. This issue is repeated later in the file.
#if !defined(__CCE_AICORE__) || (__CCE_AICORE__ >= 200)
SGMV_EXPAND_TYPE_DECLARE(bfloat16_t);| #ifndef __CCE_AI_CORE__ || __CCE_AI_CORE__ >= 200 | ||
| SGMV_SHRINK_TYPE_DECLARE(bfloat16_t); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This line has an invalid preprocessor directive and a typo. The macro name should be __CCE_AICORE__. The #ifndef A || B syntax is incorrect and should be replaced with #if !defined(A) || (B). This needs to be fixed in both places it occurs in this file to avoid build errors.
#if !defined(__CCE_AICORE__) || (__CCE_AICORE__ >= 200)
SGMV_SHRINK_TYPE_DECLARE(bfloat16_t);
What this PR does / why we need it?
Does this PR introduce any user-facing change?
How was this patch tested?