RedisAI v1.0.1 LLAPI not being properly loaded by RedisGears v1.0.1

[filipecosta90]

The issue seems to be related to RedisAI_TensorRedisType, as per the sample output:

docker run -p 6379:6379 redislabs/redismod
1:C 07 Aug 2020 13:23:56.396 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 07 Aug 2020 13:23:56.396 # Redis version=6.0.1, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 07 Aug 2020 13:23:56.396 # Configuration loaded
1:M 07 Aug 2020 13:23:56.396 * Increased maximum number of open files to 10032 (it was originally set to 1024).
1:M 07 Aug 2020 13:23:56.397 * Running mode=standalone, port=6379.
1:M 07 Aug 2020 13:23:56.397 # Server initialized
1:M 07 Aug 2020 13:23:56.397 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 07 Aug 2020 13:23:56.397 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 07 Aug 2020 13:23:56.397 * <ai> Redis version found by RedisAI: 6.0.1 - oss
1:M 07 Aug 2020 13:23:56.397 * <ai> RedisAI version 10001, git_sha=dd2848af1206b435aaf956dbdb28088d3798502a
1:M 07 Aug 2020 13:23:56.397 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
1:M 07 Aug 2020 13:23:56.398 * <ft> RediSearch version 1.6.13 (Git=v1.6.13)
1:M 07 Aug 2020 13:23:56.398 * <ft> Low level api version 1 initialized successfully
1:M 07 Aug 2020 13:23:56.398 * <ft> concurrent writes: OFF, gc: ON, prefix min length: 2, prefix max expansions: 200, query timeout (ms): 500, timeout policy: return, cursor read size: 1000, cursor max idle (ms): 300000, max doctable size: 1000000, search pool size: 20, index pool size: 8, 
1:M 07 Aug 2020 13:23:56.398 * <ft> Initialized thread pool!
1:M 07 Aug 2020 13:23:56.398 * Module 'ft' loaded from /usr/lib/redis/modules/redisearch.so
1:M 07 Aug 2020 13:23:56.402 * <graph> Graph deletion will be done asynchronously.
1:M 07 Aug 2020 13:23:56.402 * <graph> Thread pool created, using 8 threads.
1:M 07 Aug 2020 13:23:56.402 * <graph> Maximum number of OpenMP threads set to 8
1:M 07 Aug 2020 13:23:56.402 * Module 'graph' loaded from /usr/lib/redis/modules/redisgraph.so
1:M 07 Aug 2020 13:23:56.403 * <timeseries> RedisTimeSeries version 10207, git_sha=
1:M 07 Aug 2020 13:23:56.403 * <timeseries> Redis version found by RedisTimeSeries : 6.0.1 - oss
1:M 07 Aug 2020 13:23:56.403 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
1:M 07 Aug 2020 13:23:56.403 # <ReJSON> JSON data type for Redis v1.0.4 [encver 0]
1:M 07 Aug 2020 13:23:56.403 * Module 'ReJSON' loaded from /usr/lib/redis/modules/rejson.so
1:M 07 Aug 2020 13:23:56.403 * Module 'bf' loaded from /usr/lib/redis/modules/redisbloom.so
1:M 07 Aug 2020 13:23:56.405 * <rg> RedisGears version 1.0.1, git_sha=155ef626ae6f728e9d9c646cf810954d8c51b9ab, compiled_os=linux-buster-x64
1:M 07 Aug 2020 13:23:56.405 * <rg> Redis version found by RedisGears : 6.0.1 - oss
1:M 07 Aug 2020 13:23:56.405 * <rg> MaxExecutions:1000
1:M 07 Aug 2020 13:23:56.405 * <rg> MaxExecutionsPerRegistration:100
1:M 07 Aug 2020 13:23:56.405 * <rg> ProfileExecutions:0
1:M 07 Aug 2020 13:23:56.405 * <rg> PythonAttemptTraceback:1
1:M 07 Aug 2020 13:23:56.405 * <rg> DependenciesUrl:http://redismodules.s3.amazonaws.com/redisgears/redisgears-dependencies.linux-buster-x64.1.0.1.tgz
1:M 07 Aug 2020 13:23:56.405 * <rg> DependenciesSha256:dd1c4c55e296a27a3044b315219b23505ffbc222376fa7af1a7dac079d94caaa
1:M 07 Aug 2020 13:23:56.405 * <rg> CreateVenv:0
1:M 07 Aug 2020 13:23:56.405 * <rg> ExecutionThreads:3
1:M 07 Aug 2020 13:23:56.405 * <rg> ExecutionMaxIdleTime:5000
1:M 07 Aug 2020 13:23:56.405 * <rg> PythonInstallReqMaxIdleTime:30000
1:M 07 Aug 2020 13:23:56.405 * <rg> PythonInstallationDir:/var/opt/redislabs/modules/rg
1:M 07 Aug 2020 13:23:56.405 * <rg> DownloadDeps:1
1:M 07 Aug 2020 13:23:56.405 * <rg> ForceDownloadDepsOnEnterprise:0
1:M 07 Aug 2020 13:23:56.405 * <rg> SendMsgRetries:3
1:M 07 Aug 2020 13:23:56.405 * <rg> PythonHomeDir:/opt/redislabs/lib/modules/python3
1:M 07 Aug 2020 13:23:56.405 # <rg> could not initialize RedisAI_TensorRedisType
1:M 07 Aug 2020 13:23:56.405 # <rg> could not initialize RediAI api, running without AI support.
1:M 07 Aug 2020 13:23:56.405 * <rg> PYENV_DIR: /var/opt/redislabs/modules/rg//python3_1.0.1/
1:M 07 Aug 2020 13:23:56.405 * <rg> PYENV_HOME_DIR: /var/opt/redislabs/modules/rg//python3_1.0.1//.venv/
1:M 07 Aug 2020 13:23:56.405 * <rg> PYENV_BIN_DIR: /var/opt/redislabs/modules/rg//python3_1.0.1//.venv//bin
1:M 07 Aug 2020 13:23:56.405 * <rg> PYENV_ACTIVATE: /var/opt/redislabs/modules/rg//python3_1.0.1//.venv//bin/activate_this.py
1:M 07 Aug 2020 13:23:56.405 * <rg> PYENV_ACTIVATE_SCRIPT: /var/opt/redislabs/modules/rg//python3_1.0.1//.venv//bin/activate
1:M 07 Aug 2020 13:23:56.405 * <rg> Found python installation under: /var/opt/redislabs/modules/rg//python3_1.0.1/
1:M 07 Aug 2020 13:23:56.463 * Module 'rg' loaded from /var/opt/redislabs/lib/modules/redisgears.so
1:M 07 Aug 2020 13:23:56.463 * Ready to accept connections

[filipecosta90]

This fix has been fixed by #450 ( which added the missing backport of RedisAI_TensorRedisType ) meaning that on redisai v1.0.2 this issue is gone, as can be confirmed in the following docker run output log:

$ docker run -p 6379:6379 redislabs/redismod
1:C 25 Nov 2020 17:29:59.974 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 25 Nov 2020 17:29:59.974 # Redis version=6.0.1, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 25 Nov 2020 17:29:59.974 # Configuration loaded
1:M 25 Nov 2020 17:29:59.975 * Increased maximum number of open files to 10032 (it was originally set to 1024).
1:M 25 Nov 2020 17:29:59.976 * Running mode=standalone, port=6379.
1:M 25 Nov 2020 17:29:59.976 # Server initialized
1:M 25 Nov 2020 17:29:59.976 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 25 Nov 2020 17:29:59.976 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 25 Nov 2020 17:29:59.976 * <ai> Redis version found by RedisAI: 6.0.1 - oss
1:M 25 Nov 2020 17:29:59.976 * <ai> RedisAI version 10002, git_sha=97bedfa60238fa0fa6b318b7d9e5df995fe8b5e2
1:M 25 Nov 2020 17:29:59.977 * Module 'ai' loaded from /usr/lib/redis/modules/redisai.so
1:M 25 Nov 2020 17:29:59.977 * <search> Redis version found by RedisSearch : 6.0.1 - oss
1:M 25 Nov 2020 17:29:59.977 * <search> RediSearch version 2.0.3 (Git=v2.0.3)
1:M 25 Nov 2020 17:29:59.977 * <search> Low level api version 1 initialized successfully
1:M 25 Nov 2020 17:29:59.977 * <search> concurrent writes: OFF, gc: ON, prefix min length: 2, prefix max expansions: 200, query timeout (ms): 500, timeout policy: return, cursor read size: 1000, cursor max idle (ms): 300000, max doctable size: 1000000, max number of search results:  1000000, search pool size: 20, index pool size: 8, 
1:M 25 Nov 2020 17:29:59.977 * <search> Initialized thread pool!
1:M 25 Nov 2020 17:29:59.977 * Module 'search' loaded from /usr/lib/redis/modules/redisearch.so
1:M 25 Nov 2020 17:29:59.982 * <graph> Graph deletion will be done asynchronously.
1:M 25 Nov 2020 17:29:59.982 * <graph> Thread pool created, using 8 threads.
1:M 25 Nov 2020 17:29:59.982 * <graph> Maximum number of OpenMP threads set to 8
1:M 25 Nov 2020 17:29:59.982 * Module 'graph' loaded from /usr/lib/redis/modules/redisgraph.so
1:M 25 Nov 2020 17:29:59.982 * <timeseries> RedisTimeSeries version 10406, git_sha=35b3b2f6d651f8dd5313f661c04bd2c77caacd2c
1:M 25 Nov 2020 17:29:59.982 * <timeseries> Redis version found by RedisTimeSeries : 6.0.1 - oss
1:M 25 Nov 2020 17:29:59.982 * Module 'timeseries' loaded from /usr/lib/redis/modules/redistimeseries.so
1:M 25 Nov 2020 17:29:59.982 # <ReJSON> JSON data type for Redis v1.0.6 [encver 0]
1:M 25 Nov 2020 17:29:59.982 * Module 'ReJSON' loaded from /usr/lib/redis/modules/rejson.so
1:M 25 Nov 2020 17:29:59.983 * Module 'bf' loaded from /usr/lib/redis/modules/redisbloom.so
1:M 25 Nov 2020 17:29:59.984 * <rg> RedisGears version 1.0.3, git_sha=6d6d74b69412bfbbf5bcfe1e951faa523d1b80e4, compiled_os=linux-buster-x64
1:M 25 Nov 2020 17:29:59.984 * <rg> Redis version found by RedisGears : 6.0.1 - oss
1:M 25 Nov 2020 17:29:59.984 * <rg> MaxExecutions:1000
1:M 25 Nov 2020 17:29:59.984 * <rg> MaxExecutionsPerRegistration:100
1:M 25 Nov 2020 17:29:59.984 * <rg> ProfileExecutions:0
1:M 25 Nov 2020 17:29:59.984 * <rg> PythonAttemptTraceback:1
1:M 25 Nov 2020 17:29:59.984 * <rg> DependenciesUrl:http://redismodules.s3.amazonaws.com/redisgears/redisgears-dependencies.linux-buster-x64.1.0.3.tgz
1:M 25 Nov 2020 17:29:59.984 * <rg> DependenciesSha256:799de46b223d4eaaf2c84695648e58db8c502f3ccd4d2b8b09d5365dfd699016
1:M 25 Nov 2020 17:29:59.984 * <rg> CreateVenv:0
1:M 25 Nov 2020 17:29:59.984 * <rg> ExecutionThreads:3
1:M 25 Nov 2020 17:29:59.984 * <rg> ExecutionMaxIdleTime:5000
1:M 25 Nov 2020 17:29:59.984 * <rg> PythonInstallReqMaxIdleTime:30000
1:M 25 Nov 2020 17:29:59.984 * <rg> PythonInstallationDir:/var/opt/redislabs/modules/rg
1:M 25 Nov 2020 17:29:59.984 * <rg> DownloadDeps:1
1:M 25 Nov 2020 17:29:59.984 * <rg> ForceDownloadDepsOnEnterprise:0
1:M 25 Nov 2020 17:29:59.984 * <rg> SendMsgRetries:3
1:M 25 Nov 2020 17:29:59.984 * <rg> PythonHomeDir:/opt/redislabs/lib/modules/python3
1:M 25 Nov 2020 17:29:59.984 * <rg> RedisAI api loaded successfully.
1:M 25 Nov 2020 17:29:59.990 * <rg> PYENV_DIR: /var/opt/redislabs/modules/rg//python3_1.0.3/
1:M 25 Nov 2020 17:29:59.990 * <rg> PYENV_HOME_DIR: /var/opt/redislabs/modules/rg//python3_1.0.3//.venv/
1:M 25 Nov 2020 17:29:59.990 * <rg> PYENV_BIN_DIR: /var/opt/redislabs/modules/rg//python3_1.0.3//.venv//bin
1:M 25 Nov 2020 17:29:59.990 * <rg> PYENV_ACTIVATE: /var/opt/redislabs/modules/rg//python3_1.0.3//.venv//bin/activate_this.py
1:M 25 Nov 2020 17:29:59.990 * <rg> PYENV_ACTIVATE_SCRIPT: /var/opt/redislabs/modules/rg//python3_1.0.3//.venv//bin/activate
1:M 25 Nov 2020 17:29:59.990 * <module> log file is 

1:M 25 Nov 2020 17:29:59.990 * <rg> Found python installation under: /var/opt/redislabs/modules/rg//python3_1.0.3/
1:M 25 Nov 2020 17:30:00.044 * Module 'rg' loaded from /var/opt/redislabs/lib/modules/redisgears.so
1:M 25 Nov 2020 17:30:00.045 * Ready to accept connections

We can close this issue and also RedisLabsModules/redismod#7