- 
                Notifications
    
You must be signed in to change notification settings  - Fork 106
 
Onnx kill switch #779
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
          
     Merged
      
      
    
  
     Merged
                    Onnx kill switch #779
Changes from 32 commits
      Commits
    
    
            Show all changes
          
          
            35 commits
          
        
        Select commit
          Hold shift + click to select a range
      
      040043d
              
                Introduce kill switch mechanism for onnxruntime sessions (not ready yet)
              
              
                alonre24 0961e66
              
                Putting login in onnx backend (not ready yet)
              
              
                alonre24 9d5fbf8
              
                WIP
              
              
                alonre24 22662bd
              
                Refactor background workers + add support to kill switch in onnx (for…
              
              
                alonre24 c3a45e9
              
                Refactor - do not use rax, extend onnxRunSessions array whenever a ne…
              
              
                alonre24 2684852
              
                Refactor backends loading
              
              
                alonre24 cd9baa1
              
                Start testing - not finished
              
              
                alonre24 5c09106
              
                Support bool type tensor
              
              
                alonre24 5d3dd2c
              
                Support tensors of type bool. Add validation that a input value doesn…
              
              
                alonre24 fa14217
              
                Merge branch 'Support_BOOL_type_for_tensors' into ONNX_kill_switch
              
              
                alonre24 04dac08
              
                Support tensor of type bool in ONNX, Add tests for kill switch
              
              
                alonre24 1d6b3ed
              
                Add load time config for ONNX_TIMEOUT. Parallel tests seems not to work.
              
              
                alonre24 ea3c174
              
                Some fixes
              
              
                alonre24 05c2a39
              
                Merge master (resolve conflicts in backends.c)
              
              
                alonre24 4bbfbcd
              
                Remove debug print
              
              
                alonre24 cd2936c
              
                Merge master with updated changes of supporting tensor of type bool
              
              
                alonre24 4aed8ca
              
                Some fixes and documentation complement.
              
              
                alonre24 6cd9652
              
                Refactor load time config
              
              
                alonre24 42059b8
              
                Remove redundant include
              
              
                alonre24 6c906aa
              
                Merge branch 'master' into ONNX_kill_switch
              
              
                alonre24 23749c4
              
                PR fixes part 1: refactor config and run queue info files (and all pl…
              
              
                alonre24 342afbb
              
                Merge branch 'ONNX_kill_switch' of https://github.com/RedisAI/RedisAI…
              
              
                alonre24 697faf9
              
                linter...
              
              
                alonre24 ee02cc0
              
                Merge branch 'master' into ONNX_kill_switch
              
              
                alonre24 1201cb2
              
                linter...
              
              
                alonre24 4360679
              
                Merge branch 'master' into ONNX_kill_switch
              
              
                alonre24 21737e6
              
                More PR fixes, add the option to get the global run sessions array fr…
              
              
                alonre24 73f2a91
              
                Minor fixes
              
              
                alonre24 3942d23
              
                More PR fixes, among that:
              
              
                alonre24 e9fed4f
              
                Merge branch 'master' into ONNX_kill_switch
              
              
                alonre24 349653c
              
                Fix tests for the case that we run on GPU - since CPU queue always cr…
              
              
                alonre24 af423a7
              
                Update readies
              
              
                alonre24 fd8c672
              
                PR fixes
              
              
                alonre24 78da23e
              
                Return error if onnx is executed in a non async manner (via gears for…
              
              
                alonre24 285b5be
              
                Small refactor in get_thread_id function.
              
              
                alonre24 File filter
Filter by extension
Conversations
          Failed to load comments.   
        
        
          
      Loading
        
  Jump to
        
          Jump to file
        
      
      
          Failed to load files.   
        
        
          
      Loading
        
  Diff view
Diff view
There are no files selected for viewing
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              | Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,11 @@ | ||
| #pragma once | ||
| 
     | 
||
| #include <stdint.h> | ||
| 
     | 
||
| uintptr_t (*RedisAI_GetThreadId)(void); | ||
| 
     | 
||
| uintptr_t (*RedisAI_GetThreadsCount)(void); | ||
| 
     | 
||
| long long (*RedisAI_GetNumThreadsPerQueue)(void); | ||
| 
     | 
||
| long long (*RedisAI_GetModelExecutionTimeout)(void); | ||
      
      Oops, something went wrong.
        
    
  
  Add this suggestion to a batch that can be applied as a single commit.
  This suggestion is invalid because no changes were made to the code.
  Suggestions cannot be applied while the pull request is closed.
  Suggestions cannot be applied while viewing a subset of changes.
  Only one suggestion per line can be applied in a batch.
  Add this suggestion to a batch that can be applied as a single commit.
  Applying suggestions on deleted lines is not supported.
  You must change the existing code in this line in order to create a valid suggestion.
  Outdated suggestions cannot be applied.
  This suggestion has been applied or marked resolved.
  Suggestions cannot be applied from pending reviews.
  Suggestions cannot be applied on multi-line comments.
  Suggestions cannot be applied while the pull request is queued to merge.
  Suggestion cannot be applied right now. Please check back later.
  
    
  
    
Uh oh!
There was an error while loading. Please reload this page.