File tree Expand file tree Collapse file tree 1 file changed +3
-2
lines changed
quickwit/quickwit-control-plane/src/indexing_scheduler/scheduling Expand file tree Collapse file tree 1 file changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -15,8 +15,9 @@ We also want to observe some interesting properties such as:
1515To simplify the logic and make it easier to test it, we first abstract this in the following
1616optimization problem. In Quickwit, we have two types of source:
1717
18- - The push api source: they have a given (changing) set of shards associated to them.
19- A shard is rate-limited to ensure their throughput is lower than ` 5MB/s ` worth of
18+ - The push api source: indexes have a given (changing) set of shards associated to them.
19+ Shards are stored on indexer nodes and are spread randomly accross them. A shard is
20+ rate-limited to ensure their throughput is lower than ` 5MB/s ` worth of
2021 uncompressed data. This guarantees that a given shard can be indexed by a
2122 single indexing pipeline.
2223
You can’t perform that action at this time.
0 commit comments