[Question]: Is it possible to merge different workdirs or have different workdirs work together?

[Socratesa]

Do you need to ask a question?

• I have searched the existing question and discussions and this question is not already answered.
• I believe this is a legitimate question, not just a bug or feature request.

Your Question

Due to the large amount of data, I divided the data into multiple copies. In order to prevent conflicts, I chose different workdirs for processing. Does LightRAG support merging different workdirs or unified query processing so that I don’t have to make the same query request in different workdirs? This is my ultimate appeal.

Now what I do is merge the kv_store_llm_response_cache.json in different workdirs, then delete other files and rerun (as mentioned in the link #1280). Even with the cache, I found that the speed is much slower than I expected.

Additional Context

No response

[Socratesa]

[Socratesa]

I re-run for about an hour and can process more than 700 chunks, but I have about 40,000 chunks, so this time cost is unbearable.

[Socratesa]

Or does it support multiple processes inserting into the same workdir?

[Socratesa]

Or does it support multiple processes inserting into the same workdir?

I've verified it, it's very slow, it doesn't seem feasible