Skip to content

Conversation

@original-brownbear
Copy link
Contributor

If we have the shard id we don't need to separately write the index
name. Especially for large bulk requests this wastes a non-trivial
amount of memory.

If we have the shard id we don't need to separately write the index
name. Especially for large bulk requests this wastes a non-trivial
amount of memory.
@original-brownbear original-brownbear added >non-issue :Distributed Indexing/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. v8.0.0 v7.8.0 labels May 4, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (:Distributed/CRUD)

@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label May 4, 2020
Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was puzzled why ReplicationRequest has to deal with the case that it doesn't have a shard ID. I think that it's just that we use DeleteRequest and IndexRequest on both sides of the coordinating node, and the coordinating node fills the shard ID in itself. If so, can we instead separate the client-level usage from the shard-level usage and avoid this split personality?

@original-brownbear
Copy link
Contributor Author

If so, can we instead separate the client-level usage from the shard-level usage and avoid this split personality?

Looks like you're right :) This actually seems like the better option. I'll try to see if I can find a way to make this happen without the BwC concerns around this becoming too crazy.

@original-brownbear
Copy link
Contributor Author

original-brownbear commented May 6, 2020

Closing in favor of the more general improvements to this in #56209

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed Indexing/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. >non-issue Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.8.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants