Skip to content

Conversation

@tanik98
Copy link
Owner

@tanik98 tanik98 commented Apr 2, 2025

Description

  • Integrating derive source feature in get and search path
  • Tested this integration for various cases.
  • Added integration tests for all relevant paths like create/update/get/search/reindex.

Considerations:

  • For the scenarios where we read from the translog, we have created the in-memory lucene index, which will ensure that we derive source from lucene docValues and stored fields only instead of reading _source directly from translog. This will help in making final resulted source consistent in terms of various fields(like Date, GeoPoint(we always return in lat/lon pair, input source can have different format like geohash)) where display format can vary as compared to suppkied format passed during ingestion.

This PR is a continuation of opensearch-project#17759

Related Issues

Resolves opensearch-project#17073

Part of feature opensearch-project#9568

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@tanik98 tanik98 force-pushed the tanik-derived-source-feature-integration branch from 37dcfe9 to 116f32e Compare April 23, 2025 17:25
@tanik98 tanik98 closed this Apr 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants