Skip to content

Conversation

@CurtHagenlocher
Copy link
Contributor

Adds helpers for Schema and RecordBatch to allow them to be serialized and deserialized individually. Refactors Flight-related code slightly to make use of the new helpers.

Closes #31.

Small refactoring of Flight-related code.

cArray->n_buffers = 1;
cArray->buffers = (byte**)sharedOwner.Allocate(IntPtr.Size);
cArray->buffers[0] = null;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was already checked-in as a separate change. Will rebase if necessary.

@CurtHagenlocher CurtHagenlocher merged commit 46dd36f into apache:main Oct 6, 2025
14 checks passed
Copy link
Contributor

@adamreeve adamreeve left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me thanks Curt, I just have a couple of minor comments.

{
// Translate an Apache.Arrow.Schema to FlatBuffer Schema to ByteString
// This should never have been a public class without a namespace
// TODO: Mark as obsolete once sufficient time has passed
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we just mark this as obsolete now? Otherwise there's no indication that users should switch to something else. Either way, it would be good to add a comment to direct users to use ArrowSerializationHelpers.SerializeSchema instead if we don't want people using this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah; I'd been thinking that marking it obsolete would break binary compatibility but of course that's not true so we may as well do it now.

}

/// <summary>
/// This class handles writing schemas
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It also writes RecordBatches. I can't think of a better name for it though.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess I didn't look that closely at the code I moved ;).

CurtHagenlocher added a commit that referenced this pull request Oct 6, 2025
Apply feedback from PR for #100:

- Mark method as obsolete now instead of waiting
- Fix comment
@CurtHagenlocher CurtHagenlocher deleted the GH-31 branch October 7, 2025 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Expose lower-level APIs to consume partial Arrow data

2 participants