Skip to content

Commit 2dc8bf1

Browse files
Add example binary variant data and regeneration scripts (#76)
Adds raw binary encodings for variant types along with script that was used to generate them and a JSON map documenting values in the files. Co-authored-by: Russell Spitzer <[email protected]> --------- Co-authored-by: Russell Spitzer <[email protected]>
1 parent d1f14a0 commit 2dc8bf1

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

54 files changed

+311
-0
lines changed

README.md

Lines changed: 6 additions & 0 deletions

variant/README.md

Lines changed: 52 additions & 0 deletions

variant/array_empty.metadata

3 Bytes
Binary file not shown.

variant/array_empty.value

3 Bytes
Binary file not shown.

variant/array_nested.metadata

23 Bytes
Binary file not shown.

variant/array_nested.value

75 Bytes
Binary file not shown.

variant/array_primitive.metadata

3 Bytes
Binary file not shown.

variant/array_primitive.value

15 Bytes
Binary file not shown.

variant/data_dictionary.json

Lines changed: 73 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,73 @@
1+
{
2+
"array_empty": [],
3+
"array_nested": [
4+
{
5+
"id": 1,
6+
"thing": {
7+
"names": [
8+
"Contrarian",
9+
"Spider"
10+
]
11+
}
12+
},
13+
null,
14+
{
15+
"id": 2,
16+
"names": [
17+
"Apple",
18+
"Ray",
19+
null
20+
],
21+
"type": "if"
22+
}
23+
],
24+
"array_primitive": [
25+
2,
26+
1,
27+
5,
28+
9
29+
],
30+
"object_empty": {},
31+
"object_nested": {
32+
"id": 1,
33+
"observation": {
34+
"location": "In the Volcano",
35+
"time": "12:34:56",
36+
"value": {
37+
"humidity": 456,
38+
"temperature": 123
39+
}
40+
},
41+
"species": {
42+
"name": "lava monster",
43+
"population": 6789
44+
}
45+
},
46+
"object_primitive": {
47+
"boolean_false_field": false,
48+
"boolean_true_field": true,
49+
"double_field": 1.23456789,
50+
"int_field": 1,
51+
"null_field": null,
52+
"string_field": "Apache Parquet",
53+
"timestamp_field": "2025-04-16T12:34:56.78"
54+
},
55+
"primitive_binary": "AxM33q2+78r+",
56+
"primitive_boolean_false": false,
57+
"primitive_boolean_true": true,
58+
"primitive_date": "2025-04-16",
59+
"primitive_decimal16": 1.2345678912345678e+16,
60+
"primitive_decimal4": 12.34,
61+
"primitive_decimal8": 12345678.9,
62+
"primitive_double": 1234567890.1234,
63+
"primitive_float": 1234567940.0,
64+
"primitive_int16": 1234,
65+
"primitive_int32": 123456,
66+
"primitive_int64": 12345678,
67+
"primitive_int8": 42,
68+
"primitive_null": null,
69+
"primitive_string": "This string is longer than 64 bytes and therefore does not fit in a short_string and it also includes several non ascii characters such as \ud83d\udc22, \ud83d\udc96, \u2665\ufe0f, \ud83c\udfa3 and \ud83e\udd26!!",
70+
"primitive_timestamp": "2025-04-16 12:34:56.78-04:00",
71+
"primitive_timestampntz": "2025-04-16 12:34:56.78",
72+
"short_string": "Less than 64 bytes (\u2764\ufe0f with utf8)"
73+
}

variant/long_string.metadata

3 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)