Commit 4532da8
authored
feat(encryption): support AES-256 keys for reading Parquet data files (#2878)
## Which issue does this PR close?
- Closes #.
Depends on the arrow-rs 58.4.0 release tracked in apache/arrow-rs#10349.
## What changes are included in this PR?
- Bump `arrow`/`parquet` deps from `58` to `58.4`. arrow-rs 58.4.0 adds
AES-256 for Parquet modular encryption (58.3.0 was AES-128 only), landed
via apache/arrow-rs#9203.
- Add an AES-256 encrypted-Parquet read test. Refactored the existing
128-bit test into a shared `assert_encrypted_parquet_roundtrip(key)`
helper with `_aes_128` and `_aes_256` callers.
Note: 192-bit is not supported for data files. arrow-rs uses `ring`,
which has no AES-192-GCM. Can revisit later.
## Are these changes tested?
Yes. Unit test `test_read_encrypted_parquet_aes_256` writes and reads
back a 256-bit encrypted Parquet file. It fails on arrow-rs 58.3.0
(`ring` rejects the 32-byte key) and passes on 58.4.0.1 parent 6960920 commit 4532da8
3 files changed
Lines changed: 61 additions & 50 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
52 | | - | |
53 | | - | |
54 | | - | |
55 | | - | |
56 | | - | |
57 | | - | |
58 | | - | |
59 | | - | |
60 | | - | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
| |||
121 | 121 | | |
122 | 122 | | |
123 | 123 | | |
124 | | - | |
| 124 | + | |
125 | 125 | | |
126 | 126 | | |
127 | 127 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
737 | 737 | | |
738 | 738 | | |
739 | 739 | | |
740 | | - | |
741 | | - | |
742 | | - | |
| 740 | + | |
| 741 | + | |
| 742 | + | |
| 743 | + | |
743 | 744 | | |
744 | 745 | | |
745 | 746 | | |
| |||
807 | 808 | | |
808 | 809 | | |
809 | 810 | | |
| 811 | + | |
| 812 | + | |
| 813 | + | |
| 814 | + | |
| 815 | + | |
| 816 | + | |
| 817 | + | |
| 818 | + | |
| 819 | + | |
| 820 | + | |
810 | 821 | | |
811 | 822 | | |
812 | 823 | | |
| |||
0 commit comments