shaoting-huang 88b373b024 enhance: binlog primary key turn off dict encoding (#34358) ... issue: #34357 Go Parquet uses dictionary encoding by default, and it will fall back to plain encoding if the dictionary size exceeds the dictionary size page limit. Users can specify custom fallback encoding by using `parquet.WithEncoding(ENCODING_METHOD)` in writer properties. However, Go Parquet [fallbacks to plain encoding](e65c1e295d/go/parquet/file/column_writer_types.gen.go.tmpl (L238)) rather than custom encoding method users provide. Therefore, this patch only turns off dictionary encoding for the primary key. With a 5 million auto ID primary key benchmark, the parquet file size improves from 13.93 MB to 8.36 MB when dictionary encoding is turned off, reducing primary key storage space by 40%. Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>		2024-07-17 17:47:44 +08:00
..
binlog	enhance: binlog primary key turn off dict encoding (#34358)	2024-07-17 17:47:44 +08:00
common	fix: Make the dynamic column optional in parquet import (#32738)	2024-05-07 11:21:29 +08:00
json	fix: Fix multiple vector fields import (#33723)	2024-06-10 21:57:54 +08:00
numpy	enhance: Fix lint issues from recent PRs (#34482)	2024-07-09 10:06:24 +08:00
parquet	fix: Fix SparseFloatVector data parse error for parquet (#33187)	2024-05-21 15:09:39 +08:00
mock_reader.go	enhance: Support retriving file size from importutilv2.Reader (#31533)	2024-03-25 20:29:07 +08:00
option.go	enhance: Support L0 import (#33514)	2024-06-07 14:17:20 +08:00
reader.go	enhance: Make the dynamic field file optional during numpy import (#32596)	2024-04-28 19:39:25 +08:00
util.go	enhance: Support retriving file size from importutilv2.Reader (#31533)	2024-03-25 20:29:07 +08:00