Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Even smaller field names! #1639

Draft
wants to merge 3 commits into
base: develop
Choose a base branch
from
Draft

[WIP] Even smaller field names! #1639

wants to merge 3 commits into from

Conversation

AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Dec 10, 2024

No description provided.

@AdamGS AdamGS added the benchmark Run benchmarks on this branch label Dec 10, 2024
@github-actions github-actions bot removed the benchmark Run benchmarks on this branch label Dec 10, 2024
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TPC-H

Benchmark suite Current: 9a6ff5e Previous: 02b1ef3 Ratio
tpch_q01/arrow 573083214 ns 535233061 ns 1.07
tpch_q01/vortex-file-compressed 462005947 ns 460181335 ns 1.00
tpch_q02/arrow 140429832 ns 141310585 ns 0.99
tpch_q02/vortex-file-compressed 145672402 ns 146645566 ns 0.99
tpch_q03/arrow 166525603 ns 173074519 ns 0.96
tpch_q03/vortex-file-compressed 228469370 ns 230034899 ns 0.99
tpch_q04/arrow 180509475 ns 181300044 ns 1.00
tpch_q04/vortex-file-compressed 162654425 ns 160210009 ns 1.02
tpch_q05/arrow 304629674 ns 317519627 ns 0.96
tpch_q05/vortex-file-compressed 324687030 ns 354250412 ns 0.92
tpch_q06/arrow 25613918 ns 25927495 ns 0.99
tpch_q06/vortex-file-compressed 59289207 ns 63838348 ns 0.93
tpch_q07/arrow 603314562 ns 635069293 ns 0.95
tpch_q07/vortex-file-compressed 638608812 ns 657202060 ns 0.97
tpch_q08/arrow 248129021 ns 263048618 ns 0.94
tpch_q08/vortex-file-compressed 313938152 ns 325939397 ns 0.96
tpch_q09/arrow 455024821 ns 476805887 ns 0.95
tpch_q09/vortex-file-compressed 531618595 ns 554256248 ns 0.96
tpch_q10/arrow 259364777 ns 265233086 ns 0.98
tpch_q10/vortex-file-compressed 298435107 ns 279678493 ns 1.07
tpch_q11/arrow 144380445 ns 142850862 ns 1.01
tpch_q11/vortex-file-compressed 129021924 ns 127710302 ns 1.01
tpch_q12/arrow 185573362 ns 179174128 ns 1.04
tpch_q12/vortex-file-compressed 235619451 ns 232184740 ns 1.01
tpch_q13/arrow 180458373 ns 170806080 ns 1.06
tpch_q13/vortex-file-compressed 188642911 ns 179335498 ns 1.05
tpch_q14/arrow 38744321 ns 38214027 ns 1.01
tpch_q14/vortex-file-compressed 66373348 ns 66562971 ns 1.00
tpch_q15/arrow 64819322 ns 70435004 ns 0.92
tpch_q15/vortex-file-compressed 107344648 ns 113044625 ns 0.95
tpch_q16/arrow 95494796 ns 104879752 ns 0.91
tpch_q16/vortex-file-compressed 99618595 ns 108638029 ns 0.92
tpch_q17/arrow 627568937 ns 637487690 ns 0.98
tpch_q17/vortex-file-compressed 558045469 ns 564646834 ns 0.99
tpch_q18/arrow 1168694999 ns 1154930694 ns 1.01
tpch_q18/vortex-file-compressed 1222080950 ns 1176160330 ns 1.04
tpch_q19/arrow 151859274 ns 150931651 ns 1.01
tpch_q19/vortex-file-compressed 110733147 ns 115623362 ns 0.96
tpch_q20/arrow 209043978 ns 229025674 ns 0.91
tpch_q20/vortex-file-compressed 233214599 ns 252655071 ns 0.92
tpch_q21/arrow 960098853 ns 995025371 ns 0.96
tpch_q21/vortex-file-compressed 933171752 ns 955153508 ns 0.98
tpch_q22/arrow 75715037 ns 78232125 ns 0.97
tpch_q22/vortex-file-compressed 78941317 ns 82335322 ns 0.96

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clickbench

Benchmark suite Current: 9a6ff5e Previous: 02b1ef3 Ratio
clickbench_q00/vortex-file-compressed 2008434 ns 2044520 ns 0.98
clickbench_q01/vortex-file-compressed 26984961 ns 27305664 ns 0.99
clickbench_q02/vortex-file-compressed 59376794 ns 65087497 ns 0.91
clickbench_q03/vortex-file-compressed 68638510 ns 71732492 ns 0.96
clickbench_q04/vortex-file-compressed 587487552 ns 609974125 ns 0.96
clickbench_q05/vortex-file-compressed 602710686 ns 623299627 ns 0.97
clickbench_q06/vortex-file-compressed 2068778 ns 2101410 ns 0.98
clickbench_q07/vortex-file-compressed 39981804 ns 40441436 ns 0.99
clickbench_q08/vortex-file-compressed 1003414124 ns 1012574744 ns 0.99
clickbench_q09/vortex-file-compressed 888641992 ns 888584288 ns 1.00
clickbench_q10/vortex-file-compressed 198238344 ns 204592269 ns 0.97
clickbench_q11/vortex-file-compressed 233495971 ns 242613626 ns 0.96
clickbench_q12/vortex-file-compressed 620481147 ns 625205600 ns 0.99
clickbench_q13/vortex-file-compressed 940413702 ns 944066196 ns 1.00
clickbench_q14/vortex-file-compressed 717014392 ns 769055735 ns 0.93
clickbench_q15/vortex-file-compressed 687321343 ns 774154073 ns 0.89
clickbench_q16/vortex-file-compressed 1722807131 ns 1777685376 ns 0.97
clickbench_q17/vortex-file-compressed 1563581611 ns 1659731093 ns 0.94
clickbench_q18/vortex-file-compressed 3742990316 ns 3787893387 ns 0.99
clickbench_q19/vortex-file-compressed 54715363 ns 58742264 ns 0.93
clickbench_q20/vortex-file-compressed 734260411 ns 736430181 ns 1.00
clickbench_q21/vortex-file-compressed 990542899 ns 949161619 ns 1.04
clickbench_q22/vortex-file-compressed 2133912080 ns 2072969170 ns 1.03
clickbench_q23/vortex-file-compressed 5308650941 ns 7422887539 ns 0.72
clickbench_q24/vortex-file-compressed 410986425 ns 441659286 ns 0.93
clickbench_q25/vortex-file-compressed 376578883 ns 403416019 ns 0.93
clickbench_q26/vortex-file-compressed 465108327 ns 503614243 ns 0.92
clickbench_q27/vortex-file-compressed 1407746711 ns 1511954328 ns 0.93
clickbench_q28/vortex-file-compressed 10869976211 ns 10951889874 ns 0.99
clickbench_q29/vortex-file-compressed 684346928 ns 708629796 ns 0.97
clickbench_q30/vortex-file-compressed 637592316 ns 720757653 ns 0.88
clickbench_q31/vortex-file-compressed 618731635 ns 672879429 ns 0.92
clickbench_q32/vortex-file-compressed 3007273479 ns 3503086216 ns 0.86
clickbench_q33/vortex-file-compressed 2530754558 ns 2857655884 ns 0.89
clickbench_q34/vortex-file-compressed 2507506608 ns 2694797514 ns 0.93
clickbench_q35/vortex-file-compressed 1366505865 ns 1497582690 ns 0.91
clickbench_q36/vortex-file-compressed 143150834 ns 157195868 ns 0.91
clickbench_q37/vortex-file-compressed 117908573 ns 100330720 ns 1.18
clickbench_q38/vortex-file-compressed 75392184 ns 84988381 ns 0.89
clickbench_q39/vortex-file-compressed 287655935 ns 304542577 ns 0.94
clickbench_q40/vortex-file-compressed 47463395 ns 48374763 ns 0.98
clickbench_q41/vortex-file-compressed 48163046 ns 46891301 ns 1.03
clickbench_q42/vortex-file-compressed 59803381 ns 61266051 ns 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DataFusion

Benchmark suite Current: 9a6ff5e Previous: 02b1ef3 Ratio
arrow/planning 806386.9362145305 ns (2649.988802132895) 807753.6171700757 ns (2321.681090849801) 1.00
arrow/exec 1751340.60107619 ns (7523.7550101648085) 1770914.918667855 ns (4765.07105967612) 0.99
vortex-pushdown-compressed/planning 502680.16291825025 ns (1453.4953760709905) 505598.4858757505 ns (1570.4703615261242) 0.99
vortex-pushdown-compressed/exec 2552864.2635000004 ns (11918.282731249463) 2644325.3742105262 ns (8153.1445328949485) 0.97
vortex-pushdown-uncompressed/planning 503035.12288459094 ns (3095.1152975642763) 506294.2996798813 ns (1368.387454857584) 0.99
vortex-pushdown-uncompressed/exec 1476850.792994607 ns (4508.585293107084) 1474796.2470069928 ns (5250.916420149384) 1.00
vortex-nopushdown-compressed/planning 834480.7070726671 ns (1536.7913921311265) 838428.9005510217 ns (1628.7008072872413) 1.00
vortex-nopushdown-compressed/exec 2889602.667777779 ns (13257.088104165858) 2965240.2970588244 ns (9522.031963235233) 0.97
vortex-nopushdown-uncompressed/planning 821377.3522166976 ns (1435.464291393233) 820794.5440648448 ns (1418.3034875129815) 1.00
vortex-nopushdown-uncompressed/exec 5008985.444 ns (56363.35741250124) 4923867.33909091 ns (10263.245534091257) 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Random Access

Benchmark suite Current: 9a6ff5e Previous: 02b1ef3 Ratio
random-access/vortex-tokio-local-disk 3096320.528125 ns (20595.56454687519) 3295755.0125 ns (60471.55213281233) 0.94
random-access/vortex-local-fs 3253421.005 ns (16166.876398437424) 3383330.936 ns (30737.562174999155) 0.96
random-access/parquet-tokio-local-disk 221854095.23333335 ns (3988667.735416651) 228113200.6 ns (6463062.738749981) 0.97

This comment was automatically generated by workflow using github-action-benchmark.

@@ -11,7 +12,7 @@ use crate::nullability::Nullability;
use crate::{ExtDType, PType};

/// A name for a field in a struct
pub type FieldName = Arc<str>;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So Arc<str> has 24 bytes overhead (usize ptr, usize len, usize refcount), if I'm following inline-array docs then InlineStr should have what, 2 bytes of overhead in the worst cast?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it can be worse if we clone a ton, but realistically yes.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Vortex Compression

Benchmark suite Current: 9a6ff5e Previous: 02b1ef3 Ratio
compress time/taxi 1358777528.5 ns (3604109.5749999285) 1346589276.8 ns (3921709.028749943) 1.01
compress time/taxi throughput 470810830 bytes 470810830 bytes 1
parquet_rs-zstd compress time/taxi 1716932795.3 ns (3677114.412500024) 1712115522.8 ns (3224463.587499976) 1.00
parquet_rs-zstd compress time/taxi throughput 470810830 bytes 470810830 bytes 1
decompress time/taxi 286594311.6 ns (947086.109375) 296131367.05 ns (832389.6731250286) 0.97
decompress time/taxi throughput 470810830 bytes 470810830 bytes 1
parquet_rs-zstd decompress time/taxi 305581847.2 ns (1356409.493750006) 305846083.9 ns (1175133.800000012) 1.00
parquet_rs-zstd decompress time/taxi throughput 470810830 bytes 470810830 bytes 1
vortex:parquet-zstd size/taxi 0.9305129071577055 ratio 0.930586101237634 ratio 1.00
vortex:raw size/taxi 0.1106012280983426 ratio 0.11060992798317745 ratio 1.00
vortex size/taxi 52072256 bytes 52076352 bytes 1.00
compress time/AirlineSentiment 698680.4239779473 ns (2312.893791348615) 700702.6985198414 ns (2969.411373416544) 1.00
compress time/AirlineSentiment throughput 2066 bytes 2066 bytes 1
parquet_rs-zstd compress time/AirlineSentiment 54772.695893779164 ns (173.25352973436384) 55623.94688577799 ns (158.10742092335204) 0.98
parquet_rs-zstd compress time/AirlineSentiment throughput 2066 bytes 2066 bytes 1
decompress time/AirlineSentiment 103342.80904296381 ns (893.6832112123593) 99020.93606454224 ns (603.4261056031173) 1.04
decompress time/AirlineSentiment throughput 2066 bytes 2066 bytes 1
parquet_rs-zstd decompress time/AirlineSentiment 32619.400059267056 ns (63.192389574993285) 32128.423212610167 ns (63.701299800397464) 1.02
parquet_rs-zstd decompress time/AirlineSentiment throughput 2066 bytes 2066 bytes 1
vortex:parquet-zstd size/AirlineSentiment 8.781799379524301 ratio 8.781799379524301 ratio 1
vortex:raw size/AirlineSentiment 4.110358180058083 ratio 4.110358180058083 ratio 1
vortex size/AirlineSentiment 8492 bytes 8492 bytes 1
compress time/Arade 2751910894.5 ns (18716303.640000105) 2675658467 ns (4016601.4499998093) 1.03
compress time/Arade throughput 787035849 bytes 787035849 bytes 1
parquet_rs-zstd compress time/Arade 3028151916.4 ns (16414529.25) 2943580813.7 ns (7678433.099999905) 1.03
parquet_rs-zstd compress time/Arade throughput 787035849 bytes 787035849 bytes 1
decompress time/Arade 483030910.6 ns (2167614.262500018) 443844244.1 ns (1930540.957499981) 1.09
decompress time/Arade throughput 787035849 bytes 787035849 bytes 1
parquet_rs-zstd decompress time/Arade 671014403.9 ns (2082380.949999988) 665228917.1 ns (1990907.1499999762) 1.01
parquet_rs-zstd decompress time/Arade throughput 787035849 bytes 787035849 bytes 1
vortex:parquet-zstd size/Arade 0.46656400075200116 ratio 0.46656400075200116 ratio 1
vortex:raw size/Arade 0.1810406072112733 ratio 0.1810406072112733 ratio 1
vortex size/Arade 142485448 bytes 142485448 bytes 1
compress time/Bimbo 10484014881 ns (26570924.89999962) 10264556788.2 ns (8575902.194999695) 1.02
compress time/Bimbo throughput 7121348333 bytes 7121348333 bytes 1
parquet_rs-zstd compress time/Bimbo 19857302123.7 ns (69247763.35874939) 19461744189.5 ns (25193752.407499313) 1.02
parquet_rs-zstd compress time/Bimbo throughput 7121348333 bytes 7121348333 bytes 1
decompress time/Bimbo 3116018160.8 ns (6730135.150000095) 3183511274.1 ns (9517614.343750238) 0.98
decompress time/Bimbo throughput 7121348333 bytes 7121348333 bytes 1
parquet_rs-zstd decompress time/Bimbo 2682116123.9 ns (5547753.497499943) 2638252083.7 ns (3572732.9000000954) 1.02
parquet_rs-zstd decompress time/Bimbo throughput 7121348333 bytes 7121348333 bytes 1
vortex:parquet-zstd size/Bimbo 1.3678894786737232 ratio 1.3678894786737232 ratio 1
vortex:raw size/Bimbo 0.07455717698004087 ratio 0.07455717698004087 ratio 1
vortex size/Bimbo 530947628 bytes 530947628 bytes 1
compress time/CMSprovider 13428426085.6 ns (79111370.05624962) 12872215534.1 ns (10301247.94999981) 1.04
compress time/CMSprovider throughput 5149200493 bytes 5149200493 bytes 1
parquet_rs-zstd compress time/CMSprovider 18900511238.9 ns (104388232.25124931) 18435368042.3 ns (29715864.75) 1.03
parquet_rs-zstd compress time/CMSprovider throughput 5149200493 bytes 5149200493 bytes 1
decompress time/CMSprovider 2857333374.7 ns (379417452.70124984) 2807554287.3 ns (393469393.11249995) 1.02
decompress time/CMSprovider throughput 5149200493 bytes 5149200493 bytes 1
parquet_rs-zstd decompress time/CMSprovider 5715164563.4 ns (123646154.43624973) 5687269543 ns (14163681.722499847) 1.00
parquet_rs-zstd decompress time/CMSprovider throughput 5149200493 bytes 5149200493 bytes 1
vortex:parquet-zstd size/CMSprovider 1.2324657951634856 ratio 1.232478603240525 ratio 1.00
vortex:raw size/CMSprovider 0.18418074131882517 ratio 0.18418654571506893 ratio 1.00
vortex size/CMSprovider 948383564 bytes 948413452 bytes 1.00
compress time/Euro2016 2188949474.5 ns (5670815.466249943) 2150119859.8 ns (5129440.673750043) 1.02
compress time/Euro2016 throughput 393256178 bytes 393256178 bytes 1
parquet_rs-zstd compress time/Euro2016 1555824623.7 ns (3235465.5) 1529886973.6 ns (5704588.102500081) 1.02
parquet_rs-zstd compress time/Euro2016 throughput 393256178 bytes 393256178 bytes 1
decompress time/Euro2016 917525236.4 ns (3092174.2362499833) 938076473.2 ns (1804227.7975000143) 0.98
decompress time/Euro2016 throughput 393256178 bytes 393256178 bytes 1
parquet_rs-zstd decompress time/Euro2016 497750522.3 ns (6779761.123750001) 484029012.4 ns (2956069.7787500024) 1.03
parquet_rs-zstd decompress time/Euro2016 throughput 393256178 bytes 393256178 bytes 1
vortex:parquet-zstd size/Euro2016 1.4149303556448625 ratio 1.4149303556448625 ratio 1
vortex:raw size/Euro2016 0.4277642142979887 ratio 0.4277642142979887 ratio 1
vortex size/Euro2016 168220920 bytes 168220920 bytes 1
compress time/Food 1083554975.6 ns (7960948.282499909) 1059180032.7 ns (6199426.655000031) 1.02
compress time/Food throughput 332721678 bytes 332721678 bytes 1
parquet_rs-zstd compress time/Food 1060244717.5 ns (7698479.786249995) 1039826538.4 ns (1563995.4500000477) 1.02
parquet_rs-zstd compress time/Food throughput 332721678 bytes 332721678 bytes 1
decompress time/Food 107891198.23849206 ns (1729737.4426587373) 105630603.68253967 ns (508835.1717361212) 1.02
decompress time/Food throughput 332721678 bytes 332721678 bytes 1
parquet_rs-zstd decompress time/Food 224621281.95 ns (1902064.1256249994) 217861537.55 ns (390346.77562500536) 1.03
parquet_rs-zstd decompress time/Food throughput 332721678 bytes 332721678 bytes 1
vortex:parquet-zstd size/Food 1.2095356410719478 ratio 1.2095356410719478 ratio 1
vortex:raw size/Food 0.1317061523114824 ratio 0.1317061523114824 ratio 1
vortex size/Food 43821492 bytes 43821492 bytes 1
compress time/HashTags 2659690831.3 ns (35870252.97999978) 2596000493.2 ns (3927024.3199999332) 1.02
compress time/HashTags throughput 804503131 bytes 804503131 bytes 1
parquet_rs-zstd compress time/HashTags 2484856001.6 ns (8769177.177500248) 2433467760 ns (5464119.912499905) 1.02
parquet_rs-zstd compress time/HashTags throughput 804503131 bytes 804503131 bytes 1
decompress time/HashTags 458230733 ns (5302811.496250004) 437121820.7 ns (1655481.849999994) 1.05
decompress time/HashTags throughput 804503131 bytes 804503131 bytes 1
parquet_rs-zstd decompress time/HashTags 829387203.9 ns (14286314.655000031) 782242735.7 ns (4030335.7075000405) 1.06
parquet_rs-zstd decompress time/HashTags throughput 804503131 bytes 804503131 bytes 1
vortex:parquet-zstd size/HashTags 1.6274110816204332 ratio 1.6274053488010771 ratio 1.00
vortex:raw size/HashTags 0.2709957582501938 ratio 0.270994803623704 ratio 1.00
vortex size/HashTags 218016936 bytes 218016168 bytes 1.00
compress time/TPC-H l_comment chunked without fsst 3604831944.6 ns (20718703.721250057) 3370057593.5 ns (18608421.30000019) 1.07
compress time/TPC-H l_comment chunked without fsst throughput 249225147 bytes 249225147 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst 919778047.6 ns (3666974.800000012) 899911701.9 ns (1917007.4749999642) 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst throughput 249225147 bytes 249225147 bytes 1
decompress time/TPC-H l_comment chunked without fsst 84685680.3 ns (15526309.57999999) 119403535.8 ns (374641.25) 0.71
decompress time/TPC-H l_comment chunked without fsst throughput 249225147 bytes 249225147 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst 251563619.3 ns (1094630.4493750036) 249179574.35 ns (838305.421875) 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst throughput 249225147 bytes 249225147 bytes 1
vortex:parquet-zstd size/TPC-H l_comment chunked without fsst 4.607549110585218 ratio 4.607767562653133 ratio 1.00
vortex:raw size/TPC-H l_comment chunked without fsst 1.052587073005117 ratio 1.0526027375560139 ratio 1.00
vortex size/TPC-H l_comment chunked without fsst 262331168 bytes 262335072 bytes 1.00
compress time/TPC-H l_comment chunked 1025440485.3 ns (6780211.547500014) 1012980553.1 ns (1856892.8899999857) 1.01
compress time/TPC-H l_comment chunked throughput 249225147 bytes 249225147 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment chunked 920667672.6 ns (3942724.1487499475) 901874400.7 ns (1603318.7962499857) 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput 249225147 bytes 249225147 bytes 1
decompress time/TPC-H l_comment chunked 91209821.66833332 ns (1461787.4739999995) 87765741.38222224 ns (586583.1415347233) 1.04
decompress time/TPC-H l_comment chunked throughput 249225147 bytes 249225147 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment chunked 250228589.75 ns (1184966.650000006) 249940103.5 ns (689702.9250000119) 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput 249225147 bytes 249225147 bytes 1
vortex:parquet-zstd size/TPC-H l_comment chunked 1.1605589088680972 ratio 1.1605640614849402 ratio 1.00
vortex:raw size/TPC-H l_comment chunked 0.26512778824843064 ratio 0.2651203411668567 ratio 1.00
vortex size/TPC-H l_comment chunked 66076512 bytes 66074656 bytes 1.00
compress time/TPC-H l_comment canonical 1029131799.9 ns (13269743.742500007) 1011100704.95 ns (1028072.6750000119) 1.02
compress time/TPC-H l_comment canonical throughput 249224435 bytes 249224435 bytes 1
parquet_rs-zstd compress time/TPC-H l_comment canonical 920689053.9 ns (2468176.3037499785) 902833119.6 ns (1829513.4781249762) 1.02
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput 249224435 bytes 249224435 bytes 1
decompress time/TPC-H l_comment canonical 89547401.89329366 ns (199652.69251090288) 86942200.58884922 ns (332174.0072212219) 1.03
decompress time/TPC-H l_comment canonical throughput 249224435 bytes 249224435 bytes 1
parquet_rs-zstd decompress time/TPC-H l_comment canonical 252162612.0315873 ns (945590.0824821442) 249093482.23873013 ns (679241.5505059361) 1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput 249224435 bytes 249224435 bytes 1
vortex:parquet-zstd size/TPC-H l_comment canonical 1.1605967018484673 ratio 1.1605941500129542 ratio 1.00
vortex:raw size/TPC-H l_comment canonical 0.26512854568212785 ratio 0.26512109857927857 ratio 1.00
vortex size/TPC-H l_comment canonical 66076512 bytes 66074656 bytes 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@AdamGS
Copy link
Contributor Author

AdamGS commented Dec 11, 2024

perf looks good, just need to get komora-io/inline-array#4 merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants