Faster read queries and nice looking data
Great write up. I like to think of the predicate push down in 3 layers:
1. Explicit partition filtering
2. File pruning
3. Row group pruning
The sorting in Ducklake really is powerful at the row groups. And sorting in combination of partitions can really amplify the performance.
Perfect breakdown. The partitioning in DuckLake is very and the latest v1.0 has bucket partitioning which I need to look at.
Great write up. I like to think of the predicate push down in 3 layers:
1. Explicit partition filtering
2. File pruning
3. Row group pruning
The sorting in Ducklake really is powerful at the row groups. And sorting in combination of partitions can really amplify the performance.
Perfect breakdown. The partitioning in DuckLake is very and the latest v1.0 has bucket partitioning which I need to look at.