You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What happened:
Datafusion uses min and max statistics to perform pruning. For partition columns we set the min and max equal to the partition value. The binary type does not support a natural order so operators such as <= and >= do not work.
What you expected to happen:
When pruning for binary partition we should just be able to use the equality operator = or !=
The text was updated successfully, but these errors were encountered:
Environment
Delta-rs version: main
Binding: rust, datafusion
Bug
What happened:
Datafusion uses min and max statistics to perform pruning. For partition columns we set the min and max equal to the partition value. The binary type does not support a natural order so operators such as
<=
and>=
do not work.What you expected to happen:
When pruning for binary partition we should just be able to use the equality operator
=
or!=
The text was updated successfully, but these errors were encountered: