You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When we do head(), we should check the number of rows in the table before performing take, and just use the lower value. That way we avoid this unnecessary warning.
[2024-11-04T21:03:31Z WARN lance::io::exec::scan] Ran out of fragments before we were done scanning for range: 0..10
pyarrow.Table
x: int64
----
x: [[1,2,3]]
Same with head:
ds.head(10)
[2024-11-04T21:03:42Z WARN lance::io::exec::scan] Ran out of fragments before we were done scanning for range: 0..10
pyarrow.Table
x: int64
----
x: [[1,2,3]]
The text was updated successfully, but these errors were encountered:
When we do
head()
, we should check the number of rows in the table before performing take, and just use the lower value. That way we avoid this unnecessary warning.https://github.com/lancedb/lance/blob/ceaf49c9d24eab6cf2dd61712849cb4f3bd14d69/rust/lance/src/dataset/scanner.rs#L1189C43-L1189C44
We actually seem to do this for offset, just not limit.
Same with head:
The text was updated successfully, but these errors were encountered: