You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We use the tool to browse our Parquet data lake, consisting of different folders and date partitions containing multiple Parquet files.
It would be extremely powerful to be able to load a directory of files - and display multiple files at once in the viewer. The functionality is almost there as we can currently refer to a directory and browse it, displaying data file-by-file. However, the missing piece I'm looking for is to be able to e.g. select an entire folder and then view the combined Parquet contents.
Maybe there would need to be some restrictions i.e. it may only work if the underlying Parquet files are using an identical Schema - but perhaps there is a way to ensure this or to check for it, then only display the data if the Schema is identical etc.
The text was updated successfully, but these errors were encountered:
Thanks for making Tad, it's awesome.
We use the tool to browse our Parquet data lake, consisting of different folders and date partitions containing multiple Parquet files.
It would be extremely powerful to be able to load a directory of files - and display multiple files at once in the viewer. The functionality is almost there as we can currently refer to a directory and browse it, displaying data file-by-file. However, the missing piece I'm looking for is to be able to e.g. select an entire folder and then view the combined Parquet contents.
Maybe there would need to be some restrictions i.e. it may only work if the underlying Parquet files are using an identical Schema - but perhaps there is a way to ensure this or to check for it, then only display the data if the Schema is identical etc.
The text was updated successfully, but these errors were encountered: