Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Load multiple Parquet files #261

Open
MatinF opened this issue Apr 10, 2024 · 0 comments
Open

Feature request: Load multiple Parquet files #261

MatinF opened this issue Apr 10, 2024 · 0 comments

Comments

@MatinF
Copy link

MatinF commented Apr 10, 2024

Thanks for making Tad, it's awesome.

We use the tool to browse our Parquet data lake, consisting of different folders and date partitions containing multiple Parquet files.

It would be extremely powerful to be able to load a directory of files - and display multiple files at once in the viewer. The functionality is almost there as we can currently refer to a directory and browse it, displaying data file-by-file. However, the missing piece I'm looking for is to be able to e.g. select an entire folder and then view the combined Parquet contents.

Maybe there would need to be some restrictions i.e. it may only work if the underlying Parquet files are using an identical Schema - but perhaps there is a way to ensure this or to check for it, then only display the data if the Schema is identical etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant