Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Full text search todo #4564

Open
3 of 14 tasks
acquamarin opened this issue Nov 24, 2024 · 0 comments
Open
3 of 14 tasks

Feature: Full text search todo #4564

acquamarin opened this issue Nov 24, 2024 · 0 comments
Labels
feature New features or missing components of existing features

Comments

@acquamarin
Copy link
Collaborator

acquamarin commented Nov 24, 2024 •
edited
Loading

API

C++

Description

Usability:

  • Support copy in manual transactions.
  • Support optional parameters in standalone call functions (e.g., stopwords, stem).
  • Support virtual tables.
  • Disallow users from querying virtual tables/properties and helper functions/internal FTS functions.
  • Support multi-statement queries in the testing framework.
  • Support querying a subset of columns in query_fts_index().
  • Output nodes with null scores.
  • Disallow users from dropping a property that has an index on it.

Performance optimization

  • Optimize hash aggregation/distinct performance
  • Optimize the lookup of term keys in queryFTS, we can probably do primary key lookup in such cases.
  • Optimize the storage of stop-words, we may only need to store the stop-words table only once.
  • Remove edgeCompute to compute the scores and do this in a single-threaded manner.
  • Once edgeCompute is removed, pass terms in a sparse map (e.g., ValueVector) instead of using a semi-masker. This avoids redundant construction and looping.
  • Support anti-join
@acquamarin acquamarin added the feature New features or missing components of existing features label Nov 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New features or missing components of existing features
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@acquamarin