-
Notifications
You must be signed in to change notification settings - Fork 128
Bm25search open sourcing and new release #4620
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: latest
Are you sure you want to change the base?
Conversation
|
Allow 10 minutes from last push for the staging site to build. If the link doesn't work, try using incognito mode instead. For internal reviewers, check web-documentation repo actions for staging build status. Link to build for this PR: http://docs-dev.timescale.com/docs-bm25search-open-sourcing |
| This preview release focuses on core BM25 functionality. It has the following limitations: | ||
| * **Memory-only storage**: indexes are limited by `pg_textsearch.index_memory_limit` (default 64MB) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This limit goes away with 0.1.0, or at least, once it's deployed in January
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removed
| This preview release focuses on core BM25 functionality. It has the following limitations: | ||
| * **Memory-only storage**: indexes are limited by `pg_textsearch.index_memory_limit` (default 64MB) | ||
| * **No phrase queries**: cannot search for exact multi-word phrases yet |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No plans right now to add phrase query support, actually.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated
| This page shows you how to install `pg_textsearch`, configure BM25 indexes, and optimize your search capabilities using | ||
| the following best practice: | ||
|
|
||
| * **Memory planning**: size your `index_memory_limit` based on corpus vocabulary and document count |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't be necessary in 0.1.0
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removed
| 1. **Perform ranked searches using the distance operator** | ||
| ```sql | ||
| SELECT name, description, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The code examples should also change, at least for 0.1.0 -- they can now use the text <@> text operator variant, e.g.:
SELECT name, description, description <@> 'ergonomic work' as score
FROM products
ORDER BY score
LIMIT 3There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated the queries
Signed-off-by: Iain Cox <iain@tigerdata.com>
No description provided.