You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm interested in using Quickwit as an index for an existing system.
One complexity of a system like this is consistency: especially since Quickwit does async commits it's possible that a document is logically present in the system but absent from Quickwit search results.
Would it be have some way for the /search and/or /search/stream APIs to return a notion of which documents were scanned?
That way if I get back matches for documents 1, 2 & 3 and a scan but no matches for document 4 I'm sure I can exclude document 4 from my query. Otherwise I don't know if I got no results for document 4 because it didn't match the query or because it isn't available for search in Quickwit yet.
Obviously it can't just return every document that didn't match, something like two searches is needed.
The most obvious solution I can think of is something like:
Perform the actual search e.g. indexed_table:123 AND message:abc
Do a followup search with only indexed_table:123
Take the difference, anything in search (2) that is not in search (1) is present in Quickwit but didn't match the search term.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'm interested in using Quickwit as an index for an existing system.
One complexity of a system like this is consistency: especially since Quickwit does async commits it's possible that a document is logically present in the system but absent from Quickwit search results.
Would it be have some way for the
/search
and/or/search/stream
APIs to return a notion of which documents were scanned?That way if I get back matches for documents 1, 2 & 3 and a scan but no matches for document 4 I'm sure I can exclude document 4 from my query. Otherwise I don't know if I got no results for document 4 because it didn't match the query or because it isn't available for search in Quickwit yet.
Obviously it can't just return every document that didn't match, something like two searches is needed.
The most obvious solution I can think of is something like:
indexed_table:123 AND message:abc
indexed_table:123
Beta Was this translation helpful? Give feedback.
All reactions