Viktor Lofgren
d457bb5d44
(index) Fix index actor initialization
2025-09-18 16:06:40 +02:00
Viktor Lofgren
c661ebb619
(refac) Move language-processing into functions
...
It's long surpassed the single-responsibility library it once was, and is as such out of place in its original location, and fits better among the function-type modules.
2025-09-18 10:30:40 +02:00
Viktor Lofgren
53e744398a
Update gitignore to exclude eclipse-generated stuff
2025-09-17 17:14:02 +02:00
Viktor Lofgren
1d71baf3e5
(search) Display search query first in title
2025-09-16 13:16:18 +02:00
Viktor Lofgren
bb5fc0f348
(language) Fix sketchy unicode handling in UnicodeNormalization
2025-09-16 12:15:09 +02:00
Viktor Lofgren
c8f112d040
(lang+search) Clean up LanguageConfiguration initialization and LangCommandD
2025-09-16 11:49:46 +02:00
Viktor Lofgren
ae31bc8498
(lang+search) Clean up LanguageConfiguration initialization and LangCommand
2025-09-16 11:47:15 +02:00
Viktor Lofgren
da5046c3bf
(lang) Remove language redirects for languages that are not configured
...
Passing an invalid &lang= to the query service leads to a harmless but ugly stacktrace. This change prevents such a request from being formed.
2025-09-16 11:05:31 +02:00
Viktor Lofgren
f67257baf2
(lang) Remove lang:... keyword during LangCommand
2025-09-16 11:01:11 +02:00
Viktor Lofgren
924fb05661
(config) Fix language config pickup
2025-09-16 10:43:27 +02:00
Viktor Lofgren
c231a82062
(search) Lang redirection works better if it's hooked in
2025-09-16 10:40:24 +02:00
Viktor Lofgren
2c1082d7f0
(search) Add notice about the current language selection to the UI
2025-09-16 10:32:13 +02:00
Viktor Lofgren
06947bd026
(search) Add redirect based on lang:-keyword in search query
...
The change also suppresses the term in the query parser so that it isn't delegated to the index as a keyword.
2025-09-16 10:00:20 +02:00
Viktor Lofgren
519aebd7c6
(process) Make the use of zookeeper based domain coordination optional
...
The zookeeper based domain coordinator has been a bit unstable and lead to rare deadlocks. As running multiple instances of the crawler is an unusual configuration, the default behavior that makes the most sense is to disable cross-process coordination and use only local coordination.
2025-09-15 19:13:57 +02:00
Viktor Lofgren
42cc27586e
(process) Reduce connection pool stats log spam
2025-09-15 18:51:43 +02:00
Viktor Lofgren
360881fafd
(setup) Pull POS tags from control svc on first boot
...
This commit also removes the old retrieval from setup.sh
2025-09-15 10:05:17 +02:00
Viktor Lofgren
4c6fdf6ebe
(language) Make language configuration configurable
2025-09-15 09:54:57 +02:00
Viktor Lofgren
554de21f68
(converter) Disable language keyword
2025-09-15 09:49:04 +02:00
Viktor Lofgren
00194acbfe
(search) Add language chooser to UI, clean up search service code
2025-09-13 12:40:42 +02:00
Viktor Lofgren
97dabcefaa
(search) Add language chooser to UI, clean up search service code
2025-09-13 12:34:34 +02:00
Viktor Lofgren
cc790644d4
(search) Persist language choice in the search form
2025-09-12 11:14:54 +02:00
Viktor Lofgren
8f893ee6c0
(search) Add basic support for configuring query language to the search service
...
This is not visible in the UI at this stage, only a query param.
2025-09-11 15:55:09 +02:00
Viktor Lofgren
938721b793
(index) Backwards compatible loading of old words file in index loading
2025-09-11 15:42:31 +02:00
Viktor Lofgren
f68bcefc75
(index) Correct index construction to use the correct files for Fwd index
2025-09-09 11:21:48 +02:00
Viktor Lofgren
0cfd759f85
(deps) Upgrade slop to 0.17 for better skip performance and faster index construction times
2025-09-08 18:02:34 +02:00
Viktor Lofgren
b53002200c
(index) SkipListWriter should not be in APPEND mode
2025-09-08 17:55:14 +02:00
Viktor Lofgren
78246b9a63
(index) Fix journal language enumeration
2025-09-08 15:38:26 +02:00
Viktor Lofgren
b552e79927
(language) Make LanguageConfiguration a Singleton to avoid duplicate initializations
2025-09-08 13:24:18 +02:00
Viktor Lofgren
bffc159486
(language) Make unicode normalization configurable
2025-09-08 13:18:58 +02:00
Viktor Lofgren
1432fc87d7
(index) Test languages via integration test
2025-09-06 20:11:41 +02:00
Viktor Lofgren
edd453531e
(index) Partition keyword lexicons by language
2025-09-04 17:24:48 +02:00
Viktor Lofgren
096496ada1
(refac) Fold ft-anchor-keywords into converting-process
2025-09-03 13:04:30 +02:00
Viktor Lofgren
8ca6209260
(refac) Fold ft-anchor-keywords into converting-process
2025-09-03 13:03:38 +02:00
Viktor Lofgren
673c65d3c9
(refac) Fold term-frequency-dict into language-processing
2025-09-03 12:59:10 +02:00
Viktor Lofgren
acb9ec7b15
(refac) Consistently use 'languageIsoCode' for the language field
2025-09-03 12:54:18 +02:00
Viktor Lofgren
47079e05db
(index) Store language information in the index journal
2025-09-03 12:33:24 +02:00
Viktor Lofgren
c93056e77f
(refac) Clean up index code
2025-09-03 09:51:57 +02:00
Viktor Lofgren
6f7530e807
(refac) Clean up index code
2025-09-02 18:53:58 +02:00
Viktor Lofgren
87ce4a1b52
(refac) Clean up index code
2025-09-02 17:52:38 +02:00
Viktor Lofgren
52194cbe7a
(refac) Clean up index code
2025-09-02 17:44:42 +02:00
Viktor Lofgren
fd1ac03c78
(refac) Clean up index code
2025-09-02 17:30:19 +02:00
Viktor Lofgren
5e5b86efb4
(refac) Clean up index code
2025-09-02 17:24:30 +02:00
Viktor Lofgren
f332ec6191
(refac) Clean up index code
2025-09-02 13:13:10 +02:00
Viktor Lofgren
c25c1af437
(refac) Clean up index code
2025-09-02 13:04:05 +02:00
Viktor Lofgren
eb0c911b45
(refac) Clean up index code
2025-09-02 12:50:07 +02:00
Viktor Lofgren
1979870ce4
(refac) Merge index-forward, index-reverse, index/query into index
...
The project has too many submodules, and it's a bit of a headache to navigate.
2025-09-02 12:30:42 +02:00
Viktor Lofgren
0ba2ea38e1
(index) Move reverse index into a distinct package
2025-09-02 11:59:56 +02:00
Viktor Lofgren
d6cfbceeea
(index) Use a configurable hasher in the index
2025-09-01 13:44:28 +02:00
Viktor Lofgren
e369d200cc
(refac) Simplify index data model by merging SearchParameters, SearchTerms and ResultRankingContext into a new object called SearchContext
...
The previous design was difficult to reason about as similar data was stored in several places, and different functions wanted different nearly identical (but not fully identical) context objects.
This is in preparation for making the keyword hash function configurable, as we want focus all the code that hashes keywords into one place.
2025-09-01 13:17:11 +02:00
Viktor Lofgren
946d64c8da
(index) Make hash algorithm selection configurable, writer-side
2025-09-01 12:03:01 +02:00
