Terms
Description
Refactor the current autosuggestion and autocompletion system to replace the existing database based approach with a hybrid Trie + LLM architecture similar to the AOSP keyboard. The Trie will handle efficient prefix-based candidate generation, while the LLM layer will provide contextual reranking and next-word prediction to improve relevance and accuracy. This change aims to enhance suggestion quality, contextual awareness, and scalability while maintaining low-latency performance suitable for mobile environments.
Contribution
I would be working on this. Happy to hear suggestions and improvements to the current plan :)
Terms
Description
Refactor the current autosuggestion and autocompletion system to replace the existing database based approach with a hybrid Trie + LLM architecture similar to the AOSP keyboard. The Trie will handle efficient prefix-based candidate generation, while the LLM layer will provide contextual reranking and next-word prediction to improve relevance and accuracy. This change aims to enhance suggestion quality, contextual awareness, and scalability while maintaining low-latency performance suitable for mobile environments.
Contribution
I would be working on this. Happy to hear suggestions and improvements to the current plan :)