Security News
tea.xyz Spam Plagues npm and RubyGems Package Registries
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
@superhuman/trie-ing
Advanced tools
Readme
The fastest weighted auto-completion trie known to me.
Yet another trie? "Why?" I hear you cry! I know, it's trie-ing...
For Superhuman we're building a product focussed around speed and productivity. To do this we need to run an auto-completer over your contacts, ordered by how recently you contacted them.
Most tries return results in alphabetical order, this trie returns them by descending score.
This trie structure can index my 285kb of contact data in ~11ms, and provide auto-completion results ordered by how recently I've communicated with them in ~0.25ms. This improves over the original linear search (which took ~40ms) and first stab at using a trie (~55ms index, ~20ms search).
First install. In this example I'm using npm, but browserify or copy-paste works just fine.
npm install trie-ing
Then use it
var Trie = require('trie-ing');
var trie = new Trie();
trie.add({
key: "richard",
value: {name: "Richard", ...},
score: 5
});
trie.add({
key: "rachael",
value: {name: "Rachael", ...},
score: 1
});
trie.add({
key: "sarah",
value: {name: "Sarah", ...},
score: 3
});
trie.add({
key: "sam",
value: {name: "Sam", ...},
score: 2
});
// The limit option limits the number of results.
// The unique option returns only the first result for each key
// (the trie can store multiple values per key)
trie.prefixSearch('r', {limit: 3, unique: true})
//=> [{name: "Richard", ...} , {name: "Rachael", ...}]
The problem with building a search tree for contacts is that the order of results is orthogonal from the search.
If I type "R", my dad ("Richard") should be the first auto-completion result, not my friend "Rachael" who I haven't spoken to for a year.
To do this nodes in the trie have their highest score attached:
+ (4) rachael
+ (4) r --+ (1) richard
root ----+
+ (3) s ---+ (3) a ---+ (3) sarah
+ (2) sam
To improve indexing time, sub-nodes are not sorted; so on the first access to each section of the tree you have to pay the cost of sorting the sub-nodes ( this is usually a very small sort, <5 entries, per node in the tree).
There's also a special case for nodes with one child, where we don't expand them out letter by letter. (An exercise for the reader would be to use a fully compressed trie, which would give us this optimization as a side-effect)
The search algorithm maintains a queue of nodes to visit based on score, and is truncated to the limit. The most expensive part of the search is merging the current node's children into the priority queue, and so the efficiency of lookup is dominated by the limit parameter, with some additional cost due to having to traverse many intermediate nodes (see note about implementing a compressed trie).
This code base started out as the trie implementation from https://github.com/marccampbell/node-autocomplete packaged in a way I can use it in the browser, but has been significantly alterred.
See LICENSE for original copyright holder, changes are also released under the MIT license.
FAQs
A fast weighted autocompleter
The npm package @superhuman/trie-ing receives a total of 52 weekly downloads. As such, @superhuman/trie-ing popularity was classified as not popular.
We found that @superhuman/trie-ing demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 9 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
Security News
As cyber threats become more autonomous, AI-powered defenses are crucial for businesses to stay ahead of attackers who can exploit software vulnerabilities at scale.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.