Trying to invent a better substring search algorithm

https://marcos.unsafe.rs/trying-to-invent-a-better-substring-search-algorithm/

30 points · 3 comments · view on lemmy.world

3 Comments

burntsushi@programming.dev · 8 pts · 2y (2 replies)

Disclosure: I'm the author of the memchr crate.

You mention the memchr crate, but you don't seem to have benchmarked it. Instead, you benchmarked the needle crate (last updated 7 years ago). Can you explain a bit more about your methodology?

The memchr crate in particular doesn't just use Rabin-Karp. It also uses Two-Way. And SIMD (with support for x86-64, aarch64 and wasm32).

snaggen@programming.dev · 4 pts · 2y (1 reply)

FYI: Not the author, just found it to be an interesting read. Notified the author, so lets hope he joins in for a nice discussion.

burntsushi@programming.dev · 2 pts · 2y

Ah gotya, thanks!