Чт 17:46:31 <rkeene> For my project, my DB access was just as fast as someone's Rust implementation, with the DB implemented in C (LMDB)
Чт 17:46:51 <rkeene> So a full table scan took 17s with Tcl and 17s with Rust, when analyzing each table
Чт 17:47:47 <_abc_> What access layer from tcl side? odbc?
Чт 17:47:57 <rkeene> No, just using tcl-lmdb
Чт 17:48:05 <_abc_> Ah so native basically
Чт 17:48:25 <_abc_> I am not famliar with lmdb I assumed it has an odbc if
Чт 17:48:31 <rkeene> It's a key-value store
Чт 17:48:48 <rkeene> But has nested transactions
Чт 17:48:50 <_abc_> Is it better than gdbm for large things?
Чт 17:49:20 <_abc_> memory mapped suggests it is not a good idea to run on slow small cache/ram machines?
Чт 17:49:33 <dbohdan> From what I've seen of it, tcl-lmdb is nice to work with
Чт 17:49:46 <_abc_> But do you need a super duper computer for it?
Чт 17:49:51 <dbohdan> No
Чт 17:50:00 <_abc_> The above indexing numbers from 2008 were on a 32 bit core2 with 1GB ram...
Чт 17:50:03 <dbohdan> rkeene: What search options did you need to implement manually and explode?
Чт 17:50:35 <dbohdan> I made this with tcl-lmdb:
https://wiki.tcl-lang.org/page/Persistent+arrays#546c8ca80a90f646967628e990f9c26407f3d722bc072b2e898a05a2f7532058Чт 17:51:44 <dbohdan> They use LMDB in embedded devices, much like SQLite
Чт 17:52:28 <rkeene> dbohdan, For FTS, I wanted to be able to do a search for substrings
Чт 17:52:44 <rkeene> So if there was FOOBAR in the DB, I wanted to be able to search for BAR and find it
Чт 17:53:34 <_abc_> rkeene: is that not done by searching for substrings in the word db then go on to the url table ? Wait, that was what I had in my 2008 app
Чт 17:53:51 <rkeene> So I had to manaully insert into the FTS DB, FOOBAR, OOBAR, OBAR, BAR
Чт 17:54:00 <_abc_> oh that is bad
Чт 17:54:18 <dbohdan> I see
Чт 17:54:33 <dbohdan> I think FTS5 still only does prefix search
Чт 17:54:46 <rkeene> It works fine the other way, if you search for "FOO" and there's "FOOBAR" it will find it
Чт 17:55:10 <_abc_> So, apart from Chebyshev in the wiki and regression in ::statistics nothing?