Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
veganism.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Veganism Social is a welcoming space on the internet for vegans to connect and engage with the broader decentralized social media community.

Administered by:

Server stats:

294
active users

veganism.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.4.0-alpha.5

#lmdb

5 posts4 participants0 posts today
Howard Chu @ Symas<p>"Crash when attempting to create a database with an invalid name with <a href="https://mastodon.social/tags/lmdb" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>lmdb</span></a>" </p><p><a href="https://github.com/oven-sh/bun/issues/21682" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/oven-sh/bun/issues/</span><span class="invisible">21682</span></a></p><p>The crash isn't in LMDB, so whatever. But IMO it's perfectly ok to allow misconfigurations like this to crash your program on startup, as opposed to explicitly checking for the error. Either way, your program can't run without manual intervention to fix the invalid config.</p>
fresco<p>A high-performance Erlang NIF (Native Implemented Function) for LMDB (Lightning Memory-Mapped Database) written in Rust.<br><a href="https://github.com/twilson63/elmdb-rs" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">github.com/twilson63/elmdb-rs</span><span class="invisible"></span></a><br><a href="https://mastodon.social/tags/Erlang" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Erlang</span></a> <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a></p>
Howard Chu @ Symas<p>Contrastive Learning‐Based Fine‐Tuning Method for Cross‐Modal Text‐Image Retrieval - using <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> <a href="https://www.researchgate.net/publication/394301683_Contrastive_Learning-Based_Fine-Tuning_Method_for_Cross-Modal_Text-Image_Retrieval" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">researchgate.net/publication/3</span><span class="invisible">94301683_Contrastive_Learning-Based_Fine-Tuning_Method_for_Cross-Modal_Text-Image_Retrieval</span></a></p>
Howard Chu @ Symas<p>Building a music-aware metronome on top of <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> <a href="https://wellquite.org/posts/rallentando/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">wellquite.org/posts/rallentand</span><span class="invisible">o/</span></a></p><p>He wanted a metronome that can change its tempo automatically over the course of a piece of music. Personally, I did this using Cubase on my Atari ST back in 1993 or so. Enter a score, add tempo notations, play it all thru headphones, no biggie.</p>
Howard Chu @ Symas<p>ANOC: Automated NoSQL database carver</p><p><a href="https://www.sciencedirect.com/science/article/pii/S266628172500068X" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">sciencedirect.com/science/arti</span><span class="invisible">cle/pii/S266628172500068X</span></a></p><p>Retrieving the contents of a DB by reverse engineering its data format. Tested against BDB and <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a>, among others. Intended to be a universal tool that can automatically discover the format of any DB engine, for digital forensics.</p><p>Their description of LMDB's page structure is incorrect. Perhaps they're not accounting for the difference between branch pages and leaf pages.</p>
Howard Chu @ Symas<p>Managing Data for Scalable and Interactive Event Sequence Visualization <a href="https://arxiv.org/html/2508.03974v1" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">arxiv.org/html/2508.03974v1</span><span class="invisible"></span></a></p><p>"The naive solution requires 499 milliseconds (ms) for the data fetch, which is outside best practices for interactivity. Our ESeMan solution [built on <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a>] retrieves data for an equivalent chart in one tenth the time."</p><p>Human-Computer-Interaction studies over many years have pegged 100ms as the max latency for interactive systems. Slower than that is perceived as lag. LMDB eliminates lag...</p>
Howard Chu @ Symas<p>Convert any Wikipedia page into a knowledge graph, using <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> </p><p><a href="https://xcancel.com/wjb_mattingly/status/1952492251634151714" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">xcancel.com/wjb_mattingly/stat</span><span class="invisible">us/1952492251634151714</span></a></p><p>"To make this solution scale, we rebuilt Wikipedia and Wikidata both locally with LMDB. We can create non-relationship specific graphs within about 1/100th of a second."</p><p>No other data storage software can accomplish that.</p>
Gabriele Svelto<p><span class="h-card" translate="no"><a href="https://mastodon.social/@hyc" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>hyc</span></a></span> <a href="https://mas.to/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> is great and I wish we could use it more</p>
Howard Chu @ Symas<p>A new engineer discovers how Cloudflare used <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> for their distributed config <a href="https://xcancel.com/UltraSive/status/1948967694004326605#m" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">xcancel.com/UltraSive/status/1</span><span class="invisible">948967694004326605#m</span></a></p><p>"99th %ile of reads dropped by two orders of magnitude!"</p><p>"LMDB stability has been exceptional. It has been running in production for over three years. We have experienced only a single bug and zero data corruption. Considering we serve over 2.5 trillion read requests and 30 million write requests a day on over 90,000 database instances across thousands of servers, this is very impressive."</p>
Howard Chu @ Symas<p>I've dedicated most of my career to writing the most efficient code.</p><p><a href="https://ngmx.com/@mejofi/114889780968597360" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ngmx.com/@mejofi/1148897809685</span><span class="invisible">97360</span></a></p><p>But the mention of storing way more data than you're ever going to use also triggered me here.</p><p>It's a common symptom of poorly designed apps looking for write-optimized databases like RocksDB. If your workload is more write heavy than read, then by definition you're writing more than you'll use.</p><p>It's another reason why <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> is read optimized, because we only care about data we'll actually use.</p>
Howard Chu @ Symas<p>lmdb-queue</p><p>A lightning fast disk based queue, meta data is stored in <a href="https://mastodon.social/tags/lmdb" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>lmdb</span></a> </p><p><a href="https://lib.rs/crates/lmdb-queue" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">lib.rs/crates/lmdb-queue</span><span class="invisible"></span></a></p>
Howard Chu @ Symas<p>"This article introduces <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> (an efficient key-value storage database) and the command line tool `lmcmd` developed based on Python. Since LMDB uses binary files for storage, which is inconvenient to manage and debug, `lmcmd` was developed to provide a command line operation interface similar to Redis, supporting database operations, data import and export, and search functions." <a href="https://developer.aliyun.com/article/1672386" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">developer.aliyun.com/article/1</span><span class="invisible">672386</span></a></p>
Howard Chu @ Symas<p>"If I abandon Vercel and switch to VPS, I can abandon Firestore and build my own query layer with <a href="https://mastodon.social/tags/lmdb" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>lmdb</span></a> ...<br> just thinking about it makes me happy"</p><p><a href="https://xcancel.com/apolkingg8/status/1943623985666679152#m" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">xcancel.com/apolkingg8/status/</span><span class="invisible">1943623985666679152#m</span></a></p>
Howard Chu @ Symas<p>"xs-lib is a command-line tool (xs) and a Rust library (xs_lib) for recording and retrieving sequential streams of payloads. It uses Lightning Memory-Mapped Database (<a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a>) for local data storage."</p><p><a href="https://lib.rs/crates/xs-lib" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">lib.rs/crates/xs-lib</span><span class="invisible"></span></a></p><p>I don't understand why you'd need to store a sequentially accessed stream into a database. This looks like an over-engineered `cat` to me.</p>
Howard Chu @ Symas<p>If you can't beat 'em, join 'em. Oracle now uses <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> <a href="https://docs.oracle.com/en/middleware/fusion-middleware/fmwlc/licensing-information.pdf" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">docs.oracle.com/en/middleware/</span><span class="invisible">fusion-middleware/fmwlc/licensing-information.pdf</span></a></p>
Howard Chu @ Symas<p>"I’m experiencing significant slow-downs when converting data from <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> to HDF5 format."</p><p>Solution: don't do that. <a href="https://mastodon.social/tags/HDF5" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>HDF5</span></a> is a pig.</p><p><a href="https://stackoverflow.com/questions/79706522/hdf5-write-performance-degrades-over-time-when-converting-from-lmdb-3-7m-entri" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">stackoverflow.com/questions/79</span><span class="invisible">706522/hdf5-write-performance-degrades-over-time-when-converting-from-lmdb-3-7m-entri</span></a></p>
Howard Chu @ Symas<p>ARTIQ (Advanced Real-Time Infrastructure for Quantum physics) is a leading-edge control and data acquisition system for quantum information experiments. It is maintained and developed by M-Labs and the initial development was for and in partnership with the Ion Storage Group at NIST.<br>...<br>Persistent datasets are now stored in a <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> database for improved performance. </p><p><a href="https://m-labs.hk/artiq/manual-beta.pdf" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">m-labs.hk/artiq/manual-beta.pdf</span><span class="invisible"></span></a></p>
Howard Chu @ Symas<p>Squawk - a compact <a href="https://mastodon.social/tags/XMPP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>XMPP</span></a> desktop messenger</p><p><a href="https://git.macaw.me/vae/squawk" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">git.macaw.me/vae/squawk</span><span class="invisible"></span></a></p><p>Uses <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a></p>
Howard Chu @ Symas<p><a href="https://mastodon.social/tags/Flutter" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Flutter</span></a> Local DB</p><p>A high-performance local database for Flutter that leverages Rust's <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> embedded database through FFI (Foreign Function Interface). This library provides a robust, efficient, and safe way to store local data in your Flutter applications across multiple platforms.<br><a href="https://pub.dev/packages/flutter_local_db" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">pub.dev/packages/flutter_local</span><span class="invisible">_db</span></a></p>
Howard Chu @ Symas<p>OSM Express: fast data format for OpenStreetMap data, built on <a href="https://mastodon.social/tags/LMDB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LMDB</span></a> <br><a href="https://github.com/bdon/OSMExpress" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">github.com/bdon/OSMExpress</span><span class="invisible"></span></a></p>
VegansExploreLive feeds
About