veganism.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Veganism Social is a welcoming space on the internet for vegans to connect and engage with the broader decentralized social media community.

Administered by:

Server stats:

295
active users

#datacompression

0 posts0 participants0 posts today
Francesc Alted<p>Blosc2 is incredibly powerful, but its flexibility comes with a challenge: navigating thousands of possible compression parameter combinations (codecs, levels, filters) to find the best one for your data.</p><p>Stop guessing and start optimizing. Save valuable time and unlock the full potential of your data compression pipeline with Btune 🚀 </p><p>👉 <a href="https://ironarray.io/btune" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">ironarray.io/btune</span><span class="invisible"></span></a></p><p>Compress Better</p><p><a href="https://masto.social/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a> <a href="https://masto.social/tags/BigData" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>BigData</span></a> <a href="https://masto.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataScience</span></a> <a href="https://masto.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AI</span></a> <a href="https://masto.social/tags/Optimization" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Optimization</span></a></p>
Neustradamus :xmpp: :linux:<p><a href="https://mastodon.social/tags/WinRAR" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WinRAR</span></a> 7.12 has been released (<a href="https://mastodon.social/tags/RAR" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RAR</span></a> / <a href="https://mastodon.social/tags/ZIP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZIP</span></a> / <a href="https://mastodon.social/tags/ZIPX" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZIPX</span></a> / <a href="https://mastodon.social/tags/7Zip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7Zip</span></a> / <a href="https://mastodon.social/tags/7z" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7z</span></a> / <a href="https://mastodon.social/tags/GZip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GZip</span></a> / <a href="https://mastodon.social/tags/zstd" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zstd</span></a> / <a href="https://mastodon.social/tags/Zstandard" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Zstandard</span></a> / <a href="https://mastodon.social/tags/FileArchiver" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>FileArchiver</span></a> / <a href="https://mastodon.social/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a> / <a href="https://mastodon.social/tags/DarkMode" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DarkMode</span></a>) <a href="https://rarlab.com/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">rarlab.com/</span><span class="invisible"></span></a></p>
Francesc Alted<p><a href="https://masto.social/tags/Blosc2" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Blosc2</span></a> now runs directly in your browser! Leveraging the power of <a href="https://masto.social/tags/WASM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WASM</span></a>, <a href="https://masto.social/tags/Pyodide" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Pyodide</span></a>, and <a href="https://masto.social/tags/JupyterLite" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>JupyterLite</span></a>, you can harness efficient, adaptable compression through the web's universal interface. Experience the future of large-scale data processing without leaving your browser window.</p><p>Compress Better, Compute Bigger, Share Faster</p><p><a href="https://masto.social/tags/WebAssembly" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebAssembly</span></a> <a href="https://masto.social/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a> <a href="https://masto.social/tags/WebDevelopment" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDevelopment</span></a> <a href="https://masto.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataScience</span></a></p>
Neustradamus :xmpp: :linux:<p><a href="https://mastodon.social/tags/7Zip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7Zip</span></a> 25.00 has been released (<a href="https://mastodon.social/tags/SevenZip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SevenZip</span></a> / <a href="https://mastodon.social/tags/7z" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7z</span></a> / <a href="https://mastodon.social/tags/LZMA" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LZMA</span></a> / <a href="https://mastodon.social/tags/LZMA2" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LZMA2</span></a> / <a href="https://mastodon.social/tags/ZIP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZIP</span></a> / <a href="https://mastodon.social/tags/RAR" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RAR</span></a> / <a href="https://mastodon.social/tags/FileArchiver" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>FileArchiver</span></a> / <a href="https://mastodon.social/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a>) <a href="https://7-zip.org/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">7-zip.org/</span><span class="invisible"></span></a></p>
Neustradamus :xmpp: :linux:<p><a href="https://mastodon.social/tags/PeaZip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PeaZip</span></a> 10.5.0 has been released (<a href="https://mastodon.social/tags/7Z" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7Z</span></a> / <a href="https://mastodon.social/tags/7ZIP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>7ZIP</span></a> / <a href="https://mastodon.social/tags/ARC" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ARC</span></a> / <a href="https://mastodon.social/tags/PEA" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>PEA</span></a> / <a href="https://mastodon.social/tags/RAR" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RAR</span></a> / <a href="https://mastodon.social/tags/TAR" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TAR</span></a> / <a href="https://mastodon.social/tags/ZIP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZIP</span></a> / <a href="https://mastodon.social/tags/ZIPX" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ZIPX</span></a> / <a href="https://mastodon.social/tags/zstd" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zstd</span></a> / <a href="https://mastodon.social/tags/Zstandard" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Zstandard</span></a> / <a href="https://mastodon.social/tags/FileArchiver" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>FileArchiver</span></a> / <a href="https://mastodon.social/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a>) <a href="https://peazip.github.io/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">peazip.github.io/</span><span class="invisible"></span></a></p>
Blosc Development Team<p>🚀 C-Blosc2 2.19.0 is out!<br>We’ve added b2nd_expand_dims(), making it easy to add new dimensions to your b2nd arrays—perfect for evolving your data structures on the fly.<br>Big thanks to @lshaw8317 for the contribution! 🙏 </p><p>Check out the release notes: <a href="https://github.com/Blosc/c-blosc2/blob/main/RELEASE_NOTES.md" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/Blosc/c-blosc2/blob</span><span class="invisible">/main/RELEASE_NOTES.md</span></a></p><p><a href="https://fosstodon.org/tags/C" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>C</span></a>-Blosc2 <a href="https://fosstodon.org/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a> <a href="https://fosstodon.org/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenSource</span></a></p>
deutrino<p>wow, if I'm reading the graphs right, 'zstd' long-range matching mode blows 'lrzip' on default settings out of the water in terms of performance</p><p><a href="https://github.com/facebook/zstd/releases/tag/v1.3.2" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/facebook/zstd/relea</span><span class="invisible">ses/tag/v1.3.2</span></a></p><p>(and that's for the 2017 release, who knows how well it performs nearly 8 years later!)</p><p><a href="https://mstdn.io/tags/DataCompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DataCompression</span></a> <a href="https://mstdn.io/tags/zstd" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zstd</span></a> <a href="https://mstdn.io/tags/lrzip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>lrzip</span></a></p>
Farooq | فاروق<p>So <span class="h-card" translate="no"><a href="https://polymaths.social/@rl_dane" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>rl_dane</span></a></span> introduced <a href="https://cr8r.gg/tags/bzip3" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>bzip3</span></a> to me to use instead of <a href="https://cr8r.gg/tags/bzip2" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>bzip2</span></a>. Let's turn some <code>bz2</code> files into <code>bz3</code> to see the difference.</p><p><strong>First example: 90k opus files</strong></p><p>hey snips wake word dataset. It has ~90k opus files and a tar file of <code>3.1GB</code>. <code>bzip2</code> produces the same <code>3.1GB</code> which is as expected. bzip3 created <code>3.0GB</code> but used tons of computation power. Not worth the <code>100MB</code></p><p><strong>Second example: Windows 7 virtual box VM image</strong></p><p><code>Windows7.vdi</code> it's Windows 7 VM image for the "special" days. I think I have to get rid of it. But while it is still there, let's see how each will perform. It is <code>16GB</code> uncompressed. <code>bzip2 -9</code> is <code>7.0GB</code>. <code>bzip3</code> is <code>6.3GB</code> but at the expense of like 3x CPU time. Deleting all of them anyway. Down with Windows.</p><p><strong>Third example: Pure XML text file</strong></p><p>Pure XML file. It's Persian and English characters. Uncompressed is <code>1.7GB</code>. <code>bzip2 -9</code> is <code>276M</code> while <code>bzip3</code> is <code>260MB</code></p><p><strong>Final example: Creating a simple bomb</strong></p><p>So I did this:</p><pre><code>dd if=/dev/zero of=./justzero bs=2G count=6<br></code></pre><p>So now I have a <code>16GB</code> with only zero bytes. <code>bzip2 -9</code> is <code>672KB</code>. <code>bzip3</code> is <code>46KB</code>. </p><p><strong>Conclusion</strong></p><p>Thank you <span class="h-card" translate="no"><a href="https://polymaths.social/@rl_dane" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>rl_dane</span></a></span> </p><p>Real nice thing!</p><p><a href="https://cr8r.gg/tags/compression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>compression</span></a> <a href="https://cr8r.gg/tags/gzip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gzip</span></a> <a href="https://cr8r.gg/tags/zip" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zip</span></a> <a href="https://cr8r.gg/tags/filecompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>filecompression</span></a> <a href="https://cr8r.gg/tags/textcompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>textcompression</span></a> <a href="https://cr8r.gg/tags/datacompression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datacompression</span></a> <a href="https://cr8r.gg/tags/linux" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>linux</span></a> <a href="https://cr8r.gg/tags/unix" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>unix</span></a> <a href="https://cr8r.gg/tags/tech" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>tech</span></a></p>