New DFloat11 Technique Offers 30% Lossless Compression for LLMs, Easing Hardware Demands
#AI #AIResearch #DFloat11 #LLMs #LLMcompression #MachineLearning #DeepLearning #BF16 #Inference #RiceUniversity #xMADai
New DFloat11 Technique Offers 30% Lossless Compression for LLMs, Easing Hardware Demands
#AI #AIResearch #DFloat11 #LLMs #LLMcompression #MachineLearning #DeepLearning #BF16 #Inference #RiceUniversity #xMADai
Local LLM inference: where #ambition meets #reality in a glorious code spaghetti that no sane developer wants to untangle.
It's like building a rocket
only to realize you forgot the launchpad—works great in theory but crashes spectacularly in the real world.
https://medium.com/@aazo11/local-llm-inference-897a06cc17a2 #LocalLLM #Inference #CodeSpaghetti #TechHumor #SoftwareDevelopment #HackerNews #ngated
Local LLM inference – impressive but too hard to work with
Day 19 cont ️
“The #LiberalParty has accidentally left part of its email provider’s #subscriber details exposed, revealing the types of #data harvested by the party during the #election campaign.
This gives rare #insight into some of the specific kinds of data the party is keeping on voters, including whether they are “predicted Chinese”, “predicted Jewish”, a “strong Liberal” and other #PersonalInformation.”
#AusPol / #DataScience / #inference / #voters / #Liberal / #LNP / #Nationals <https://www.crikey.com.au/2025/04/17/victorian-liberals-data-exposed-email-mailchimp-federal-election-crikey/>
The Path to Open-Sourcing the DeepSeek Inference Engine
https://github.com/deepseek-ai/open-infra-index/tree/main/OpenSourcing_DeepSeek_Inference_Engine
How is #censorship implemented in #deepseek? A link to #wikipedia referring to the #tienanmen square can spark an #ethical judgment on the #chinese government. Of course it dare not speak its name
Since censorship is active also on locally run model, probably it is implemented toward the last steps of #inference, while the training set was hastily used and not “curated” for censorship. #AI #LLM
"In real life, we weigh the anticipated consequences of the decisions that we are about to make. That approach is much more rational than limiting the percentage of making the error of one kind in an artificial (null hypothesis) setting or using a measure of evidence for each model as the weight."
Longford (2005) http://www.stat.columbia.edu/~gelman/stuff_for_blog/longford.pdf
#Heuristique : Partie de la science qui étudie les procédures de découverte des faits et théories / Méthode de résolution de problèmes non fondée sur un modèle formel et qui n'aboutit pas nécessairement à une solution mais qui reste viable pour la prise de décision.
#Inférence : Opération de raisonnement admettant une proposition si elle est liée à d'autres propositions précédemment admises, comme dans la déduction.
#truisme : vérité évidente.
"Cette capacité qu'a le #cerveau d'établir des modèles mentaux et de les affiner en présence d'évènements petit à petit lui confère un #pouvoir d'anticipation essentiel appelé #inférence ."
https://mastodon.social/@cobrate/113545463857222347
"Nos actions de tous les jours sont pour la plupart des #heuristiques. Mais la #pensée aussi a les siennes [...]."
https://www.europesays.com/1650391/ Tech Leaders Searching for Energy Alternatives, As AI Power Use Grows #AiDevelopment #BigTechCompany #CameronPorter #electricity #Energy #EnergyAlternatives #goal #google #inference #Meta #NUCLEARENERGY #power #PreviousAiModel #stake #TechLeader #training
The Case For Remote Sensing Of Individual Plants
--
https://doi.org/10.1002/ajb2.1347 <-- shared short article
--
#GIS #spatial #mapping #UAV #drone #drones #LiDAR #photosynthesis #imagingspectroscopy #trees #plants #vegetation #forest #monitoring #identification #satellite #cubesat #landsurface #landcover #spatialanalysis # interpretation #biology #scale #sensor #technology #fieldwork #fieldplatforms #spatiotemporal #resources #naturalresources #phenology #photogrammetry #plantbiology #model #modeling #inference #remotesensing
Time for our #introduction !
We are a group of researchers in #archaeology at #CambridgeUniversity (something called #CDAL ). We are challenging scientists from every fields & every level to infer what happened in an artificial world where a group of #Farmers replaced a group of #HunterGatherers . Its a game, open to anyone, using any #inference method as long as we can re-run the analysis ourself ( #OpenSource tools only, we won't pay a matlab licence to re-run your code )