Veganism Social

Nicolas MOUARTThis is a Ficaria verna (formerly Ranunculus ficaria L.), or lesser celandine or pilewort (as per Wikipedia and other sites).I have tested gemma 3 4b-it-q4_0 multimodal vision model for a while: it is not accurate, and can't be trusted. For instance, it thinks it is a Ranunculus acris (it isn't). It's really hit and miss with this model. I guess it could still be useful to provide some clues or vocabulary.<a href="https://mastodon.social/tags/taximony" class="mention hashtag" rel="nofollow noopener" target="_blank">#taximony</a> <a href="https://mastodon.social/tags/localLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#localLLM</a> <a href="https://mastodon.social/tags/NLP" class="mention hashtag" rel="nofollow noopener" target="_blank">#NLP</a> <a href="https://mastodon.social/tags/multimodal" class="mention hashtag" rel="nofollow noopener" target="_blank">#multimodal</a> <a href="https://mastodon.social/tags/flower" class="mention hashtag" rel="nofollow noopener" target="_blank">#flower</a> <a href="https://mastodon.social/tags/privacy" class="mention hashtag" rel="nofollow noopener" target="_blank">#privacy</a> <a href="https://mastodon.social/tags/review" class="mention hashtag" rel="nofollow noopener" target="_blank">#review</a> <a href="https://mastodon.social/tags/English" class="mention hashtag" rel="nofollow noopener" target="_blank">#English</a> <a href="https://mastodon.social/tags/photography" class="mention hashtag" rel="nofollow noopener" target="_blank">#photography</a>

Nicolas MOUARTHopefully, people using GPTs will fact check answers, and won't act as mere schochastic parrot repeaters. <a href="https://mastodon.social/tags/humanoversight" class="mention hashtag" rel="nofollow noopener" target="_blank">#humanoversight</a> Q: How do you know that your answer is correct? A: Remember that while my goal is always accuracy and relevance within the constraints of available data up to early-September 2021, human oversight or further research may be necessary for critical applications where absolute certainty matters most.<a href="https://mastodon.social/tags/Microsoft" class="mention hashtag" rel="nofollow noopener" target="_blank">#Microsoft</a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LLM</a> <a href="https://mastodon.social/tags/localLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#localLLM</a> <a href="https://mastodon.social/tags/GPT" class="mention hashtag" rel="nofollow noopener" target="_blank">#GPT</a> <a href="https://mastodon.social/tags/accountability" class="mention hashtag" rel="nofollow noopener" target="_blank">#accountability</a> <a href="https://mastodon.social/tags/promptTips" class="mention hashtag" rel="nofollow noopener" target="_blank">#promptTips</a>

Nicolas MOUARTI wrote my own LLM chatbot experiment to test below Q8 LLMs on a computer without GPU <a href="https://mastodon.social/tags/environment" class="mention hashtag" rel="nofollow noopener" target="_blank">#environment</a> <a href="https://mastodon.social/tags/EveryLittleHelp" class="mention hashtag" rel="nofollow noopener" target="_blank">#EveryLittleHelp</a> <a href="https://mastodon.social/tags/Microsoft" class="mention hashtag" rel="nofollow noopener" target="_blank">#Microsoft</a> Phi 3.5 is the best so far at French, in my humble opinion. They did a really good curating job compared to others. Obviously not for serious business (<a href="https://mastodon.social/tags/hallucination" class="mention hashtag" rel="nofollow noopener" target="_blank">#hallucination</a>), that's for data center LLMs I guess. It is sad to see where the tech industry goes these days. I doubt customer will be king for very long at this pace.<a href="https://mastodon.social/tags/localLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#localLLM</a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LLM</a> <a href="https://mastodon.social/tags/review" class="mention hashtag" rel="nofollow noopener" target="_blank">#review</a> <a href="https://mastodon.social/tags/customerservice" class="mention hashtag" rel="nofollow noopener" target="_blank">#customerservice</a> <a href="https://mastodon.social/tags/IA" class="mention hashtag" rel="nofollow noopener" target="_blank">#IA</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>

Ronnie RochaI got Xcode's native coding assistant working with my local AI models using Ollama. Apple made it surprisingly easy! 👏 I wrote down the simple steps if you want to try it too. 👨‍💻<a href="https://ronnierocha.dev/blog/connecting-xcodes-coding-assistant-to-your-local-ollama-llms/" rel="nofollow noopener" translate="no" target="_blank">https://ronnierocha.dev/blog/connecting-xcodes-coding-assistant-to-your-local-ollama-llms/</a><a href="https://mastodon.social/tags/Xcode" class="mention hashtag" rel="nofollow noopener" target="_blank">#Xcode</a> <a href="https://mastodon.social/tags/Ollama" class="mention hashtag" rel="nofollow noopener" target="_blank">#Ollama</a> <a href="https://mastodon.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a> <a href="https://mastodon.social/tags/iOSDev" class="mention hashtag" rel="nofollow noopener" target="_blank">#iOSDev</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>

5ikaComme l'IA débarque dans nos vies qu'on le veuille ou non, je débute un projet perso qui consiste à mettre en place une "IA" qui tourne sur ma propre machine et consomme le moins de ressources possible (relativement aux IA mainstream). J'ai déjà quelques résultats intéressants pour gérer une todolist et d'autres tâches simples.Je suis certain que d'autres projets existent mais ils sont difficiles à trouver. Si vous avez des liens, je suis preneur 🙂 <a href="https://tooting.ch/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a> <a href="https://tooting.ch/tags/LocalAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalAI</a> <a href="https://tooting.ch/tags/SelfHosting" class="mention hashtag" rel="nofollow noopener" target="_blank">#SelfHosting</a> <a href="https://tooting.ch/tags/Privacy" class="mention hashtag" rel="nofollow noopener" target="_blank">#Privacy</a>

➴➴➴Æ🜔Ɲ.Ƈꭚ⍴𝔥єɼ👩🏻‍💻So, with <a href="https://lgbtqia.space/tags/copilot" class="mention hashtag" rel="nofollow noopener" target="_blank">#copilot</a> <a href="https://lgbtqia.space/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> I can't wait for one easily run off <a href="https://lgbtqia.space/tags/ollama" class="mention hashtag" rel="nofollow noopener" target="_blank">#ollama</a> or other <a href="https://lgbtqia.space/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a>.

Debby<a href="https://fosstodon.org/@system76" class="u-url mention" rel="nofollow noopener" target="_blank">@system76</a> I love <a href="https://hear-me.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LLM</a>, or as they're often called, <a href="https://hear-me.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.However, if I wanted to be fully transparent to <a href="https://hear-me.social/tags/bigtech" class="mention hashtag" rel="nofollow noopener" target="_blank">#bigtech</a>, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻 <a href="https://hear-me.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenSource</a> <a href="https://hear-me.social/tags/Privacy" class="mention hashtag" rel="nofollow noopener" target="_blank">#Privacy</a> <a href="https://hear-me.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://hear-me.social/tags/LocalModels" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalModels</a> <a href="https://hear-me.social/tags/SelfHosted" class="mention hashtag" rel="nofollow noopener" target="_blank">#SelfHosted</a> <a href="https://hear-me.social/tags/LinuxAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#LinuxAI</a> <a href="https://hear-me.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a> <a href="https://hear-me.social/tags/LocalAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalAI</a>

Dr. Fortyseven 🥃 █▓▒░So, I had an idea while messing with <a href="https://defcon.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a> geolocation with <a href="https://defcon.social/tags/Gemma3" class="mention hashtag" rel="nofollow noopener" target="_blank">#Gemma3</a>.I fed it this photo from Wikipedia of Governors Island in NY.Unsurprisingly, it figured it out immediately.> Considering all the evidence, I am confident that the image depicts Governors Island in New York City. The shape of the island, the surrounding skyscrapers, the port facilities, and the presence of the Verrazano-Narrows Bridge all point to this location.Fair enough. That's baby stuff at this point. ;)But then I had an idea: "Assuming this refined guess is correct, where might the photo have been taken FROM?"The ol' geolocate the camera trick. (Usually finding a CCTV or something, in some cases.)> Based on the clarity of the view of Governors Island, the partial obstruction of other buildings, and the overall angle, I believe the photo was most likely taken from One World Trade Center. The height and location provide the perfect vantage point for this shot. > > Specifically, I'd estimate the photo was taken from the *observation deck or a high-floor office within One World Trade Center, likely facing southeast towards Governors Island and the Verrazano-Narrows Bridge*.And uh... well, yeah probably. :DThough I don't expect nearly as much success on other photos. I'll keep trying and see what I get.[cc: <a href="https://fedi.simonwillison.net/@simon" class="u-url mention" rel="nofollow noopener" target="_blank">@simon</a>]<a href="https://defcon.social/tags/llm" class="mention hashtag" rel="nofollow noopener" target="_blank">#llm</a> <a href="https://defcon.social/tags/osint" class="mention hashtag" rel="nofollow noopener" target="_blank">#osint</a>

DebbyBalancing Privacy and Assistive Technology: The Case for Large Language ModelsIn today’s digital world, the tension between privacy and technology is more pronounced than ever. I’m deeply concerned about the implications of surveillance capitalism—especially the spyware embedded in our devices, cars, and even our bodies. This pervasive technology can lead to a loss of autonomy and a feeling of being constantly monitored. Yet, amidst these concerns, assistive technology plays a critical role, particularly for those of us with neurological impairments.I recently read a thought-provoking post by <a href="https://babka.social/@serge" class="u-url mention" rel="nofollow noopener" target="_blank">@serge</a> that highlighted the importance of sharing perspectives on this issue. <iframe src="<a href="https://babka.social/@serge/113754269997543779/embed" rel="nofollow noopener" translate="no" target="_blank">https://babka.social/@serge/113754269997543779/embed</a>" width="400" allowfullscreen="allowfullscreen" sandbox="allow-scripts allow-same-origin allow-popups allow-popups-to-escape-sandbox allow-forms"></iframe>With the rise of large language models (LLMs) like ChatGPT, we’re seeing a shift toward more accessible and user-friendly technology. Local LLMs offer a viable alternative to big tech solutions, often running on specially laptops or even compact devices like Raspberry Pi. For many, including myself, LLMs are invaluable tools that enhance communication, summarize information, transcribe voice, facilitate learning, and help manage tasks that might otherwise feel overwhelming. They can help strike the right emotional tone in our writing and assist in understanding complex data—capabilities that are especially crucial for those of us facing neurological challenges.While the goal of eliminating surveillance capitalism is commendable, banning technology outright isn’t the answer. We must recognize the significance of LLMs for individuals with disabilities. Calls to remove these technologies can overlook their profound impact on our lives. For many, LLMs are not just tools; they are lifelines that enable us to engage with the world more fully. Removing access to these resources would only isolate individuals who already face significant barriers. Instead, we should focus on utilizing local LLMs and other privacy-focused alternatives.This situation underscores the need for a nuanced approach to the intersection of privacy and assistive technology. Open-source LLMs, like Piper, exemplify how we can create locally run voice models that are accessible to everyone, even on low-cost devices. Advocating for privacy must go hand in hand with considering the implications for those who rely on these technologies for daily functioning. Striking a balance between protecting individual privacy and ensuring access to vital assistive tools is not just necessary; it’s imperative.In conclusion, LLMs represent a promising avenue for assisting individuals with neurological impairments. By embracing local and open-source solutions, we can protect our privacy while ensuring that everyone has access to the tools they need to thrive. The conversation around privacy and technology must continue, focusing on inclusivity and empowerment for all.I use SpeechNotes installed locally all the time, and I’d love to hear how you use LLMs as assistive technology! Do you run your LLM locally? Share your experiences!<a href="https://hear-me.social/tags/PrivacyAdvocate" class="mention hashtag" rel="nofollow noopener" target="_blank">#PrivacyAdvocate</a> <a href="https://hear-me.social/tags/AssistiveTechnology" class="mention hashtag" rel="nofollow noopener" target="_blank">#AssistiveTechnology</a> <a href="https://hear-me.social/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LLM</a> <a href="https://hear-me.social/tags/SurveillanceCapitalism" class="mention hashtag" rel="nofollow noopener" target="_blank">#SurveillanceCapitalism</a> <a href="https://hear-me.social/tags/Neurodiversity" class="mention hashtag" rel="nofollow noopener" target="_blank">#Neurodiversity</a> <a href="https://hear-me.social/tags/Accessibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#Accessibility</a> <a href="https://hear-me.social/tags/TechForGood" class="mention hashtag" rel="nofollow noopener" target="_blank">#TechForGood</a> <a href="https://hear-me.social/tags/a11y" class="mention hashtag" rel="nofollow noopener" target="_blank">#a11y</a> <a href="https://hear-me.social/tags/LocalLLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalLLM</a> <a href="https://hear-me.social/tags/LocalAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#LocalAI</a> <a href="https://hear-me.social/tags/FOSSai" class="mention hashtag" rel="nofollow noopener" target="_blank">#FOSSai</a> <a href="https://hear-me.social/tags/opensource_ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource_ai</a>

Recent searches

Search options

Administered by:

Server stats:

#localllm