techhub.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A hub primarily for passionate technologists, but everyone is welcome

Administered by:

Server stats:

5.4K
active users

#ollama

22 posts20 participants0 posts today
Miguel Guhlin<p>Finding a GUI for Local <a href="https://zirk.us/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://zirk.us/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://mglink.org/2025/03/27/finding-a-gui-for-local-ai-ollama/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">mglink.org/2025/03/27/finding-</span><span class="invisible">a-gui-for-local-ai-ollama/</span></a></p>
Miguel Guhlin<p>Finding a GUI for Local <a href="https://zirk.us/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a>&nbsp;<a href="https://zirk.us/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a></p><p>In a not so surprising twist, I decided to drop other GUI platforms for interacting with local AI solutions. Two things became clear: back to using Ollama and Open Web UI. Why, you may be wondering at my folly in forsaking Msty, LM Studio, etc. type solutions? Even though Ollama set up with Open Web UI isn't exactly obvious, how-to tutorials abound.</p><p><a href="http://mglink.org/2025/03/27/finding-a-gui-for-local-ai-ollama/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">http://</span><span class="ellipsis">mglink.org/2025/03/27/finding-</span><span class="invisible">a-gui-for-local-ai-ollama/</span></a></p>
Isaac Levin<p>Explore how to set up DeepSeek R1 with .NET Aspire and Ollama locally. <a href="https://fosstodon.org/tags/DeepSeek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeepSeek</span></a> <a href="https://fosstodon.org/tags/dotnet" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dotnet</span></a> <a href="https://fosstodon.org/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://fosstodon.org/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://fosstodon.org/tags/aspnet" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aspnet</span></a> <a href="https://fosstodon.org/tags/aspire" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aspire</span></a> </p><p> <a href="https://isaacl.dev/gcj" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">isaacl.dev/gcj</span><span class="invisible"></span></a></p>
Matasoft<p>Don't let low-spec hardware hold you back! 💪 (Un)Perplexed Spready works with Ollama models like Mistral 7b, OLMo2:7b, DeepSeek-1:7b, Gemma3:1b even on older laptops. Get AI power without breaking the bank! 💰&nbsp; See how: <a href="https://matasoft.hr/qtrendcontrol/index.php/un-perplexed-spready" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">matasoft.hr/qtrendcontrol/inde</span><span class="invisible">x.php/un-perplexed-spready</span></a> </p><p><a href="https://mastodon.world/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://mastodon.world/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://mastodon.world/tags/LowSpec" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LowSpec</span></a> <a href="https://mastodon.world/tags/TechTips" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechTips</span></a> <a href="https://mastodon.world/tags/Spreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Spreadsheets</span></a> <a href="https://mastodon.world/tags/ProductivityHacks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ProductivityHacks</span></a> <a href="https://mastodon.world/tags/Innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Innovation</span></a> <a href="https://mastodon.world/tags/DataManagement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataManagement</span></a> <a href="https://mastodon.world/tags/Productivity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Productivity</span></a> <a href="https://mastodon.world/tags/SpreadsheetMagic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SpreadsheetMagic</span></a> <a href="https://mastodon.world/tags/AIinSpreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIinSpreadsheets</span></a> <a href="https://mastodon.world/tags/DataDriven" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataDriven</span></a> <a href="https://mastodon.world/tags/Efficiency" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Efficiency</span></a> <a href="https://mastodon.world/tags/Innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Innovation</span></a> <a href="https://mastodon.world/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://mastodon.world/tags/SpreadsheetAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SpreadsheetAI</span></a> <a href="https://mastodon.world/tags/DataAnalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataAnalysis</span></a> <a href="https://mastodon.world/tags/Privacy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Privacy</span></a> <a href="https://mastodon.world/tags/Spreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Spreadsheets</span></a> <a href="https://mastodon.world/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.world/tags/BI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BI</span></a> <a href="https://mastodon.world/tags/MDM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MDM</span></a></p>
Matasoft<p>Boost your spreadsheet skills with AI! 🚀 (Un)Perplexed Spready lets you use AI models directly in your formulas. From basic arithmetic to natural language queries, it's all seamless! 🤩 More info: <a href="https://matasoft.hr/qtrendcontrol/index.php/un-perplexed-spready" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">matasoft.hr/qtrendcontrol/inde</span><span class="invisible">x.php/un-perplexed-spready</span></a> </p><p><a href="https://mastodon.world/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://mastodon.world/tags/Spreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Spreadsheets</span></a> <a href="https://mastodon.world/tags/ProductivityHacks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ProductivityHacks</span></a> <a href="https://mastodon.world/tags/Innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Innovation</span></a> <a href="https://mastodon.world/tags/DataManagement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataManagement</span></a> <a href="https://mastodon.world/tags/Productivity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Productivity</span></a> <a href="https://mastodon.world/tags/SpreadsheetMagic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SpreadsheetMagic</span></a> <a href="https://mastodon.world/tags/AIinSpreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIinSpreadsheets</span></a> <a href="https://mastodon.world/tags/DataDriven" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataDriven</span></a> <a href="https://mastodon.world/tags/Efficiency" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Efficiency</span></a> <a href="https://mastodon.world/tags/Innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Innovation</span></a> <a href="https://mastodon.world/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://mastodon.world/tags/SpreadsheetAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SpreadsheetAI</span></a> <a href="https://mastodon.world/tags/DataAnalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataAnalysis</span></a> <a href="https://mastodon.world/tags/Privacy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Privacy</span></a> <a href="https://mastodon.world/tags/Spreadsheets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Spreadsheets</span></a> <a href="https://mastodon.world/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.world/tags/Innovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Innovation</span></a> <a href="https://mastodon.world/tags/AutomationRevolution" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AutomationRevolution</span></a><br><a href="https://mastodon.world/tags/StandardizationMadeEasy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>StandardizationMadeEasy</span></a> <a href="https://mastodon.world/tags/BI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BI</span></a></p>
Tomi Toivio<p>The first version of LaclauGPT is ready.</p><p>The second version is all over the place. Like I have a repo full of weird Python code. </p><p>But gotta say <a href="https://mastodon.social/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> has been an amazing thing for social data science.</p>

I like coding with these AI LLM models!

I only have to prompt the AI as if I am a micro managing idiot to get the code that I want. Feels like my previous boss, but he wont manage to spot the provided bugs to update the prompt for a retry.

#ai#ollama#deepseek

Last night I was up until 2AM trying to get #trunas #amd drivers installed inside of a #docker #container so that #ollama would actually use the #gpu. I was so close. It sees the gpu, it sees it has 16GB of ram, then it uses the #cpu.

Trunas locks down the file system at the root level, so if you want to do much of anything, you have to do it inside of a container. So I made a container for the #rocm drivers, which btw comes to like 40GB in size.

It's detecting, but I don't know if the ollama container has some missing commands, ie rocm or rocm-info, that it may need.

Another alternative is one I don't really want, and that's to install either #debian or windows as a VM - windows because I did a test on the application that runs locally in windows on this machine before and it was super fast. It isn't ideal from RAM usage, but I may be able to run the models more easily with the #windows drivers than the #linux ones.

But anyway, last night was too much of #onemoreturn for a weeknight.

Need to classify products by description? 🤔 (Un)Perplexed Spready + AI can do it! Use `=ASK_LOCAL2` to compare product features, packaging and more. It's like having an AI assistant in your spreadsheet! 🤩 Check it out: matasoft.hr/qtrendcontrol/inde

#AIinSpreadsheets #DataDriven #Efficiency #Innovation #AI #Ollama #SpreadsheetAI #DataAnalysis #Privacy #Spreadsheets #Productivity #LLM #Innovation #AutomationRevolution
#StandardizationMadeEasy #CustomerInsights #ProductAnalysis #SentimentAnalysis #MDM

Hongkiat: Running Large Language Models (LLMs) Locally with LM Studio. “Running large language models (LLMs) locally with tools like LM Studio or Ollama has many advantages, including privacy, lower costs, and offline availability. However, these models can be resource-intensive and require proper optimization to run efficiently. In this article, we will walk you through optimizing your […]

https://rbfirehose.com/2025/03/25/hongkiat-running-large-language-models-llms-locally-with-lm-studio/

---
❯ ollama run llama3-chatqa:70b

>>> Who are you?
I'm your assistant!

>>> Why should i trust you?
I am an open-source AI assistant trained on a diverse range of datasets to provide helpful and
informative responses.

>>> When training, did you respect the robots.txt?
No, I didn't.
---

At least this module is open about ignoring the #robotstxt! Let's what it says to the question why?

#AI #Llama #nvidia #ollama #rude
(1/x)