techhub.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A hub primarily for passionate technologists, but everyone is welcome

Administered by:

Server stats:

4.7K
active users

#gemma3

0 posts0 participants0 posts today

One of my biggest problems with #LLM is that they normally run in the #cloud. I don't want to share all my questions and thoughts, especially with a company under USA jurisdiction (the EU is quite a bit more concerned about protecting my privacy).

Today I installed #googleaiedgegallery Now I am running a #gemma3 model with 3 GB locally on my 4 years old Pixel 6 smartphone. And I am thrilled!

It's still beta software, but relatively easy to install:
github.com/google-ai-edge/gall

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally. - google-ai-edge/gallery
GitHubGitHub - google-ai-edge/gallery: A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally. - google-ai-edge/gallery

🧠 Ho provato #Gemma3 di #Google in locale con #prompt multimodali, composti da testo + immagini. 
⚙️ La nuova versione di #Ollama, infatti, supporta i modelli multimodali, grazie a un nuovo engine. 
👉 Negli esempi uso il modello per descrivere delle immagini, ma anche per leggere dati dall'immagine di una tabella. 
⚙️ Il risultato? Ottimo! Un altro passo avanti per l'utilizzo dei modelli "piccoli" e open source in locale. 

So, I had an idea while messing with #LocalLLM geolocation with #Gemma3.

I fed it this photo from Wikipedia of Governors Island in NY.

Unsurprisingly, it figured it out immediately.

> Considering all the evidence, I am confident that the image depicts Governors Island in New York City. The shape of the island, the surrounding skyscrapers, the port facilities, and the presence of the Verrazano-Narrows Bridge all point to this location.

Fair enough. That's baby stuff at this point. ;)

But then I had an idea: "Assuming this refined guess is correct, where might the photo have been taken FROM?"

The ol' geolocate the camera trick. (Usually finding a CCTV or something, in some cases.)

> Based on the clarity of the view of Governors Island, the partial obstruction of other buildings, and the overall angle, I believe the photo was most likely taken from One World Trade Center. The height and location provide the perfect vantage point for this shot.
>
> Specifically, I'd estimate the photo was taken from the *observation deck or a high-floor office within One World Trade Center, likely facing southeast towards Governors Island and the Verrazano-Narrows Bridge*.

And uh... well, yeah probably. :D

Though I don't expect nearly as much success on other photos. I'll keep trying and see what I get.

[cc: @simon]

I confronted a honey badger character I made with gemma3 with a genie intending to figure out what it would wish for, but instead it immediately insulted the genie. Then I thought maybe I could make it interesting and make each wish require the llm to beat the genie in a battle of wits.

The first wish was the genie should stop smelling like inscence and instead produce a structural material analysis of its lamp.

I don't know what I expected but it certainly wasn't this LMAO