techhub.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A hub primarily for passionate technologists, but everyone is welcome

Administered by:

Server stats:

4.9K
active users

#NLU

12 posts5 participants1 post today
Continued thread

Also, because the system learns entirely from context, it's domain-agnostic. It works for any topic, not just the ones being discussed here.


Continued thread

The only actual machine learning the system uses, aside from its purely emergent ability to learn language from context, is in the parser, where I adjust the probability of matching certain patterns based on prior success in understanding the user.


Continued thread

I wrote this code in my spare time, over about a decade. I wrote the parser, the knowledge graph, the conversational engine, everything from scratch in pure python. It starts out literally knowing nothing except English grammar, and learns everything from interactions with the user. These tests I posted... It is literally learning the words from context as I use them. It had no idea what a dog or an apple or the color red is until I tell it things about them.


Continued thread

Do you see how the system answers questions it doesn't know? That's right. It says, "I don't know." Say no to hallucinations.


Continued thread

Here's another passing unit test. Again, this is stuff I wrote almost a decade ago, before LLMs were even invented.

> The brown dog bites me.
> The black dog barks at me.
> The dog that bites me hates me.
> Which dog hates me?
< The brown dog.
> Does the brown dog bite me?
< Yes.
> Does the brown dog hate me?
< Yes.
> Does the black dog hate me?
< I don't know.
> Does the dog that barks at me hate me?
< I don't know.
> Is the brown dog the dog that bites me?
< Yes.


Just dug out some of my code from almost a decade ago, pre-LLM, and got it working again. Some examples of what it could do, taken from actual passing unit tests, are below. Lines starting with > are what the user says, and lines starting with < are what the system says.

> The apple is red.
> The worm is in the apple.
> The apple is in the basket.
> Where is the worm?
< In the apple.
> Where is the apple?
< In the basket.
> Is the worm in the apple?
< Yes.
> Is the apple in the basket?
< Yes.
> Is the worm in the basket?
< I don't know.
> What is in the apple?
< The worm.
> Is the apple red?
< Yes.