Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
techhub.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A hub primarily for passionate technologists, but everyone is welcome

Administered by:

Server stats:

5.4K
active users

techhub.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.6

#foundation

8 posts7 participants0 posts today
Public
N-gated Hacker News

Oh joy, yet another paper with a title that sounds like a new #crypto #fad 🤦‍♂️. Thank goodness for the #Simons Foundation's donations, because without them, we'd clearly be lost in a sea of #academic gobbledygook 🤷‍♀️. Can't wait to "multi-token" my way to #enlightenment - or was it ennui? 📚🔍
arxiv.org/abs/2504.00927 #Foundation #research #multi-token #HackerNews #ngated

arXiv logo
arXiv.orgMulti-Token AttentionSoft attention is a critical mechanism powering LLMs to locate relevant parts within a given context. However, individual attention weights are determined by the similarity of only a single query and key token vector. This "single token attention" bottlenecks the amount of information used in distinguishing a relevant part from the rest of the context. To address this issue, we propose a new attention method, Multi-Token Attention (MTA), which allows LLMs to condition their attention weights on multiple query and key vectors simultaneously. This is achieved by applying convolution operations over queries, keys and heads, allowing nearby queries and keys to affect each other's attention weights for more precise attention. As a result, our method can locate relevant context using richer, more nuanced information that can exceed a single vector's capacity. Through extensive evaluations, we demonstrate that MTA achieves enhanced performance on a range of popular benchmarks. Notably, it outperforms Transformer baseline models on standard language modeling tasks, and on tasks that require searching for information within long contexts, where our method's ability to leverage richer information proves particularly beneficial.
Continued thread
Public
Johannes Brakensiek

#Swing #Cocoa: It isn't suprising when you look into it. For #WebObjects #Apple not only reimplemented #Foundation in #Java (com.webobjects.foundation), they also made a #Cocoa abstraction layer that mimics layout and behaviour in #Swing (com.webobjects.eointerface.swing).

That one still works (fosstodon.org/@lazarus/1142527), while the bridge to Cocoa has been deprecated with WebObjects 5.4 (and thus is not part of its docs anymore).

Compare leopard-adc.pepas.com/document to leopard-adc.pepas.com/document.

FosstodonJohannes Brakensiek (@lazarus@fosstodon.org)Attached: 1 image Probably doing #Cocoa in #Swift is nice. But it wasn't that bad in #Java either. Somehow this tech was deprecated. This client-server database app runs on any desktop operation system having a regular JVM. Crazy stuff, #Apple did, huh? #WebObjects #D2JC
Public
Uli Kusterer (Not a kitteh)

DST change reminded me of that time QA discovered that, if you build a date from NSDateComponents, any missing items will not be set to zero, but will be set to the corresponding value from the current date and time.

Which meant that my March 30th, 12:00 would get random one-minute-drift like 12:00:59 because the user entered the date right before a minute change.

Makes sense for the date, but was a bit bewildering for the time, especially seconds.

#cocoa#appkit#foundation
Public
Labdoo.org (Germany)

Eure IT-Spenden und @Labdoo_D wirken und machen die Welt jeden Tag etwas besser - diese Bilder zeigen es ganz deutlich 😀
Kinder in der Region Arusha, Tansania erhalten dort von der Dunia Salama Foundation an jedem Wochenende einen freien Computerkurs.
platform.labdoo.org/de/edoovil
#labdoo #salama #foundation #arusha #tansania #tanzania #computer #course #children #kinder #teilhabe #reise #travel #bildung #education

Collage mehrerer Fotos, die alle Kinder im Grundschulalter zeigen. Sie sitzen in einem Garten voller Pflanzen auf einem Rasen. Je ein Kind hält einen aufgeklappten Laptop auf dem Schoß. Aufgeregt stehen weitere Kinder um dieses Kind herum und zeigen auf den Bildschirm oder geben Ratschläge.
Public
ButterWord

Optimum Business y Lia Foundation Relanze Subvenciones locales de pequeñas empresas #Business #empresas #Foundation #Lia #Locales #Optimum #pequeñas #Relanze #Subvenciones #ButterWord #Spanish_News Comenta tu opinión 👇
butterword.com/optimum-busines

ButterWord · Optimum Business y Lia Foundation Relanze Subvenciones locales de pequeñas empresas – ButterWordOptimum Business y la Fundación LIA han anunciado el relanzamiento de las subvenciones de pequeñas empresas locales (levantando nuestros negocios comunitarios en Long Island), destinadas a apoyar a las pequeñas empresas en los condados de Nassau y Suffolk. Ahora en su segundo año, el software otorgará subvenciones de $ 5,000 a 40 pequeñas empresas seleccionadas, […]
ExploreLive feeds
About