Published at #IRRJ: "Don't Use LLMs to Make Relevance Judgments" by Ian Soboroff. #evaluation #relevance #llm https://doi.org/10.54195/irrj.19625
doi.orgDon't Use LLMs to Make Relevance Judgments
| Information Retrieval Research
Recent searches
Search options
Administered by:
#relevance
3 posts3 participants0 posts today
What's the relationship between conference size and "success"? My experience? Small well-designed conferences beat the pants off huge events!
https://www.conferencesthatwork.com/index.php/event-design/2014/03/conference-size-and-success
Greg Cocks Introduction - Geoethics For The Future
--
https://doi.org/10.1016/B978-0-443-15654-0.00034-7 <-- shared link to volume
--
[disclaimer: sharing of this link should not be seen as an endorsement]
#anthropocene #geoethics #global #anthropogenic #change #socialgeosciences #societal #relevance #geosciences #GIS #spatial #mapping #spatialanalysis #ethics #geology #resources #naturalresources #ecosystems #ecology #water #earthscience #humanimpacts #Interdisciplinary #sustainability #risk #hazard #responsibilities #interaction
? what is it
! a light lamp upside down
? is beauty or truth
a question of perspectives
the #TRUTH series
https://EMOniceR.com
#perpective #view #beauty #design #wisdom #relevance #function #lifestyle
Ah, the never-ending saga of reinventing the wheel, now featuring "trainable self-attention"—because nothing screams cutting-edge like pretending to be the first person to discover attention #spans. 
Meanwhile, the blog's timeline reads like a desperate plea for #relevance through the ages. 
https://www.gilesthomas.com/2025/03/llm-from-scratch-8-trainable-self-attention #reinventingthewheel #trainableselfattention #innovation #AIattention #techblog #HackerNews #ngated
Giles' Blog · Writing an LLM from scratch, part 8 -- trainable self-attentionMoving on from a toy self-attention mechanism, it's time to find out how to build a real trainable one. Following Sebastian Raschka's book 'Build a Large Language Model (from Scratch)'. Part 8/??
Quite a good list of LLM evaluation metrics (with papers!) by Parea AI: https://docs.parea.ai/blog/eval-metrics-for-llm-apps-in-prod
Parea AIEvaluation Metrics for LLM Applications In Production - Parea AIHow to measure the performance of LLM applications without ground truth data.
Sentinel Tip - Filter Logs Before Ingestion: Use filtering techniques to exclude irrelevant data and reduce costs. Filtering helps in managing data volume and focusing on relevant information. #LogFiltering #CostManagement #Relevance
What's the relationship between conference size and "success"? My experience? Small well-designed conferences beat the pants off huge events!
https://www.conferencesthatwork.com/index.php/event-design/2014/03/conference-size-and-success
A quotation from Taleb, Nassim Nicholas:
«
They think that intelligence is about noticing things that are relevant (detecting patterns); in a complex world, intelligence consists in ignoring things that are irrelevant (avoiding false patterns).
»
Full quote, sourcing, notes:
https://wist.info/taleb-nassim-nicholas/73876/
Continued thread
commitment to staying current but also ensures your CV remains focused and impactful.
Keep it concise and pertinent to make a strong impression on potential employers.
Due to low interest, there will be less posting
"I think now is a good time to remind everyone that Wicked is a story about a weak man ..."
#Wicked #Movie #relevance
Sounds like a tiny 
with tiny hands?
Continued thread
commitment to staying current but also ensures your CV remains focused and impactful.
Keep it concise and pertinent to make a strong impression on potential employers.
https://www.europesays.com/1624898/ AI agents are the next big thing. What are they? #Activision #AI #AIAlignment #ArtificialIntelligence #Blackwell #Chatbots #ChatGPT #ComputationalNeuroscience #Cybernetics #DanielVassilev #GenerativeArtificialIntelligence #Hopper #HopperChips #JensenHuang #MarkZuckerberg #Meta #Microsoft #MicrosoftCopilot #Nvidia #OpenAI #Quartz #RebeccaGreene #Regal #Relevance #RelevanceAI #Roku
What's the relationship between conference size and "success"? My experience? Small well-designed conferences beat the pants off huge events!
https://www.conferencesthatwork.com/index.php/event-design/2014/03/conference-size-and-success
Continued thread
commitment to staying current but also ensures your CV remains focused and impactful.
Keep it concise and pertinent to make a strong impression on potential employers.
Continued thread
You also need to consider the #relevance and timeliness of the content. A common problem is that documentation quickly becomes outdated. So, whenever you write something, consider the level of commitment you and your team are willing to invest in keeping it updated. That's why I love internal blog posts—they naturally age. Everyone can tell, based on the publication date, whether the content is still accurate. (cont'd)
Continued thread
commitment to staying current but also ensures your CV remains focused and impactful.
Keep it concise and pertinent to make a strong impression on potential employers.
What's the relationship between conference size and "success"? My experience? Small well-designed conferences beat the pants off huge events!
https://www.conferencesthatwork.com/index.php/event-design/2014/03/conference-size-and-success
Continued thread
commitment to staying current but also ensures your CV remains focused and impactful.
Keep it concise and pertinent to make a strong impression on potential employers.