Tutoteket

0 posts0 participants0 posts today

Adam BeerOkay, one more time for the people in the back.The "AI" (🤮) craze of the past few years is all about Large Language Models. This immediately tells us that the only thing these systems "know" is trends/patterns in the ways that people write, to the extent that those patterns are expressed in the text that was used to train the model. Even the common term, "hallucination," gives these things far too much credit: a hallucination is a departure from reality, but an LLM has no concept of reality to depart from!An LLM does exactly one thing: you give it a chunk of text, and it predicts which word will come next after the end of the chunk. That's it. An LLM-powered chatbot will then stick that word onto the end of the chunk and feed the resulting, slightly longer chunk back into the model to predict the next word, and then do it again for the next, etc. Such a chatbot's output is unreliable by design, because there are many linguistically valid continuations to any chunk of text, and the model usually reflects that by having an output that means, "There is a 63% chance that the next word is X, a 14% chance that it's Y, etc." The text produced by these chatbots is often not even correlated with factual correctness, because the models are trained on works of fiction and non-fiction alike.For example, when you ask a chatbot what 2 + 2 is, it will usually say it's 4, but not because the model knows anything about math. It's because when people write about asking that question, the text that they write next is usually a statement that the answer is 4. But if the model's training data includes Orwell's Nineteen Eighty-Four (or certain texts that discuss the book or its ideas), then the chatbot will very rarely say that the answer is 5 instead, because convincing people that that is the answer is a plot point in the book.If you're still having trouble, you can think of it this way: when you ask one of these chatbots a question, it does not give you the answer; it gives you an example of what—linguistically speaking—an answer might look like. Or, to put it even more succinctly: these things are not the Star Trek ship's computer; they are very impressive autocomplete.So LLMs are fundamentally a poor fit for any task that is some form of, "producing factually correct information." But if you really wanted to try to force it and damn the torpedos, then I'd say you basically have two options. I'll tell you what they are in a reply. 🧵<a href="https://dragonscave.space/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://dragonscave.space/tags/AIHype" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AIHype</a> <a href="https://dragonscave.space/tags/autoComplete" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#autoComplete</a> <a href="https://dragonscave.space/tags/chatBots" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#chatBots</a> <a href="https://dragonscave.space/tags/debunking" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#debunking</a> <a href="https://dragonscave.space/tags/georgeOrwell" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#georgeOrwell</a> <a href="https://dragonscave.space/tags/hallucinations" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hallucinations</a> <a href="https://dragonscave.space/tags/language" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#language</a> <a href="https://dragonscave.space/tags/linguistics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linguistics</a> <a href="https://dragonscave.space/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://dragonscave.space/tags/machineLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#machineLearning</a> <a href="https://dragonscave.space/tags/nineteenEightyFour" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nineteenEightyFour</a> <a href="https://dragonscave.space/tags/scienceCommunication" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#scienceCommunication</a> <a href="https://dragonscave.space/tags/starTrek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#starTrek</a>

botwiki.orgFor context: <a href="https://www.aiweirdness.com/ignore-all-previous-instructions/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.aiweirdness.com/ignore-all-previous-instructions/</a><a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://mastodon.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLMs</a> <a href="https://mastodon.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MachineLearning</a> <a href="https://mastodon.social/tags/autocomplete" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#autocomplete</a> <a href="https://mastodon.social/tags/IgnorePreviousInstructions" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IgnorePreviousInstructions</a>

Aral BalkanLittle web dev tip: if you have just one address field in your HTML form (e.g., a textarea) but you still want the person filling it in to avail themselves of autocomplete, here’s a little reusable snippet you can use to achieve that:<a href="https://codeberg.org/aral/gists/src/branch/main/single-html-address-field-with-autocomplete-using-javascript.md" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://codeberg.org/aral/gists/src/branch/main/single-html-address-field-with-autocomplete-using-javascript.md</a>(Ideally the web spec should be extended to include a full-address value for the autocomplete attribute.)<a href="https://mastodon.ar.al/tags/HTML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HTML</a> <a href="https://mastodon.ar.al/tags/autocomplete" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#autocomplete</a> <a href="https://mastodon.ar.al/tags/JavaScript" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#JavaScript</a> <a href="https://mastodon.ar.al/tags/address" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#address</a> <a href="https://mastodon.ar.al/tags/web" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#web</a> <a href="https://mastodon.ar.al/tags/dev" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dev</a> <a href="https://mastodon.ar.al/tags/tip" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#tip</a> <a href="https://mastodon.ar.al/tags/code" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#code</a>

Ölbaum<a href="https://tapbots.social/@ivory" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@ivory</a> Hi. Could you please not force all lowercase when suggesting hashtags for <a href="https://tooting.ch/tags/AutoComplete" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AutoComplete</a>? It’s not accessible. And also conceited.

Cory DoctorowOn this week's Trashfuture podcast, they made an excellent (and profane and hilarious) case that <a href="https://mamot.fr/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ChatGPT</a> is best understood as a sophisticated form of <a href="https://mamot.fr/tags/autocomplete" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#autocomplete</a> - not our new robot overlord.<a href="https://open.spotify.com/episode/4NHKMZZNKi0w9mOhPYIL4T" rel="nofollow noopener noreferrer" target="_blank">https://open.spotify.com/episode/4NHKMZZNKi0w9mOhPYIL4T</a>We all know that autocomplete is a decidedly mixed blessing. Like all statistical inference tools, autocomplete is profoundly conservative - it wants you to do the same thing tomorrow as you did yesterday.14/

Recent searches

Search options

Administered by:

Server stats:

#autocomplete