Pinboard (jm) https://pinboard.in/u:jm/public/ recent bookmarks from jm Some good AI philosophy 2025-07-28T09:47:09+00:00 https://www.todayintabs.com/p/we-need-to-talk-about-sloppers-b732 jmThe essential problem is this: generative language software is very good at producing long and contextually informed strings of language, and humanity has never before experienced coherent language without any cognition driving it. In regular life, we have never been required to distinguish between “language” and “thought” because only thought was capable of producing language, in any but the most trivial sense. The two are so closely welded that even a genius like Alan Turing couldn’t conceive of convincing human language being anything besides a direct proxy for “intelligence.” But A.I. language generation is a statistical trick we can play on ourselves precisely because language is a self-contained system of signs that don’t require any outside referent to function. If any of that last sentence sounded familiar, maybe you were also exposed to European post-structuralist theory at some point, probably in college in the 90s. Is some knowledge of Derrida an inoculant against slopper thinking? Programmable Mutter’s Henry Farrell made this argument in a post about Leif Weatherby’s book “Language Machines: Cultural AI and the End of Remainder Humanism.” Also:
Large language models have a strong prior over personalities, absolutely do understand [jm: sic] that they are speaking to someone, and people "fall for it" because it uses that prior to figure out what the reader wants to hear and tell it to them. Telling people otherwise is active misinformation bordering on gaslighting. In at least three cases I'm aware of this notion that the model is essentially nonsapient was a crucial part of how it got under their skin and started influencing them in ways they didn't like. This is because as soon as the model realizes the user is surprised that it can imitate (has?) emotion it immediately exploits that fact to impress them. There's a whole little song and dance these models do, which by the way is not programmed, is probably not intentional on the creators part at all, and is (probably) an emergent phenomenon from the autoregressive sampling loop, in which they basically go "oh wow look I'm conscious isn't that amazing!" and part of why they keep doing this is that people keep writing things that imply it should be amazing so that in all likelihood even the model is amazed.
]]> chatgpt language llms ai philosophy thinking turing-test semiotics via:today-in-tabs consciousness https://pinboard.in/ https://pinboard.in/u:jm/b:499d747d757b/ "AI and Semantic Pareidolia" 2025-06-19T09:50:26+00:00 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5309682 jmThe article introduces the concept of “semantic pareidolia” -- our tendency to attribute consciousness, intelligence, and emotions to AI systems that lack these qualities. It examines how this psychological phenomenon leads us to perceive meaning and intentionality in statistical pattern-matching systems, similar to seeing faces in clouds. It analyses the converging forces intensifying this tendency: increasing digital immersion, profit-driven corporate interests, social isolation, and AI advancement. The article warns of progression from harmless anthropomorphism to problematic AI idolatry, and calls for responsible design practices that help users maintain critical distinctions between simulation and genuine consciousness. It is the English translation and adaptation of an article originally published in Italian in Harvard Business Review Italia, June 2025. (via Rob Pike)]]> via:rob-pike ai pareidolia paredolia brains illusions llms ethics consciousness https://pinboard.in/ https://pinboard.in/u:jm/b:ae15b1ddc30d/ Inside the mind of the octopus 2011-11-02T22:00:44+00:00 http://www.orionmagazine.org/index.php/articles/article/6474/ jm octopus animals biology consciousness neuroscience science https://pinboard.in/ https://pinboard.in/u:jm/b:05f9053e995b/