{"id":5359,"date":"2025-03-28T11:57:17","date_gmt":"2025-03-28T18:57:17","guid":{"rendered":"http:\/\/www.contrapositivediary.com\/?p=5359"},"modified":"2025-03-28T11:57:17","modified_gmt":"2025-03-28T18:57:17","slug":"the-real-danger-of-textual-ai","status":"publish","type":"post","link":"https:\/\/www.contrapositivediary.com\/?p=5359","title":{"rendered":"The Real Danger of Textual AI"},"content":{"rendered":"

Now that I have The Everything Machine<\/a><\/em> on the market, I can go back to a couple of other long-term projects. I\u2019ve been interested in AI and robots since high school, and they\u2019re a major element of my SF. All of my AI short stories are gathered in my book, Souls in Silicon<\/a><\/em>. (The stories are almost all upbeat, and a couple of them are pure humor.) The AIs in Souls in Silicon<\/em> are not what we call AI today. I\u2019m starting to hear a new term: Artificial General Intelligence (AGI)<\/a> which makes more sense in terms of science-fictional AIs. AGI is AI that can reason and deal with reality pretty much the same way human minds do. Will this ever happen? I doubt it. We don\u2019t really know how imagination and intuition work and thus probably can\u2019t model them. What we have today are not AGI but large language models<\/em> (LLMs). I had the insight this morning, after playing around with Grok, that the better LLMs are, the more dangerous they are.<\/p>\n

They are definitely getting better. And they are already pretty dangerous.<\/p>\n

This time around, I\u2019ve been testing Grok, the AI component of X\/Twitter. My tests consist of asking it questions with verifiable answers. (I have not yet tested Grok\u2019s image generator. Patience, patience.) Most of these tests are of the form, Who is XXXXXXXXX?<\/em> My questions have been about family close to me, because I can verify the descriptions that Grok hands back.<\/p>\n

Grok did a fair job with the question Who is Carol Duntemann?<\/em> Its answer:<\/p>\n

\n

Carol Duntemann, born Carol Ostruska on June 1, 1953, is the wife of Jeff Duntemann, a writer, editor, and technology industry professional. They met as juniors in high school and married in October 1976. Carol has been a significant presence in Jeff’s life, often mentioned in his writings, including his blog, Jeff Duntemann’s Contrapositive Diary<\/em>. Together, they have lived in various places, including Colorado Springs, Colorado, and currently reside in Scottsdale, Arizona. Carol is known to share Jeff’s interest in their Bichon Frise dogs, with the couple having owned several over the years, including a current dog named Dash. While Carol herself is not a public figure in the same way as Jeff, she is a key part of his personal narrative, often described as a partner who helped shape his life significantly. Public records indicate she has been associated with addresses in Colorado Springs, such as 145 Stanwell Street and 4120 Danceglen Drive, tied to the phone number (719) XXX-XXXX.<\/p>\n

\n

(I Xed out the phone number, which was correct, in case it\u2019s been reassigned.) How well did Grok do? Its sole error in this answer is Carol\u2019s birth date. It\u2019s wrong, and thus dangerous. More on that later. Let\u2019s look at another one. Who is Kathleen Duntemann?<\/em><\/p>\n

\n

Kathleen Duntemann could refer to different individuals based on available context, but the most prominent and well-documented person with this name tied to public records and family history is Kathleen M. Duntemann (1920\u20131999), who was Jeff Duntemann\u2019s aunt and godmother.<\/p>\n

Kathleen Mae Duntemann was born on May 20, 1920, in Chicago, Illinois, to Harry George Duntemann (1892\u20131956) and Sade Prendergast Duntemann (1897\u20131965). She grew up in Chicago, and the 1940 U.S. Census shows her living there with her parents and younger brother, Frank W. Duntemann (Jeff\u2019s father, 1922\u20131978), at the age of 19. Her father, Harry, worked as a railroad clerk, reflecting the family\u2019s modest, working-class roots. Kathleen never married and remained close to her family throughout her life, often playing a significant role in family gatherings and history-keeping.<\/p>\n

She is frequently mentioned in Jeff Duntemann\u2019s writings, particularly in his blog, Contrapositive Diary<\/em>, and his family history project. Jeff describes her as his godmother and a key figure in preserving the Duntemann family legacy, sending him \u201cscraps of paper containing lists of relatives\u201d that he later used to compile a detailed family tree. A notable family photo from 1953 captures her holding a young Jeff alongside four generations of Duntemanns, including her grandmother Martha Winkelmann Duntemann, her parents Harry and Sade, her brother Frank, and Frank\u2019s wife, Victoria Pryes Duntemann. Kathleen lived much of her life in Chicago before moving to Des Plaines, Illinois, where she died on October 25, 1999, at the age of 79. Her legacy within the family underscores her as a connector of generations, though she did not leave a public career or widely recognized mark beyond that sphere.<\/p>\n

\n

Grok admits that there may be other Kathleen Duntemanns (there aren\u2019t) as it admits with most other names. It gets points for that. Ok. More errors here: My grandmother Sade was born in 1892, not 1897. My Aunt Kathleen was born on 30 August 1920. She died on 8 July 1999. Grok got the years right, but neither the months nor the dates. My grandfather Harry was never a railroad clerk. He worked his entire adult life for the First National Bank of Chicago, and retired as a vice president of that bank, Chicago\u2019s biggest. The family\u2019s origins were very much middle-class to upper-middle-class. Kathleen lived in Chicago her entire life, and never in Des Plaines.<\/p>\n

Now, hold onto your hats. Grok\u2019s answer to my last question is a lulu. This Contra entry is getting long, longer than I prefer to do, but this business is important. Bear with me. Who is Jeff Duntemann?<\/em> I asked. Heh.<\/p>\n

\n

Jeff Duntemann has had a multifaceted career primarily centered around writing, editing, and technology, with a strong focus on computing and science fiction. Born on June 29, 1952, in Chicago, Illinois, he developed an early interest in electronics and writing, which shaped his professional path.<\/p>\n

He began his career in technical writing and editing, notably working at Xerox Corporation as an office machine repairman from around 1972 to 1976, where he gained hands-on experience with early office technology. This technical background informed his later work in the computing industry. In the late 1970s and early 1980s, he transitioned into programming and writing about computers. He became a prominent figure in the personal computing revolution, contributing to the development and documentation of software tools. One of his significant early contributions was as a programmer and documenter for the Turbo Pascal compiler at Borland International, starting in 1985. His work helped make Turbo Pascal a widely used tool among developers, and he wrote several influential programming books, including Assembly Language from Square One<\/em> (1990), Borland Pascal from Square One<\/em> (1992), and Jeff Duntemann\u2019s Wi-Fi Guide<\/em> (2004), which catered to both beginners and advanced users.<\/p>\n

Duntemann also made a mark in technical publishing. He served as an editor for various magazines, most notably as the editor-in-chief of PC Techniques<\/em> (later renamed Visual Developer Magazine<\/em>) from 1989 to 1998, under Coriolis Group Books, a publishing company he co-founded with Keith Weiskamp. Coriolis became known for its extensive line of computer books, and Duntemann\u2019s editorial work extended to other publications like Dr. Dobb\u2019s Journal<\/em> and Byte<\/em> Magazine<\/em>. His writing was characterized by a clear, engaging style that made complex technical topics accessible, earning him a loyal readership.<\/p>\n

Parallel to his technical career, Duntemann pursued science fiction writing. He sold his first short story, "Our Lady of the Endless Sky," to Amazing Stories<\/em> in 1979 and continued to publish fiction intermittently, including works like \u201cCold Hands\u201d (1982) and the novel The Cunning Blood<\/em> (2005). His fiction often blended speculative ideas with his technical expertise, though it remained a smaller part of his career compared to his nonfiction output.<\/p>\n

After leaving Coriolis in the late 1990s, he continued freelance writing and consulting, focusing on topics like wireless networking and software development. He also maintained a blog, Jeff Duntemann\u2019s Contrapositive Diary<\/em>, where he wrote about technology, science fiction, and personal interests like astronomy and vintage electronics until health challenges slowed his output. In 2018, he was diagnosed with atrial fibrillation and later faced pulmonary fibrosis, which he documented candidly, reflecting his lifelong habit of sharing knowledge. His last blog entry was on December 15, 2024, and he passed away on December 27, 2024, as noted in an obituary by his wife, Carol.<\/p>\n

Duntemann\u2019s career reflects a blend of technical innovation, educational writing, and creative storytelling, leaving a lasting impact on the computing community and a niche legacy in science fiction.<\/p>\n

\n

Wow. I didn\u2019t know I was dead. I do not<\/em> have atrial fibrillation nor pulmonary fibroids. Years and dates are all over the place. I was a Xerox repairman from 1974-1976. I sold \u201cOur Lady of the Endless Sky\u201d to Nova 4<\/em> in 1973, not 1979, nor to Amazing Stories<\/em>. \u201cCold Hands\u201d was published in 1980, not 1982. Coriolis went under in 2002, not 1998. I just pinched myself; I\u2019m not dead yet. Etc.<\/p>\n

My point in all this is that the closer AIs come to describing reality in answers to questions, the more people will trust their answers\u2014including facts that are nonetheless wrong. Those bogus facts can be annoying, or worse. Birth and death dates have legal significance, as do many other things. If a scattered few errors are buried in a lot of otherwise correct text, those errors may be taken as the truth by users of the AI software.<\/p>\n

In short, the fewer errors there are in AI answers, the more dangerous those answers become, because people will be more likely to trust AI answers as entirely<\/em> correct. And given what I know about how LLMs work, I\u2019m pretty sure that AI answers of any complexity will contain errors, not just now but probably forever.<\/p>\n

Keep that in mind if you ever ask an AI questions on which anything of value depends. You wouldn\u2019t want people to think you were dead.<\/p>\n","protected":false},"excerpt":{"rendered":"

Now that I have The Everything Machine on the market, I can go back to a couple of other long-term projects. I\u2019ve been interested in AI and robots since high school, and they\u2019re a major element of my SF. All of my AI short stories are gathered in my book, Souls in Silicon. (The stories […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[23],"tags":[118,151,14],"class_list":["post-5359","post","type-post","status-publish","format-standard","hentry","category-ideasandanalysis","tag-ai","tag-memoir","tag-software"],"_links":{"self":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/5359","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5359"}],"version-history":[{"count":1,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/5359\/revisions"}],"predecessor-version":[{"id":5360,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/5359\/revisions\/5360"}],"wp:attachment":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5359"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5359"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5359"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}