{"id":4972,"date":"2023-05-28T11:31:45","date_gmt":"2023-05-28T18:31:45","guid":{"rendered":"http:\/\/www.contrapositivediary.com\/?p=4972"},"modified":"2023-05-28T11:32:25","modified_gmt":"2023-05-28T18:32:25","slug":"stormy-vs-the-ai-doom-kvetchers","status":"publish","type":"post","link":"https:\/\/www.contrapositivediary.com\/?p=4972","title":{"rendered":"STORMY Vs. the AI Doom Kvetchers"},"content":{"rendered":"

I follow the AI discussion to some extent (as time permits, which it hasn\u2019t lately) and from initial amusement it\u2019s pivoted to apprehension and doom-kvetching, as if we didn\u2019t get a bellyful of doom-kvetching as COVID passed through. The AIs I\u2019ve played with have had peculiar failure modes, among them expressing that 128-bit registers are larger than 512-bit registers<\/a>. Numbers aren\u2019t their forte, even down at level of counting on their fingers, since AI image generators don\u2019t have any clear idea how many fingers a hand is supposed to have<\/a>. (More on that topic here<\/a>.)<\/p>\n

I get the impression that our current generation of AIs have their own way of proposing solutions to problems. What seems obvious to them isn\u2019t always obvious to us. The danger, if there is any, lies in giving them more responsibility than something that can\u2019t count fingers or toes should rightfully have.<\/p>\n

Which brings us to an SF flash story that I wrote in 1990 and published in my magazine PC Techniques<\/em> about that time. Most of my regular readers are familiar with \u201cSTORMY Vs. the Tornadoes.\u201d It was designed as a humor piece, and a satire on the concept of AI as it was imagined thirty years ago. A few days ago I realized that I had, in a sense, predicted the future: That AIs will do ridiculous things because those ridiculous things make sense to the AIs<\/em>. STORMY, a National Weather Service AI, was asked how we might reduce American tornado fatalities.<\/p>\n

And STORMY took the question very<\/em> seriously.<\/p>\n

Here\u2019s the whole story, for those who haven\u2019t seen it, or haven\u2019t read it in a long time.<\/p>\n

\n

STORMY Vs. the Tornadoes<\/p>\n

By Jeff Duntemann<\/p>\n

\u201cMr. Petter, in the last six months, that computer program of yours cut Federal government purchase orders for 18,000 \u2018uninhabitable manufactured housing units,\u2019 to a total of 21 million dollars.\u201d Senator Orenby Ruesome (R., Oklahoma) sent the traitor Xerox copies skittering over the Formica tabletop.<\/p>\n

U.S. Weather Service Programmer Grade 12 Anthony Petter winced. \u201cUmm…you gave us the money, Senator.\u201d<\/p>\n

\u201cBut not for rotted-out house trailers!\u201d<\/p>\n

Petter sucked in his breath. \u201cYou gave us 25 million dollars to create a system capable of cutting annual US tornado fatalities in half. We spent a year teaching STORMY everything we knew about tornadoes. Every statistic, every news item, every paper ever published on the subject we fed him, and we gave him the power to set up his own PERT charts and plan his own project. Umm…I preauthorized him to cut purchase orders for items under $2000.\u201d<\/p>\n

\u201cWhich he did. 18,000 times. For beat-up, rotted-out, abandoned house trailers. Which he then delivered to an abandoned military base in west Nebraska a zillion miles from nowhere. And why, pray tell?\u201d<\/p>\n

Petter keyed in the question on the wireless terminal he had brought from his office. STORMY\u2019s answer was immediate:<\/p>\n

TO KEEP TORNADOES FROM KILLING PEOPLE.<\/p>\n

Petter turned the portable terminal around so that the Senator could see it. A long pause ensued.<\/p>\n

Ruesome puffed out his red cheeks. \u201cMr. Petter, be at my office at 8:00 sharp tomorrow. We\u2019re going to Nebraska.\u201d<\/p>\n

The two men climbed out of the Jeep onto scrubby grass. It was July-muggy, and it smelled like rain. Petter gripped his palmheld cellular remote terminal in one hand, and that hand was shaking.<\/p>\n

Before them on the plain lay an enormous squat pyramid nine layers high, built entirely of discolored white and pastel boxes made out of corrugated aluminum and stick pine, some with wheels, most without. The four-paned windows looked disturbingly like crossed-out cartoon eyes. Petter counted trailers around the rim of the pyramid, and a quick mental estimate indicated that they were all in there, all 18,000 of them.<\/p>\n

A cold wind was blowing in from the southeast.<\/p>\n

\u201cWell, here\u2019s the trailers. Ask your software expert what made him think stacking old trailers in the butt end of nowhere would save lives.\u201d<\/p>\n

Lightning flashed in the north. The sky was darkening; a storm was definitely coming in. Petter propped the wireless terminal on the Jeep\u2019s fender and dutifully keyed in the question. The cellular link to STORMY in Washington was marginal, but it held:<\/p>\n

TORNADOES ALWAYS SEEM TO STRIKE PLACES WHERE THERE ARE LOTS OF MOBILE HOMES.<\/p>\n

Petter read the answer for the Senator. Ruesome groaned and kicked the Jeep hard with his pointed alligator boot. \u201cGoldurn it, son, you call this \u2018artificial intelligence?\u2019 That silly damfool program bought up all the cheap trailers it could find and stacked them in Nebraska to get them away from tornadoes in the midwest. Makes sense, right? To a program, right? Save people who don\u2019t live in empty trailers, right?\u201d<\/p>\n

The force of the wind abruptly doubled. Lightning flashed all around them, and huge thunderheads were rolling in from all points of the compass. Petter could hear the wind howling through cavities between the trailers.<\/p>\n

\u201cI\u2019m sorry, Senator!\u201d Petter shouted over the wind.<\/p>\n

But Ruesome wasn\u2019t listening. He was looking to the west, where a steel-grey tentacle had descended from the sky, twisting and twitching until it touched the ground. Petter looked south\u2014and saw two more funnel clouds appear like twins to stab at the earth.<\/p>\n

The programmer spun around. On every side, tornadoes were appearing amidst the roiling clouds, first five, then a dozen, and suddenly too many to count, all heading in defiance of the wind right toward them. The noise was deafening\u2014and Petter could now feel through the soles of his feet that unmistakable freight-train rumble of the killer twisters.<\/p>\n

Petter had felt all along that he had never quite asked STORMY the right question. Now, suddenly, the question was plain, and he hammered it into the terminal with shaking fingers:<\/p>\n

STORMY: FOR WHAT PURPOSE DID YOU BUY ALL THESE TRAILERS?<\/p>\n

The answer came back as a single word:<\/p>\n

BAIT.<\/p>\n

The winds were blowing him to the ground. Petter dropped the terminal and grabbed the Senator by the arm, pulling him toward a nearby culvert where the road crossed a dry creekbed. He shoved the obese man into one three-foot drainpipe, then threw himself into the other.<\/p>\n

A moment later, the tornadoes converged on the trailers, all at once. The sound was terrifying. Petter fainted.<\/p>\n

Both men lived. Local legend holds that it rained corrugated aluminum in Nebraska for several weeks.<\/p>\n

And it was years <\/i>before another tornado was seen anywhere in the USA.<\/p>\n","protected":false},"excerpt":{"rendered":"

I follow the AI discussion to some extent (as time permits, which it hasn\u2019t lately) and from initial amusement it\u2019s pivoted to apprehension and doom-kvetching, as if we didn\u2019t get a bellyful of doom-kvetching as COVID passed through. The AIs I\u2019ve played with have had peculiar failure modes, among them expressing that 128-bit registers are […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[118,257,142],"class_list":["post-4972","post","type-post","status-publish","format-standard","hentry","category-noneoftheabove","tag-ai","tag-satire","tag-sff"],"_links":{"self":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/4972","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4972"}],"version-history":[{"count":1,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/4972\/revisions"}],"predecessor-version":[{"id":4973,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=\/wp\/v2\/posts\/4972\/revisions\/4973"}],"wp:attachment":[{"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4972"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4972"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.contrapositivediary.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4972"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}