Can I trust the numbers?

AI in structural engineering: Week 1, lesson 2 of 3

A chat AI writes its answer by predicting likely words, so it can sound certain and still be wrong without telling you it guessed. Its confidence comes from fluent wording, not from checking the numbers.

How a chat AI writes an answer

A chat AI doesn't look up an answer and doesn't run a calculation. It writes one word at a time, each time choosing a likely next word based on the text it learned from.

Most general AI tools don't have the code text either, unless you paste it in. Ask about a clause and the answer comes from memory, which can mean a real-looking section number that is wrong when you look it up.

That is why it is good with text. Drafting an RFI response, summarizing a report and turning notes into action items all reward fluent, likely wording. A number is different: the likely-looking number and the right number are not the same thing.

Why the tone never changes

A chat AI writes a wrong answer in the same calm, certain voice as a right one. Nothing in the wording tells you which is which.

It also won't tell you when it filled a gap with a guess. Ask it to list its assumptions, and you can see the guesses before they reach your calculation.

What to do with its numbers

Use AI to set up a problem. Run the numbers where you can see the working.

  • Ask it for the checks and the inputs, not the final values.
  • Ask it to list every assumption it made.
  • Run the key numbers through a calculator that shows its working.
  • Treat any number with no working behind it as unchecked.

Try it

Ask an AI tool a structural question you already know the answer to. Notice how sure it sounds, then check its answer against your own.

Your first good prompt

Free, with one short email a week.

Linking a calculation to a column in Calcs.com, with the AISC Steel Construction Manual reference attached

We use analytics cookies to understand how you use this site and improve our content. See our privacy policy and cookie policy for details.