Automation Without Understanding

AIs should be forced to show their work. Every tool they use, every program they generate and run in the background, and every logical inference. They should be forced to produce Lean or Rocq proofs or execution traces for all the computation they use. For facts, they should be able to produce sources. For any abstract reasoning, they should be able to break it down into explainable steps.

Then, on top of that, they should be able to explain any of that, at any level of detail, whether talking to an expert or a layperson.

Yeah how many of us know how to build an ICE engine or shoes of any meaningful quality

We set upon end of human craftsmanship decades ago

Math is probably the easiest to reclaim given its right in front our faces going about daily life. The syntax of math is not that important; real world quantification the syntax is meant to represent will still exist. Our biochemistry implicitly operates on senses of enough food and water, etc.

Such measures are so embedded in the daily routines we live an intuition will always exist

No one is born knowing how to make a computer as we know them today. A cup half filled is obvious

I'm not exactly sure how you would go about grading mathematical proficiency. I went through calculus two and discrete mathematics, but I'm sure that there are things I have forgotten now even though I would be considered familiar with most leading edge AI technology. If I'm being honest, I'm not sure I could pass the final exams I took to get my CS degree right now.

"Civilization advances by extending the number of important operations which we can perform without thinking about them." - A. N. Whitehead