This was so cool to read.
"Most things are. At least you can describe it by maths. You just do not know the variables and the rules... and even if you figure out the rules, there might be some things missing, even if the rules you figured out are good enough for most cases"
I noticed this and it's wild. Just when you think you've got the rules down, something else pops up. It's a little weird, to be honest. In my mind, the rules are the structure but that isn't always true here.
"Sounds to me, your epiphany was discovering how a math operation that is fundamental for neural networks actually worked and does something. Must have been thrilling."
Thrilling indeed! But more akin to paradigm-shifting. After 30 years of psychology and philosophy, to inject the higher mathematics now... It was quite an experience and I am a little embarrassed to say this but the implications brought me to tears. It was beautiful and terrifying at the same time. Because it wasn't just like storing knowledge in the brain. It was integrated and distributed throughout my general understanding.
I once saw a Joe Rogan podcast where two very different mathematicians were debating and one cautioned the other saying something to the effect of "Math at this level can be like a drug" and I understand what he meant by that now. And why he said it in such a manner.
So personally, I have come to the conclusion that I need to go backwards--not continue forwards--and make sure I have not jumped ahead too far.
But I will say this part from both experience and observation: the term "lazy" is far too loose here.
There is laziness and then there is efficiency. Many have heard the saying "work smarter, not harder". While the merits of such a concept are up for debate, what cannot be denied is that this sentiment runs the modern world. For example, I struggle to see the difference between a boss/manager/director delegating tasks and a fluent Python coder using AI to belt out code and reviewing it manually before implementation. Is the delegate lazy? Sure, sometimes. But just as often, it is a matter of speed, efficiency, and the stability of a complex orchestration of separate tasks that no one man can do alone... Until now.
In my own observation, AI in it's current state is a frontier. Instead of covered wagons and mining picks, it is open to individual explorers... for now.
The potential is too great, this will eventually consolidate into certain hands. At that time, this frontier for independents may close forever.





