As someone who is deeply disturbed by deep learning, I appreciate everything you wrote about KANs.
I am even more interested in Active Learning, as exemplified by work based on Karl Friston's free energy principle, such as being done by VERSES. It seems to have all the advantages you promote, with the complexity built into the network as in a brain.