You may be on to something. The way I was taught to do math was very much like the way Victorian public schools apparently worked--lots of memorization, very little explanation. The only higher math I've really retained involves the X/Y axis, which I had taught to me several times until the correlation between the formula and the placement of points on the grid finally clicked.

I still can't remember left from right immediately, though.