In my opinion, it would not be crazy.
Massive amounts of people believe in God, afterlife, soul, which are emotionally heavier concepts. Many people are aware of how body organs relates to emotions, for example, heart, which they relate to romantic feelings, liver, which they relate to bile’ish person who is irritable. Traditional Chinese Medicine, which at the core deals with “energy”, at least in China, is mainstream.
Thus, energy centers would be just another element of the body.
Maybe I misunderstood, but Ra explicitly says that adjusting the mind is needed to adjusting the chakras.