Don't put yoga in a box. Sport. Meditation. Whatever. It's not the point.
There are two major areas of controversy with respect to the practice of yoga: 1. Is it a sport? 2. Is it religiously affiliated? We'll leave the second question for now and tackle the first.
