Yoga can be inexpensive, in the sense that it doesn't require a lot of materials to get started. Here's a small list of what to start with:
Also, you might want these