If you think it is possible to produce a quality camera bag in America, and be able to make enough money to pay your taxes (tax is the largest expense for American and Japanese companies, BTW, not executive pay) overhead, payroll, etc. and make enough money to support your family afterward, then you should do it. Done properly, it is certainly possible.
Here in Japan F64 is a popular bag which is made in the USA. These are simple nylon bags, not at all expensive, but they are very popular, particularly with Chinese tourists, who, ironically enough, refuse to purchase Chinese goods.
For myself, I buy only goods which are made in Japan, America, or Europe. Not a single piece of my clothing nor pair of my shoes is made in China, or other place in Asia. I bought my Fuji X-Pro because it was made in Japan, just as my LX5 was.
I am a part-time teacher myself, working at an international university here in Tokyo. But teacher's pay is not so great, so I work at home as a financial consultant, which pays significantly better. I also export various Japanese goods, and this also provides me with income. Some might say that what I do to make extra money is simply business, and not art, but I would disagree, it has taken a lot of creative thinking and discipline for me to get these things started, and to keep them going. But, I am now relatively independent, and I can't bitch about my pay, I can make as much as I want if I put in the thought and effort. Anyone can.