Is it weird to spend 6 years at a community college?

It's unusual to spend that much time at a community college, though if you have a clear career pursuit in studying physics, it is totally justified to do so. As long as you have a good setup to get into a decent graduate program, you're in good shape.