Am I wrong or is my mom being unfair?

I think you do have a point and your mom is wrong, but you should at least try to have a simple conversation about it with your mom and your brother at least once before you get too worried about how she doesn't listen to you, but you do have every right to feel this way. My mom acts the same way sometimes.