Be brave.  It may be scary at first to stand up for yourself, but it will pay off in the end when you feel more comfortable in your relation