Your body is pretty smart. It identifies a lack of nutrition in your diet, ie not enough protein for you to work out, and causes you to crave those things to replenish itself.
Your particular problem, if you still want to be a vegetarian, can be managed by, obviously, eating more protein. You can try nuts, cereals, lentils, beans. Some vegetarians I know eat eggs.
Of course, if you want to get buff quick, a balanced diet of carbs, proteins and fats will most efficiently give you the best results.