Are pacifiers bad for the teeth?

My Dr. said that I have to take away pacifier from my 15 month old cold turkey. She was hysterical for an hour and would not go to sleep without it. So I gave up. Is it really that bad? He said she will have problems with her teeth.