There's multiple reasons for me and my family.
As for me personally, I had a cancer-removal surgery a couple years ago. As a result of the surgery, I have a weaker immune system than normal and I was told specifically not to get the vaccine. I have a doctor's appointment tomorrow to get the formal medical exemption form filled out.
As for my family members, my sister technically has a government job as a receptionist in a government-run rehab clinic. She was forced to get the vaccine. Shortly after getting the first dose, she started having serious heart issues. As in, having to carry a heart monitor with her everywhere she went for several days. She had never had heart issues before, and they would have come up in the full-body medical scans she had gotten previously for an unrelated condition. (spine issue) On top of that, the typical worst-case side effects hit her and she was bedridden for a while. We had no idea any of this would have happened to her, and in hindsight, getting the vaccine in her case seems to one of the worst things she could have done.
My mother in particular already has heart issues. These are physical issues, not hereditary, so they have nothing to do with my sister's reaction to the vaccine. If my mother has the same or similar reaction to the vaccine as my sister did, chances are incredibly likely that she won't survive.
My grandmother used to work in the local hospital. She's close friends with a majority of the doctors and nurses who still work there. A large number of them are apparently saying that they would rather quit their jobs than be forced to take the vaccine. This makes my grandparents a bit suspicious. After all, everybody's saying listen to the experts, and a majority of the local experts do not want the vaccine.
So yeah, in my case it's a combination of directly told by a doctor (Regardless of what you think of the other reasoning I've posted, I have a damned good reason to listen to my own doctor directly), immediate anecdotal evidence courtesy of my sister, second-hand verification from my grandmother's former co-workers, as well as the addition of what could possibly happen to her in my mother's case.