3

What you've described is a very serious carbon monoxide hazard called chimney backdraft.
You likely need to explicitly provide a fresh air intake so that chimney stack can work properly.
That water heater room needs non-blockable fresh air source year-round ASAP. Two 4-inch holes or one 6-inch ho...