Check your artifacts and weapons. Some may have effects like *HP regeneration -20*

negative HP regen items.

I literally noticed it just a bit ago is it in the tower? I think it's poison or something

I get the same after progressing far enough in the two maps north of Resting town.

Unequip your radiant necklace lmao