An investigation is underway after a woman died while in custody at the Jefferson County Jail in Indiana.