A bakery in downtown New Albany will close its doors this spring, citing rising costs of product, utilities and labor.