LOUISVILLE, Ky. (WDRB) -- They're elderly, low-income and some have mental delays -- and they're the collateral damage in a property owner's fight with the city of Jeffersonville.

Earlier this week, we told you about Riverside Meadows and how its 11 residents might lose their homes. On Friday, we learned that forced relocation is one step closer to reality.

Resident Darrenda Stepro says she doesn't know where she's going to go. 

"I really couldn't tell you, I really couldn't tell you," she said. 

Stepro's worst fear lingers dangerously close to reality. Riverside Meadows lost its zoning appeal with the city of Jeffersonville, meaning residents of the shared living facility must move out. The city says the property owners moved Stepro and 10 others in illegally after their first zoning application was denied last year.

"It's been very frustrating that we have a property owner who doesn't seem to have much respect for the local zoning laws," said Les Merkley, the Jeffersonville city attorney.

The building used to house nuns for St. Augustine's Catholic Church, which is right across the street. Part of the owner's argument is that if it was good enough for the church in the early 1900s, then it should be good enough for them today.

While the building hasn't changed, the city says the neighborhood and zoning laws have. It's now permitted for four people -- or a duplex -- but that takes renovation.

Riverside Meadows leaders are telling residents not to pack up just yet. They may consider a lawsuit.

"I don't think Shawn Zamir had a fair hearing, and I feel the people on the [zoning] board had been contacted in advance and probably should have recused themselves," said Jack Vissing, attorney for Riverside Meadows.

Neighbors like Pat Vissing did fight to block Riverside Meadows' permit, citing prior problems the owner had at an assisted living home he operated a few blocks away.  "It had as many as four or five calls per month with police and ambulances and residents had no heat," Pat Vissing said.

"Those people have a right to live someplace but they need to be in a facility that I believe is more stable," he added.

The owners claim a business partner failed to fix the building and they started Riverside Meadows to branch out on their own. Zamir is now being sued for $200,000 in unpaid rent.

"The city is in discussion with Adult Protective Services to see whether we can obtain other options for their living," said Merkley.

And as far as Stepro is concerned, a struggle that's not her fault is very much her problem.

"I need people around me," Stepro said. "I don't like being alone by myself."

"I'm very upset about it," she added.

Merkley said if residents don't move, Jeffersonville will fine Riverside Meadows up to $1,500 a month and if that doesn't work, the city will seek an eviction order from the court.

Copyright 2014 by WDRB News. All rights reserved.