LOUISVILLE, Ky. (WDRB) -- The senior pastor of Bardstown Baptist Church has been using credit cards to make over $80,000 worth of unauthorized purchases, according to a news release from the Bardstown Police Department.

Police say that on Oct. 20, church administrators contacted Bardstown Police, concerned after they discovered the purchases. Twelve days later, police executed a search warrant at the Bardstown home of Dylan Mays, the senior pastor of the church. While inside the home, which is located on Rosewood Drive, near the intersection of Pioneer Pass and Cathedral Manor, police say they seized 23 firearms, a large amount of ammunition, police radios, electronic equipment and other items.

According to the news release, the investigation revealed that Mays used the credit cards to purchase numerous firearms, including hand guns and long guns. He also allegedly purchased firearms accessories, iPhones, computers, ammunition and tools.

Police say all of these items were purchased "on behalf of the church," and the amount of the purchases exceeded $80,000.

On Wednesday, Nov. 20, a grand jury indicted Mays on unspecified charges.

Police say Mays is not in custody at this time.

As of Nov. 21, Mays' photo had been removed from the church's Web site. The site stated that, "Rev. Dylan Mays has resigned to pursue other opportunities. We will soon be seeking his replacement. Please keep Dylan and the Mays family in your prayer."

If anyone has any information on the case, they are asked to call the Bardstown Police Department at (502) 348-6811 or Nelson County Dispatch at (502) 348-3211.

Copyright 2013 by WDRB News. All rights reserved.