Police said Kelly drove to the Sheriff's Office and handed detectives a clear, crystal-like substance wrapped in aluminum foil.
The field test proved it was methamphetamine, the drug Kelly had hoped to purchase.
Kelly was arrested and charged with possession of methamphetamine.
He is held in jail in lieu of $5,000 bail.
"Remember, our detectives are always ready to assist anyone who believes they were misled in their illegal drug purchase," the Putnam County sheriff's department stated on Facebook.