Deputies said Caster left the restaurant on a bicycle before being arrested.
Officials said that while searching Caster, they found a stainless-steel pan filled with cobbler, a lava cake and a large tub of vanilla ice cream on his person.
The items stolen from the restaurant were worth almost $200, a report said.
Deputies said Caster had been arrested for theft several times in the past.
Click here to download the free WFTV news and weather apps, and click here to watch the latest news on your Smart TV.
Florida man accused of drunkenly berating random children at beach Stephen Joye was arrested on his 34th birthday and charged with causing a public disturbance. (NCD)