The Ozark National Forest isn't too far, also along the Buffalo National River appears to have a number of old homsteads, a church, cemetery or two. There are campgrounds all along the river but I have found at least one dispersed camp ground so I imagine there may be others.
Places To Go - Buffalo National River (U.S. National Park Service)
Around Erbie also looks interesting, with a couple of miles you have two old homesteads, a cemetery, 3 water crossings, a dispersed campsite and an old community church.
I would like to make my way that direction someday. It seems Arkansas likes to protect the old homesteads and churches and such and I enjoy that kind of thing, (my event page, A back road tour of Oklahoma's forgotten history)
Day of Dirt Adventure