Counties were changed and added frequently over the years. The Georgia County Maps: Interactive History Complete List can help make sense of where your ancestors lived, when. They may have lived in 3 different counties, but never moved from their home.
The FamilySearch Wiki has links to a number of Fayette Co, Georgia documents that can be found online.
Documents are available from these counties in Georgia: