The Radiocarbon Dating Project published by Mark Lehner leaves absolutely no doubt about the dating of Khufu's pyramid to the Fourth Dynasty. The only range we find in the datings is attributable to the use of "old wood" in various places, and that "old wood" is no more than a few hundred years off.
You will find a summary of the report here: [
www.archaeology.org]
Lehner's write up is here: [
www.aeraweb.org]
You have also erred in your representation that the only thing linking Khufu to the pyramid is a single reference. There are multiple references in the tombs surrounding the pyramid that make it quite clear the pyramid and temples belonged to Khufu. There is, of course, the inscription inside the pyramid itself (in the relieving chamber) that clearly states the pyramid workers were working on a project for Khnum-Khuf/Khufu, and we have a similar inscription dating to Dynasty IV in the Sinai that credit Khnum-Khuf for excavations there. The script is unmistakably Dynasty IV in nature, and the location secures the provenance in a way that cannot leave doubt.
Two thousand years after Khufu, the pyramid was still being solidly attributed to him by the priests that were on site and could read the inscriptions on the walls. In fact, this particular textual reference is the first one we find in modern records, but is entirely and unerringly supported by the other evidence I have quoted above.
In all, there is no room for any other attribution of the pyramid. It was built in its entirety by King Khufu during the Fourth Dynasty for his use as an edifice for holding his mummy for (hopefully) all eternity. There is a mountain of evidence larger than the pyramid itself that you would have to overcome if you ever wanted to rip his achievement away from him.
Anthony
You can lead a horse to water but you can't make him think.