Cavemen are actually mentioned in the Bible. The OP is right. Cavemen were actually once men who came from great civilizations, but since they
pushed the Law of God aside, He took away their earthly treasures.
Job 12:23-25(KJV)
23He increaseth the nations, and destroyeth them: he enlargeth the nations, and straiteneth them again.
24He taketh away the heart of the chief of the people of the earth, and causeth them to wander in a wilderness where there is no way.
25They grope in the dark without light, and he maketh them to stagger like a drunken man.
Job 30:3-8(KJV)
3For want and famine they were solitary; fleeing into the wilderness in former time desolate and waste.
4Who cut up mallows by the bushes, and juniper roots for their meat.
5They were driven forth from among men, (they cried after them as after a thief
6To dwell in the cliffs of the valleys, in caves of the earth, and in the rocks.
7Among the bushes they brayed; under the nettles they were gathered together.
8They were children of fools, yea, children of base men: they were viler than the earth.