There was no background radioactive cesium before above-ground nuclear testing and nuclear accidents started.
Wikipedia provides some details on the distribution of cesium-137 due to human activities:
Small amounts of caesium-134 and caesium-137 were released into the environment during nearly all nuclear weapon tests and some nuclear accidents, most notably the Chernobyl disaster.
Caesium-137 is unique in that it is totally anthropogenic. Unlike most other radioisotopes, caesium-137 is not produced from its non-radioactive isotope, but from uranium. It did not occur in nature before nuclear weapons testing began. By observing the characteristic gamma rays emitted by this isotope, it is possible to determine whether the contents of a given sealed container were made before or after the advent of atomic bomb explosions. This procedure has been used by researchers to check the authenticity of certain rare wines, most notably the purported “Jefferson bottles”.
As the EPA notes:
Cesium-133 is the only naturally occurring isotope and is non-radioactive; all other isotopes, including cesium-137, are produced by human activity.
What people call “background” radiation is really the amount of radiation deposited into the environment within the last 100 years from nuclear tests and nuclear accidents (and naturally-occurring substances, such as radon).
2,053 nuclear tests occurred between 1945 and 1998: