This article was published in Scientific American’s former blog network and reflects the views of the author, not necessarily those of Scientific American
Pedro Ferreira's book "The Perfect Theory: A Century of Geniuses and the Battle over General Relativity" essentially tells us what other people did with Einstein's general theory of relativity after he developed it. While one chapter is devoted to Einstein's hard struggle with learning the non-Riemannian geometry and building the field equations that define the theory, the book really takes off after 1917 when a series of men and women discovered the awesome implications of these equations. The book is a fast read and it does a very good job portraying the colorful personalities and exciting discoveries unearthed by general relativity.
By 1919 the theory had been well-established as part of the scientific enterprise, especially after it retrodicted the correct value of the perihelion of mercury and predicted the bending of starlight observed by Arthur Eddington, a discovery that splashed Einstein's name on the front pages of the world's leading newspapers. Eddington was Einstein's heir, thoroughly learning the theory and grasping its implications for stellar structure. Ironically he did not dare to take these implications to their logical conclusion. That task was left to a young Indian astrophysicist named Subrahmanyan Chandrasekhar who paved the way toward the discovery of black holes by considering what happens when stars run out of fuel and collapse under gravitational contraction. Famously Eddington rebuked Chandrasekhar's findings and revealed himself to be much like Einstein, a revolutionary in young age and a reactionary in old age.
The story of black holes is one important thread that the book follows. Chandrasekhar's ideas were further developed by Lev Landau, Fritz Zwicky and Robert Oppenheimer in the 30s. Oppenheimer's story is especially interesting since he was the one who theoretically discovered black holes but later completely dissociated himself from them, showing no interest in general relativity until the end of his life. In fact Oppenheimer's view of relativity was similar to that of the vast majority of physicists who were caught up in the revolutions in nuclear and quantum physics in the 30s and 40s. Quantum mechanics and particle physics were the new frontiers; relativity was a speculative backwater.
On supporting science journalism
If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.
It was the eminent Princeton University physicist John Wheeler who picked up where Oppenheimer had left off. Wheeler is really the father of modern relativity since he was the one who rejuvenated interest in the topic in the 50s and 60s. Many of his students like Jacob Bekenstein and Kip Thorne became leaders in the field. In Britain the field was fathered by Dennis Sciama, whose students Roger Penrose and Stephen Hawking led the way in understanding singularities and the Big Bang. Hawking especially forged a very important link between information, relativity, thermodynamics and quantum mechanics through his exploration of what we now call the "black hole information paradox".
Hawking's work on singularities connects to the second major thread of the book, this time involving the applications of general relativity to the entire universe. The story begins right after Einstein developed his framework when Russian bomber pilot Alexander Friedmann and Belgian priest Georges Lemaitre found out that one of the solutions of the equations would be an expanding universe. In a famous mistake which Einstein called "the greatest blunder of my life", Einstein had found this solution but, based on the observation of a locally static universe, had applied a fudge factor - a "cosmological constant"- to halt the expansion which turned out to have great significance almost eight decades later. Lemaitre and Friedmann's story logically leads to that of Edwin Hubble who in 1929 observed the redshifting of galaxies, thereby inaugurating one of the great eras in the exploration of the cosmos. This era culminated in the discovery of dark matter and dark energy and the transformation of cosmology into a precision science, all of which has opened up frontiers undreamt of by Einstein. And Ferreira hopes there's much more in store than can flow from those beautiful equations.
Ferreira is quite adept at describing these two main threads. One of the most important aspects of the development of relativity was the shot in the arm which the theory received from experimental observations of distant objects by radio telescopes made by Martin Ryle, Jocelyn Bell and others. In fact the book underscores the fact that without these observations relativity would have continued to be considered mathematical doodling at worst and speculative science at best. The grounding of relativity in the real world through the discoveries of quasars, pulsars, neutron stars and black holes makes the paramount significance of experimental evidence in lending respectability to a theory quite clear. Personally I would have appreciated it if Ferreira had also considered some other evidence for general relativity, such as the observation of frame-dragging by Gravity Probe B, a technical marvel and a jaw-dropping exercise in accurate measurement if there ever was one.
The last part of the book concerns the quest over the last four decades to combine general relativity with quantum mechanics, an effort that was started by Wheeler and his student Bryce DeWitt in the 60s. The same techniques of field theory that led to such spectacular successes in particle physics - culminating in the Standard Model - failed abysmally when applied to relativity. One possible way out is string theory whose virtue is that gravity emerges naturally from the theoretical framework. Another promising framework is loop quantum gravity. The problem with string theory, as well known by now, is that it makes no testable predictions and its solution space is so vast that virtually anything can be accommodated in its expansive embrace. In science, a theory that can explain anything and everything is usually considered a theory that can explain nothing.
One thing that again struck me is how important experiment and observation are for actually taking a theory from a realm of fanciful speculation to hard reality. It's worth comparing the progress of quantum mechanics, general relativity and string theory in this context. Quantum mechanics was developed in the 1920s and immediately explained scores of previously confusing experimental facts. Its success only grew in the 30s and 40s as it was applied to solid-state physics, chemistry and nuclear physics, always amply supported by experiment. The philosophical conundrums in the theory - which we still struggle with - did not harm the theory because of its great experimental success. In contrast, general relativity was developed about ten years earlier. By 1940 or so it had two major experimental predictions to its credit: the bending of starlight and the expansion of the universe. But even by the late 1950s it had not become part of mainstream physics and was considered more mathematics than physics, mainly because the experimental evidence was lacking. As mentioned above, it was only the development of radio astronomy that really put the whole framework on a firm pedestal.
Thus it took quantum mechanics no time at all and relativity almost forty years to become respectable, even when there were two astonishing experimental observations which the latter had successfully predicted. The great difference was the experimental evidence, copious in case of the former and spotty and only slowly emerging in case of the latter. Compared to this, string theory has been around for about forty years and there is still no unambiguous experimental evidence in its favor. Purely on a historical basis this might hint that it may be on the wrong track. There's a reason why Feynman said that the only true test of a scientific theory is experiment.