Kenneth Stanley: Novelty Search a weapon against the status quo; Artificial Intelligence Researcher

About this episode

Vance interviews Dr. Kenneth Stanley, an AI researcher now at OpenAI (formerly University of Central Florida) whose book "Why Greatness Cannot Be Planned" Vance credits with reshaping his own career trajectory at Monsanto. Stanley unpacks "novelty search" — an algorithmic and philosophical principle that ambitious, never-before-achieved goals are best reached not by pursuing them directly but by continually seeking whatever is most different/interesting, because the true stepping stones toward breakthrough discoveries (vacuum tubes leading to computers, bilateral symmetry in flatworms leading eventually to human intelligence) rarely resemble the destination and are actively "deceptive" if approached with fixed objectives. Vance shares how he weaponized this idea inside a "totally embattled" Monsanto to justify a Reddit AMA that outperformed a Super Bowl ad, framing the book explicitly as "a weapon... against the status quo" of metric-driven institutional culture. The conversation ranges into AI risk (near-term economic displacement more worrying than "Terminator" scenarios, exponential growth's deceptive suddenness), AI's potential to convert people's implicit taste into explicit creative output, subjective vs. objective ways of perceiving space and memory, and closes on parenting-as-novelty-search and a full-throated argument that standardized testing structurally destroys the diversity and stepping-stone communication needed to fix education, since "all hard problems are deceptive" by definition.

“Novelty search was about a realization... that sometimes the best way to achieve something is to not be trying to achieve it.”

“Standardized... tells you it's just not diverse. It's the exact opposite. There are no stepping stones in that world. Everybody is lockstep on the exact same road at the exact same time... We will never solve the problem.”

“That book gave me a language to be able to describe to a scientific business community why we should try these things... I was able to do things that they never would've let me do had I not had the language of that book.”

Key moments

• ~4%: Core definition — "sometimes the best way to achieve something is to not be trying to achieve it," illustrated with robot-walking experiments and vacuum-tube-to-computer history.
• ~13%: Evolution analogy — ancient flatworm bilateral symmetry as an unpredictable stepping stone toward human intelligence; "you needed bilateral symmetry to get Shakespeare."
• ~22%: The book as "a weapon" against an objective-driven status quo — written deliberately un-marketable/uncompromised rather than watered down for mainstream publishers.
• ~26%: Vance's Monsanto Reddit AMA story — using novelty-search framing to justify an unconventional PR move that beat a Super Bowl ad's engagement.
• ~36%: AI risk discussion — economic/job displacement as the nearer-term danger versus speculative "Terminator" scenarios; exponential growth's "glass half full" suddenness problem.
• ~43%: AI's potential to convert implicit aesthetic judgment into explicit creative output — "hum a tune... it'll give you the whole band."
• ~46%: Hung-in-there-kitty vs. abstract art study — explaining your choice changes long-term preference and attachment.
• ~50%: Subjective vs. objective spatial memory — Stanley draws rooms from a first-person "walked-through" view rather than blueprint/overhead, surprising Vance.
• ~72%: Parenthood as lived novelty search — presence over distraction, and innate but delayed traits like smiling and a sense of humor.

Notable quotes

“Standardized... there are no stepping stones in that world. Everybody is lockstep on the exact same road at the exact same time... We will never solve the problem.”

“If the world thinks that you are North Korea, then you don't have to pay to get on stages... we've got lots of questions for you.”

“Sometimes the best way to achieve something is to not be trying to achieve it.”

“The book is supposed to be a weapon to argue against the status quo.”