Don't Trust Your Gut: Using Data to Get What You Really Want in Life: Summary & Key Insights

We like to imagine that intuition is a form of wisdom—that spontaneous, unspoken understanding that cuts through complexity. But when we look at data on human decision-making, intuition is rarely a reliable guide. Behavioral science shows again and again that our mental heuristics evolved for survival, not for modern complexity. We overestimate our own judgment, fall prey to confirmation bias, and remember outliers because they make better stories. The gut tells compelling tales, but they’re often wrong.

Consider economics or romance. People trust their feelings when buying homes or choosing partners, yet the numbers show these decisions are riddled with predictable biases. We assume we’ll be happier moving to a bigger house, but longitudinal studies say the initial excitement fades while commuting stress compounds. Likewise, people insist they’ll know their soulmate at first sight, but massive dating platform data reveals that lasting compatibility depends far more on patterns of daily kindness and emotional regulation than on sparks of attraction.

I don’t argue that intuition should vanish; rather, it must be put in perspective. Gut instinct can be good at sensing when something feels off, but not at calculating trade-offs or predicting happiness over time. In one sense, your instincts are data too—small samples from your personal experience. But the vast datasets now available allow us to check whether that small sample aligns with the larger human experience. And more often than not, the aggregate disproves the anecdote.

Once you start seeing your life decisions as experiments, you realize that intuition is just the first hypothesis. Data is the test. And reality—that’s what wins the argument.

Data has a power that stories alone lack: it reflects people as they are, not as they wish to appear. When you analyze anonymized web searches, survey data, or behavior from tens of millions of users, you glimpse the true impulses of humanity. People might tell pollsters they don’t care about status, but their clicks and purchases reveal otherwise. They say they value family time, yet their digital trails show hours of consumption and distraction.

In my earlier work, I explored what search data could say about our hidden selves. What impressed me most was the gap between public behavior and private truth. People often hide their doubts, desires, and mistakes because society rewards appearances. Yet data captures those unfiltered moments. When aggregated, those moments tell us not only who we are but what truly moves us.

This mirror can be uncomfortable. But it’s also liberating, because it frees us from myths. It helps us see that our struggles aren’t unique, that our biases and dreams fit within patterns as old as civilization. Once you embrace data not as cold abstraction but as an x-ray of human emotion, empathy expands. You realize every chart represents countless small acts of hope and confusion—the same ones shaping your own choices every day.