The question of whether language affects perception has been debated largely on the basis of cross-language data, without considering the functional organization of the brain. The nature of this neural organization predicts that, if language affects perception, it should do so more in the right visual field than in the left visual field, an idea unexamined in the debate. Here, we find support for this proposal in lateralized color discrimination tasks. Reaction times to targets in the right visual field were faster when the target and distractor colors had different names; in contrast, reaction times to targets in the left visual field were not affected by the names of the target and distractor colors. Moreover, this pattern was disrupted when participants performed a secondary task that engaged verbal working memory but not a task making comparable demands on spatial working memory. It appears that people view the right (but not the left) half of their visual world through the lens of their native language, providing an unexpected resolution to the language-and-thought debate.