SecondSourceJudgment rebuilt from primary sources

Today · post October 12

Perplexity's grep tops semantic search; it's self-reported

Perplexity CEO Aravind Srinivas says AI agents that look things up with the most basic file-listing and text-search commands answered 63% of questions correctly on the company's financial-document test, against 37% with semantic search. Perplexity is an AI search company. The agents here are AI that find information and read files on a user's behalf. He wrote: "Agents search with plain `ls` and `grep`. That beats semantic search 63% vs 37%" (Aravind Srinivas, 2026-10-12; Perplexity blog). `ls` lists files, and `grep` searches text for literal matches. Semantic search instead turns text into a string of numbers and finds passages with similar meaning. The 63% versus 37% comes from Perplexity's own financial documents. We didn't read how the semantic-search setup was configured, so this isn't necessarily a verdict on the two methods themselves. Results may differ on other kinds of data. How we checked →

Concept illustration: two open laptops sit side by side on a desk. The left screen shows a vertical list of grey bars with one row highlighted, and the right screen shows three clusters of circles joined by lines, each linked to a few short grey lines. Both screens have a speech-bubble icon in the top-right corner, and an open red ring binder with pages of tables lies in front of them. On the wall at upper right are a teal geometric symbol and the lettering PERPLEXITY; a pen cup and books are on the left of the desk, a stack of books is on the right, and the back of a dark chair is in the foreground.

Source and checks

This item ran in the brief of Oct 13, 2026, alongside 13 other items. How we checked it, the quote checks and what was still missing that day are on that issue's How we checked page.

Cite this item

SecondSource (2026). "Perplexity's grep tops semantic search; it's self-reported." https://secondsource.io/en/product/2026-10-13-1/. Accessed access date.