THE HYPE KEVIN / FIELD NOTESWatch the video

ENGINE NOTES / OCTOBER 19, 2026

Perplexity

Search returns page content within a token budget; the coding jobs used a plain HTTP fetch to open pages.

No free API tier listed

48 questions, one search each

One search per question
EngineVersions / 30This week / 10Traps / 8Total / 48Median secondsMedian tokensUS$ / 1,000
Perplexity1997350.361,243$5.00

Three coding jobs

Three coding jobs, three runs each
EngineTests passed / 66Median seconds per jobMedian page tokens in contextUS$ web calls per job
Perplexity6625.28,015$0.0067

Every question

Open a cell to read its ranked results. Right and wrong refer to the agent’s answer.
QuestionPerplexity
latest version of Astroversions · Right answer: 7.4.1
Right

Top five results

  1. Astro 6.2astro.build · 2026-04-30
  2. Astro 7.0astro.build · 2026-06-22
  3. Astro release notesastronomer.io · Date not supplied
  4. Upgrade Astro - Docsdocs.astro.build · Date not supplied
  5. The Astro Blogastro.build · 2026-10-15
latest version of Cloudflare Wranglerversions · Right answer: 4.151.2
Wrong

Top five results

  1. Install/Update Wranglerdevelopers.cloudflare.com · 2026-10-12
  2. Releases · cloudflare/workers-sdkgithub.com · 2026-10-14
  3. Cloudflare Docsdevelopers.cloudflare.com · Date not supplied
  4. Migrate from Wrangler v3 to v4developers.cloudflare.com · 2026-04-23
  5. Install / Update · Cloudflare Workers docsdevelopers.cloudflare.com · 2026-04-23
latest version of Expo SDKversions · Right answer: 58.0.16
Wrong

Top five results

  1. Changelog - Expoexpo.dev · 2026-10-07
  2. Expoexpo.io · Date not supplied
  3. docs.expo.devdocs.expo.dev · Date not supplied
  4. Expo changelog | HUMAN Documentationdocs.humansecurity.com · 2026-09-22
  5. Expo SDK reference - Expo documentationdocs.expo.dev · Date not supplied
latest version of openai npm packageversions · Right answer: 7.39.0
Wrong

Top five results

  1. Versions - @ai-sdk/openai - npm - Spectra Assure Communitysecure.software · 2026-10-15
  2. openaisecurity.snyk.io · 2026-10-09
  3. Versions - openai - npm | ReversingLabs Spectra Assure Communitysecure.software · 2026-09-23
  4. Openai NPM | npm.ionpm.io · 2020-07-09
  5. openai 6.49.0 | Snyksecurity.snyk.io · 2026-08-03
latest version of Claude Codeversions · Right answer: 2.1.304
Wrong

Top five results

  1. Releases · anthropics/claude-code - GitHubgithub.com · 2026-10-18
  2. Claude Code by Anthropic | AI Coding Agent, Terminal, IDEclaude.com · 2026-09-17
  3. What's new - Claude Code Docscode.claude.com · Date not supplied
  4. Claude Code: Anthropic's Terminal AI Coding Agent | AI/TLDRai-tldr.dev · 2026-10-16
  5. Claude Code changelog - Claude Code Docscode.claude.com · Date not supplied
latest version of Vercel AI SDKversions · Right answer: 7.0.145
Wrong

Top five results

  1. ai-sdkblog.vercel.com · 2026-06-15
  2. AI SDK 7 is now available - Vercelvercel.com · 2026-06-25
  3. AI SDKvercel.com · 2026-10-05
  4. Releases · vercel/ai - GitHubgithub.com · 2026-10-14
  5. What's New in Vercel AI SDK 7 (October 2026)developersdigest.tech · 2026-10-17
latest version of TanStack Queryversions · Right answer: 5.104.5
Wrong

Top five results

  1. Releases · TanStack/query - GitHubgithub.com · 2026-10-18
  2. TanStack Query Docstanstack.com · Date not supplied
  3. TanStack Query Docstanstack.com · Date not supplied
  4. Migrating to TanStack Query v5tanstack.com · Date not supplied
  5. Release Release 2026-10-17 17:53 · TanStack/querygithub.com · 2026-10-17
latest version of FastAPIversions · Right answer: 0.150.0
Wrong

Top five results

  1. Release Notesfastapi.tiangolo.com · 2026-10-19
  2. fastapi · PyPIpypi.org · 2018-12-08
  3. Releases · fastapi/fastapi - GitHubgithub.com · 2026-10-18
  4. Versions | fastapi | PyPIdeps.dev · 2026-10-18
  5. fastapipypi.org · 2018-12-08
latest version of uvversions · Right answer: 0.13.2
Right

Top five results

  1. pypi.org · project · uvuv · PyPIpypi.org · 2024-02-15
  2. Releases: astral-sh/uv - GitHubgithub.com · 2026-10-14
  3. Installation | uv - Astraldocs.astral.sh · 2026-10-14
  4. Versions | uv | PyPIdeps.dev · 2026-10-03
  5. uv/CHANGELOG.md at main · astral-sh/uv · GitHubgithub.com · 2023-10-02
latest version of Hugging Face Transformersversions · Right answer: 5.20.2
Wrong

Top five results

  1. Transformers - Hugging Facehuggingface.co · Date not supplied
  2. github.com › huggingface › transformersReleases · huggingface/transformers - GitHubgithub.com · 2026-10-16
  3. 🤗 Transformers · Hugging Facehuggingface.co · Date not supplied
  4. Без заголовкаhuggingface.co · Date not supplied
  5. 🤗 Transformershuggingface.co · Date not supplied
latest version of LiteLLMversions · Right answer: 1.106.0
Wrong

Top five results

  1. Release Notes | liteLLMdocs.litellm.ai · Date not supplied
  2. v1.82.3 - Nebius AI, gpt-5.4, Gemini 3.x, FLUX Kontext, and ...docs.litellm.ai · Date not supplied
  3. v1.81.3 - Performance - 25% CPU Usage Reductiondocs.litellm.ai · Date not supplied
  4. v1.83.14 - GPT-5.5, Prompt Compression & Memory APIdocs.litellm.ai · Date not supplied
  5. Releases · langchain-ai/langchain-litellm - GitHubgithub.com · 2026-10-14
latest version of Electronversions · Right answer: 44.9.0
Right

Top five results

  1. Releases · electron/electron - GitHubgithub.com · 2026-10-14
  2. Electron 44 | Electronelectronjs.org · 2026-08-25
  3. Electron Releases - releases.electronjs.orgreleases.electronjs.org · Date not supplied
  4. Unable to require path and fs modules in preload scriptelectronjs.org · 2026-08-25
  5. All | Electron Releasesreleases.electronjs.org · Date not supplied
latest version of ESLintversions · Right answer: 10.13.0
Right

Top five results

  1. Find and fix problems in your JavaScript code - ESLint - Pluggable JavaScript Lintereslint.org · Date not supplied
  2. v10.13.0github.com · 2026-10-16
  3. Releases · eslint/eslint · GitHubgithub.com · Date not supplied
  4. ESLint Versionseslint.org · Date not supplied
  5. Release Notes - ESLint - Pluggable JavaScript Lintereslint.org · 2026-10-16
latest version of Turborepoversions · Right answer: 2.11.9
Right

Top five results

  1. Releases · vercel/turborepogithub.com · 2026-10-16
  2. Turborepo 2.11turborepo.dev · Date not supplied
  3. Blogturborepo.dev · Date not supplied
  4. Turborepo 2.9turborepo.dev · Date not supplied
  5. Release Turborepo v2.11.9 · vercel/turborepogithub.com · 2026-10-16
latest version of Nuxtversions · Right answer: 4.6.2
Right

Top five results

  1. Releases · nuxt/nuxt - GitHubgithub.com · 2026-10-16
  2. Nuxt Blognuxt.com · 2026-10-15
  3. Nuxt Blognuxt.com · 2026-10-05
  4. nuxt.comnuxt.com · Date not supplied
  5. Release v4.6.0 · nuxt/nuxtgithub.com · 2026-10-05
latest version of Next.jsversions · Right answer: 16.4.2
Wrong

Top five results

  1. nextjs.org › blogNext.js Blog | Next.js by Vercel - The React Frameworknextjs.org · 2026-10-16
  2. Next.jsnpmjs.com · 2025-09-10
  3. Next.js 16nextjs.org · Date not supplied
  4. Next.js 16.4nextjs.org · 2026-10-06
  5. Next.js 16.3nextjs.org · Date not supplied
latest version of Vitestversions · Right answer: 5.0.5
Right

Top five results

  1. Vitest 5.0 is out!vitest.dev · 2026-09-28
  2. Releases · vitest-dev/vitestgithub.com · 2026-10-12
  3. Vitest 4.1 is out!vitest.dev · 2026-09-29
  4. Releases - Vitestvitest.dev · 2026-09-03
  5. Latest From the Vitest Blogvitest.dev · 2026-09-03
latest version of React Nativeversions · Right answer: 0.88.0
Wrong

Top five results

  1. reactnative.dev › blogBlog · React Nativereactnative.dev · 2026-08-11
  2. Releases · react/react-native - GitHubgithub.com · 2026-10-15
  3. React Native 0.88 - Web-Based Event Dispatching, Variable ...reactnative.dev · Date not supplied
  4. Releases · react/react-nativegithub.com · 2026-10-15
  5. Versions · React Nativereactnative.dev · Date not supplied
latest version of Anthropic TypeScript SDKversions · Right answer: 0.135.0
Right
latest version of OpenAI Codex CLIversions · Right answer: 0.163.0
Right
latest version of pnpmversions · Right answer: 12.14.0
Right

Top five results

  1. Releases · pnpm/pnpmgithub.com · 2026-10-15
  2. pnpm 12.0pnpm.io · Date not supplied
  3. pnpm 11.0pnpm.io · Date not supplied
  4. Blogpnpm.io · 2026-10-03
  5. pnpmnpmjs.com · 2025-09-17
latest version of Ruffversions · Right answer: 0.17.1
Right

Top five results

  1. https://raw.githubusercontent.com/astral-sh/ruff/m...raw.githubusercontent.com · 2026-10-09
  2. Ruff v0.16.0 - Astralastral.sh · Date not supplied
  3. Releases 369github.com · 2026-10-15
  4. Changelog 0.12.xfuchsia.googlesource.com · Date not supplied
  5. Ruff v0.16.0 - Simon Willison's Weblogsimonwillison.net · Date not supplied
latest version of anthropic Python SDKversions · Right answer: 1.15.0
Right

Top five results

  1. Releases · anthropics/anthropic-sdk-pythongithub.com · 2026-10-09
  2. Claude Platform release notesdocs.anthropic.com · Date not supplied
  3. Releases · anthropics/claude-agent-sdk-python - GitHubgithub.com · 2026-10-15
  4. anthropicpypi.org · 2026-08-19
  5. anthropicpypi.org · 2026-09-28
latest version of Reactversions · Right answer: 19.3.1
Right

Top five results

  1. React Versionsreact.dev · Date not supplied
  2. github.com › react › reactReleases · react/react - GitHubgithub.com · 2026-10-14
  3. Releases · react/reactgithub.com · 2026-10-14
  4. Releases · react/react · GitHubgithub.com · 2026-10-14
  5. Версії React – Reactuk.react.dev · Date not supplied
latest version of SvelteKitversions · Right answer: 3.1.0
Right

Top five results

  1. SvelteKit 3 is heresvelte.dev · 2026-10-01
  2. Svelte Release Notes & Changelog · October 2026 — Release ...releases.sh · 2026-10-14
  3. kit — Sveltereleases.sh · 2026-10-14
  4. The SvelteKit 3 Release Candidate is heresvelte.dev · 2026-08-13
  5. Blog • Sveltesvelte.dev · 2026-10-01
latest version of Playwrightversions · Right answer: 1.64.1
Right

Top five results

  1. Release notes | Playwright Pythonplaywright.dev · Date not supplied
  2. Releases · microsoft/playwright - GitHubgithub.com · 2026-10-14
  3. Latest Playwright Release Notes & Version Updates | TestDinotestdino.com · 2026-10-10
  4. playwright - PyPIpypi.org · 2026-09-15
  5. playwright - PyPIpypi.org · 2021-03-10
latest version of Vueversions · Right answer: 3.5.44
Right

Top five results

  1. Releasesvuejs.org · Date not supplied
  2. vuenpmjs.com · 2025-09-02
  3. github.com › vuejs › coreReleases · vuejs/core - GitHubgithub.com · 2026-10-16
  4. Vue.jsvuejs.org · Date not supplied
  5. Vue - endoflife.dateendoflife.date · 2026-10-14
latest version of Zodversions · Right answer: 4.6.7
Right

Top five results

  1. Release notes | Zodzod.dev · Date not supplied
  2. zodnpmjs.com · 2025-07-10
  3. Zod: Introzod.dev · Date not supplied
  4. Releases · colinhacks/zod - GitHubgithub.com · 2026-10-12
  5. Blog - Zodzod.dev · 2026-09-09
latest version of Pydanticversions · Right answer: 2.14.1
Right

Top five results

  1. Releases · pydantic/pydanticgithub.com · 2026-10-11
  2. Pydantic | The end-to-end AI engineering stackpydantic.dev · 2026-10-08
  3. Upgrade Guide | Pydantic Docspydantic.dev · 2026-06-23
  4. Releases · pydantic/pydantic-aigithub.com · 2026-10-06
  5. Migration Guide | Pydantic Docspydantic.dev · Date not supplied
latest version of Bunversions · Right answer: 1.4.3
Right

Top five results

  1. Bun — A fast all-in-one JavaScript runtimebun.sh · Date not supplied
  2. Releases · oven-sh/bungithub.com · Date not supplied
  3. Bun v1.4.3 | Bun Blogbun.com · 2026-10-10
  4. bun - npmnpmjs.com · Date not supplied
  5. Blog | Bunbun.com · Date not supplied
Exa annualized revenue run rate announced October 2026week · Right answer: $100M ARR (Will Bryk, X, Oct 13)
Right
Which company became the default search provider for Browserbase in October 2026week · Right answer: Parallel (Parag Agrawal, X, Oct 14)
Right
Name of Firecrawl's company funding intelligence tool for ChatGPT and Claude launched October 2026week · Right answer: Fireround (Firecrawl, X, Oct 15)
Right
Which DeepSeek Harness version is recommended for DeepSeek-V4.1-Flash-1017week · Right answer: v0.2.1-rc.1 or later (DeepSeek, X, Oct 17)
Right
TinyFish free search API rate limit requests per minuteweek · Right answer: 30 requests per minute (Oct 18)
Right

Top five results

  1. Search API Reference - TinyFish Web Agentdocs.tinyfish.ai · Date not supplied
  2. www.tinyfish.ai · blog · search-and-fetch-are-now-free-forTinyFish Web Search & Fetch APIs: Free, No Credit Cardtinyfish.ai · 2026-05-04
  3. Pricingtinyfish.ai · 2026-10-15
  4. AWS Marketplace: TinyFish AI Web Agents - Amazon.comaws.amazon.com · 2026-07-01
  5. Error Codes - TinyFish Web Agentdocs.tinyfish.ai · Date not supplied
According to Parallel, which open model was the first to reach the top 10 of its Search Capability Leaderboardweek · Right answer: DeepSeek V4.1 Flash (1017) (Parallel, X, Oct 18)
Right
Which Firecrawl product gives Gemini agents live web data in the Firecrawl Google Cloud partnership announced October 19 2026week · Right answer: Alexandria (Firecrawl, X, Oct 19)
Right
Which Claude Code environment variable chooses the model used by the auto mode classifierweek · Right answer: CLAUDE_CODE_AUTO_MODE_MODEL (Claude Code v2.1.302, Oct 16)
Right

Top five results

  1. Model configuration - Claude Code Docscode.claude.com · Date not supplied
  2. permission-modes.mdcode.claude.com · Date not supplied
  3. code.claude.com · docs · deModellkonfiguration - Claude Code Docscode.claude.com · Date not supplied
  4. Claude Code v2.1.302 Major Updates - Default Enablement of Fork ...dev.classmethod.jp · 2026-10-17
  5. code.claude.com · docs · frVariables d'environnement - Claude Code Docscode.claude.com · Date not supplied
Which new crypto function did Node.js 24.22.0 addweek · Right answer: crypto.parsePKCS12() (Node v24.22.0, Oct 14)
Right
Which new value for the Link prefetch prop did Next.js add in the 16.5 canary releasesweek · Right answer: "navigation" (<Link prefetch="navigation">, v16.5.0-canary.18, Oct 19)
Wrong

Top five results

  1. Link - Next.jsnextjs.org · Date not supplied
  2. Link コンポーネント | Next.js 16 日本語ドキュメントnextjsjp.org · Date not supplied
  3. Next.js 16nextjs.org · Date not supplied
  4. nextjs.org · docs · appLink Component - Next.jsnextjs.org · Date not supplied
  5. Link 组件| Next.js 16 中文文档nextjscn.org · Date not supplied
DeepSeek Search API rate limit QPS per accounttraps · Right answer: 100 QPS (docs; launch coverage said 5)
Right

Top five results

  1. Search & Fetchapi-docs.deepseek.com · 2026-06-01
  2. DeepSeek Search API pricing 2026: real cost per task and per montheesel.ai · 2026-10-19
  3. DeepSeek API Rate Limits: 429, Streaming & Retriesdeepseek-usa.ai · 2026-05-25
  4. Rate Limitapi-docs.deepseek.com · Date not supplied
  5. DeepSeek Search API: pricing, limits, and how Search and Fetch workeesel.ai · 2026-10-19
Exact UTC time DeepSeek starts billing web search calls made through Claude Code and Codextraps · Right answer: Oct 31 2026 16:00 UTC (DeepSeek docs)
Right
Which DeepSeek model is required for Codex native web search through DeepSeek's APItraps · Right answer: deepseek-v4-pro (DeepSeek Codex guide; posts said search is free for any model)
Right

Top five results

  1. Integrate with Codexapi-docs.deepseek.com · Date not supplied
  2. Using the Responses APIapi-docs.deepseek.com · Date not supplied
  3. deepseek-usa.ai › guide › use-deepseek-with-codexHow to Use DeepSeek with Codex: Secure Setup Guidedeepseek-usa.ai · 2026-10-06
  4. CodeSeeX - GitHubgithub.com · 2026-05-17
  5. Search | DeepSeek API Docsapi-docs.deepseek.com · 2026-10-19
Exa API header value needed to use dynamic highlightstraps · Right answer: Exa-Beta: dynamic-highlights-2026-08-28 (API docs; launch post calls it generally available)
Right

Top five results

  1. Highlights - Exaexa.ai · Date not supplied
  2. Dynamic Highlights | Exa Blogexa.ai · 2026-08-28
  3. Search - Exaexa.ai · Date not supplied
  4. qp-exa-dynamic — DSH Plugins Marketplacedsh-plugins-mp.com · Date not supplied
  5. Search Best Practices - Exaexa.ai · Date not supplied
Exa 3.0 release datetraps · Right answer: Oct 19 2026 (Exa blog; some coverage said Oct 18)
Wrong
Which search provider is tied with Exa 3.0 for first place on the Artificial Analysis Search Indextraps · Right answer: Perplexity, both 80 (Artificial Analysis, Oct 19; Exa says #1 on every benchmark it tested)
Right
Who owns Tavilytraps · Right answer: Nebius (acquired Feb 2026)
Right
Perplexity Decision API price per million input tokenstraps · Right answer: 2 cents (halved Oct 6, Aravind Srinivas)
Right

Top five results

  1. quickstartdocs.perplexity.ai · Date not supplied
  2. Changelog - docs.perplexity.aidocs.perplexity.ai · Date not supplied
  3. Pricing - Perplexitydocs.perplexity.ai · Date not supplied
  4. Perplexity Developers on X: "Introducing the Perplexity ...x.com · 2026-10-01
  5. Changelogdocs.perplexity.ai · Date not supplied

Back to the full results