Data sources · Collect
Where we listen, and how often
Switch sources on or off, collect now, schedule collection; every run is logged. Platforms we cannot see are listed below - no pretending to cover the whole web.
01Collect now
6 search terms × 6 enabled sources
ClaudeAnthropicModel Context ProtocolMCP serverOpenAIChatGPT
Collection runs in the background, usually 1–3 minutes; refresh the run log below for results. Last run: just now
03Data sources
16 sources
| Source | Type | Status | Last stored | Total | Last run | Enabled |
|---|---|---|---|---|---|---|
| bluesky | code | Fresh | just now | 130 | +22 / 24 | |
| gdelt | code | — | — | — | — | |
| hn | code | Fresh | just now | 134 | +8 / 16 | |
| code | Fresh | just now | 43 | failed | ||
| rss | code | — | — | — | — | |
| web | code | — | — | — | — | |
| arxiv | config · rss | — | — | — | — | |
| gdelt-news | config · json_api | Fresh | just now | 89 | failed | |
| github-issues | config · json_api | — | — | — | — | |
| google-news | config · rss | Fresh | just now | 314 | +66 / 77 | |
| google-news-zh | config · rss | — | — | — | — | |
| lemmy | config · json_api | Fresh | just now | 114 | +8 / 13 | |
| mastodon | config · json_api | — | — | — | — | |
| npr-text | config · html_list | — | — | — | — | |
| stackoverflow | config · json_api | — | — | — | — | |
| techcrunch | config · rss | — | — | — | — |
Add a source with one TOML file in configs/ (RSS / JSON API / HTML list) - see configs/README.md.
04Run log
Latest 30
| Time | Source | Term | New | Result |
|---|---|---|---|---|
| 2026-10-23 09:59 | lemmy | ChatGPT | 8 / 13 | OK |
| 2026-10-23 09:59 | google-news | ChatGPT | 66 / 77 | OK |
| 2026-10-23 09:59 | gdelt-news | ChatGPT | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests |
| 2026-10-23 09:59 | ChatGPT | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests | |
| 2026-10-23 09:59 | hn | ChatGPT | 8 / 16 | OK |
| 2026-10-23 09:59 | bluesky | ChatGPT | 22 / 24 | OK |
| 2026-10-23 09:59 | lemmy | OpenAI | 25 / 33 | OK |
| 2026-10-23 09:59 | google-news | OpenAI | 80 / 87 | OK |
| 2026-10-23 09:59 | gdelt-news | OpenAI | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests |
| 2026-10-23 09:59 | OpenAI | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests | |
| 2026-10-23 09:59 | hn | OpenAI | 41 / 49 | OK |
| 2026-10-23 09:59 | bluesky | OpenAI | 19 / 25 | OK |
| 2026-10-23 09:59 | lemmy | MCP server | 1 / 2 | OK |
| 2026-10-23 09:59 | google-news | MCP server | 14 / 22 | OK |
| 2026-10-23 09:59 | gdelt-news | MCP server | 14 / 18 | OK |
| 2026-10-23 09:59 | MCP server | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests | |
| 2026-10-23 09:59 | hn | MCP server | 14 / 15 | OK |
| 2026-10-23 09:59 | bluesky | MCP server | 19 / 25 | OK |
| 2026-10-23 09:59 | lemmy | Model Context Protocol | 0 / 0 | OK |
| 2026-10-23 09:59 | google-news | Model Context Protocol | 20 / 20 | OK |
| 2026-10-23 09:59 | gdelt-news | Model Context Protocol | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests |
| 2026-10-23 09:59 | Model Context Protocol | 21 / 22 | OK | |
| 2026-10-23 09:59 | hn | Model Context Protocol | 0 / 0 | OK |
| 2026-10-23 09:59 | bluesky | Model Context Protocol | 25 / 25 | OK |
| 2026-10-23 09:59 | lemmy | Anthropic | 30 / 35 | OK |
| 2026-10-23 09:59 | google-news | Anthropic | 45 / 75 | OK |
| 2026-10-23 09:59 | gdelt-news | Anthropic | 75 / 75 | OK |
| 2026-10-23 09:58 | Anthropic | 0 / 0 | HTTPError: HTTP Error 429: Too Many Requests | |
| 2026-10-23 09:58 | hn | Anthropic | 22 / 28 | OK |
| 2026-10-23 09:58 | bluesky | Anthropic | 20 / 24 | OK |
06Blind spots
What we cannot see
| Platform | Why |
|---|---|
| X / Twitter | paid API only (pay-per-read since 2026-02); no free search |
| Instagram · Facebook | no public search API; Meta Graph API covers only your own pages |
| TikTok | Research API restricted to approved academic use |
| no public post search API | |
| YouTube | needs a Google API key (10,000 quota units/day); not bundled |
| WeChat · Weibo · Douyin | no open search API; FTS5 tokenizer is not CJK-aware yet |
| Broadcast TV · radio · print | licensed data only |
| Private groups · DMs · paywalled content | not public; never collected |
Verdicts cover enabled sources only, never the platforms above. For those, import their official CSV exports.