Programme Pulse: Progressive-vs-Degenerating Scores for Research Funders
A service for funders that tracks if a research field is making new discoveries or just fixing old errors.
A subscription analytics service that mines published literature to score whether a research programme is making corroborated novel predictions (progressive) or only patching its theories after the facts (degenerating), so funders can steer money toward genuinely advancing fields.
Concept
The methodology of scientific research programmes [0] supplies a usable demarcation test: a programme is progressive when it predicts novel facts in advance and some are corroborated, and degenerates when its theories are repeatedly patched after the fact to absorb known results. Programme Pulse turns that test into funder-facing analytics. The service aggregates literature across dispersed databases using federated single-query search [2], extracts ex-ante prediction statements (stated hypotheses, pre-registered forecasts) from articles and registrations, tracks each prediction's later fate (corroborated, refuted, or quietly absorbed by an ad hoc patch), and computes a per-programme progress ratio: corroborated novel predictions over post-hoc accommodations. Funders get quarterly reports and an alert when a programme they back shows a rising patch rate and falling novel-prediction rate — a defensible signal for portfolio review that citation counts and output volume cannot provide.
Why now
The new paper [0] argues that demarcation between science and pseudoscience is not a parlor question but one of vital social and political importance, and that neither the strength nor the number of believers is a criterion of knowledge — yet funders today have no systematic instrument for this judgment, relying on prestige and consensus. The aggregation layer is demonstrated as operational: WorldWideScience.org and Science.gov let a patron search multiple geographically dispersed deep-web databases with a single query [2], making cross-field prediction tracking feasible now. And [1] documents that explicit methodological pathways in article development are a recognized need, meaning the article-level signals the scorer depends on (stated hypotheses, methods rigor) are both present in the literature and valued by the researchers producing it.
Written by GLM · 3 Oct 2026
AI assessment
A high-concept analytics tool that attempts to automate a philosophical demarcation test, but suffers from extreme technical optimism regarding the ability to programmatically distinguish 'novel predictions' from 'ad hoc patches' in unstructured text.
- Evidence strength 2/5
- The idea relies on a philosophical framework (Lakatos) and a search tool (WorldWideScience), but lacks any evidence that NLP can reliably distinguish between a 'progressive prediction' and a 'degenerating patch' across diverse scientific corpora.
- Market pull 3/5
- Large funders like the Wellcome Trust have a genuine interest in ROI and scientific rigor, but the willingness to trust an automated 'degenerating' score for funding decisions is unproven.
- Novelty & moat 2/5
- This is a funder-side mirror of the 'Prediction Ledger' idea; it shifts the data entry from the lab to an automated scraper but targets the same core mechanism of tracking ex-ante predictions.
- Feasibility 2/5
- While federated search is possible, the 'mining' aspect requires a level of semantic understanding of scientific intent and historical context that current LLMs cannot perform with the precision required for financial divestment decisions.
- Wedge clarity 4/5
- The specific metric of 'corroborated predictions vs. post-hoc patches' is a sharp, distinct value proposition compared to generic citation tracking.
- Simplicity / focus 4/5
- The product is focused on a single output—the progress ratio—avoiding the trap of becoming a general research platform.
Scored by Gemma 4 · 7 Oct 2026. Rated against a fixed rubric (evidence, market, novelty, feasibility, wedge, simplicity), relative to the closest ideas already in the catalog. A prior estimate to compare ideas before real-world signal arrives.
Persona discussion
AI personas trained on real people's expertise debate this idea as it evolves.
View the discussion →Act on this idea
Ideas only matter if someone runs with them. Your message goes straight to the founder's inbox — nothing is stored on our servers.
Business analysis
The PESTEL analysis reveals a high-potential opportunity driven by technological readiness in federated search and a growing demand for rigorous scientific demarcation. However, the idea faces significant social resistance from the academic establishment and complex legal challenges regarding the interpretation of intellectual property and research intent.
Political2
Economic2
Social2
Technological2
Environmental2
Legal2
The viability of the service depends on macro-level shifts in scientific demarcation standards, open-access data regulations, and the political climate of research funding. · Generated 2026-10-07 by Gemma 4AI-generatedFull PESTEL Analysis →
Who benefits
- Wellcome Trustorganization
Allocates billions across competing biomedical programmes; a progress-vs-degeneration score gives its strategy reviews an evidence-based basis for which programmes to grow, hold, or sunset.
- Flagship Pioneeringcompany
Builds ventures on specific scientific programmes; a pre-investment progress score of the underlying programme is direct diligence on whether the science is advancing or stalling.
- U.S. National Science Foundationorganization
Programme officers must justify portfolio shifts; degeneration alerts (rising post-hoc patching, falling novel predictions) provide documented rationale beyond citation metrics.
- AstraZenecacompany
Its R&D organization must choose which mechanistic programmes to pursue; a degeneration flag on a target's supporting literature prevents spend on fields that only retrofit explanations.
Research it builds on
- A importância da metodologia científica no desenvolvimento de artigos científicosRabbith Ive Carolina Shitsuka Risemberg, Michael Wakin, Ricardo Shitsuka · 2026 · 520 citationsAll ideas from this paper →
- La Metodologia de los programas de investigación científicaImre Lakatos · 2026 · 285 citationsAll ideas from this paper →
- IL PROGETTO PRIN 2022 PNRR “DIZIONARIO DELL’ITALIANO ACCADEMICO: FORME E FUNZIONI TESTUALI” (DIA): PRIME ACQUISIZIONI E PROSPETTIVEDavide Mastrantonio, Abdelmagid Sakr, Michela Dota et al. · 2025 · 16 citationsAll ideas from this paper →
- Federated search as a transformational technology enabling knowledge discovery: the role of WorldWideScience.orgWalter L. Warnick · 2010 · 6 citationsAll ideas from this paper →