Skip to content
cccskills
FreePublished on GitHub

nber-working-papers-api

Find NBER working papers, research papers shared before formal publication, by keyword or research program. Retrieve recent papers, authors, dates, and citation details, and access US business cycle dates and links to economic datasets.

OriginalShow the original description

Access NBER working papers and economic research datasets

See how to install

Good for

  • Find economics papers by topic
  • Check this week's new working papers
  • Retrieve authors, DOI, and PDF links
  • Retrieve US business cycle peak and trough dates

Files included (1)

  • SKILL.md9.0 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

NBER Working Papers and Data API

Overview

The National Bureau of Economic Research (NBER) is the leading U.S. economics research organization, publishing 1,200+ working papers annually by top economists. NBER papers are among the most cited in economics. The website provides structured JSON API access to working papers and macroeconomic datasets. Free metadata access; some full text requires subscription.

API last verified: 2026-04-23. RSS feeds (/papers.rss) and the old query-param API (?q=... without /search path) are defunct. Use the endpoints below.

Working Papers Search API

Base URL: https://www.nber.org/api/v1/working_page_listing/contentType/working_paper

Search all papers

# Search working papers (returns JSON)
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/_/_/search?page=1&perPage=20&q=inflation+expectations"

# Get new-this-week papers (omit q for all recent)
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/_/_/search?page=1&perPage=20&newThisWeek=true"

# Find a specific paper by number
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/_/_/search?page=1&perPage=1&q=w33000"

Filter by program (path segment)

Program names go in the URL path (use + for spaces), replacing the two _/_ placeholders:

# Labor Studies papers
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/programs/Labor+Studies/search?page=1&perPage=20"

# Labor Studies + keyword search
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/programs/Labor+Studies/search?page=1&perPage=20&q=minimum+wage"

# Economic Fluctuations and Growth
curl "https://www.nber.org/api/v1/working_page_listing/contentType/working_paper/programs/Economic+Fluctuations+and+Growth/search?page=1&perPage=20"

API Response Structure

{
  "totalResults": 11711,
  "results": [
    {
      "title": "Paper Title",
      "authors": ["<a href=\"/people/john_doe\">John Doe</a>"],
      "displaydate": "March 2025",
      "abstract": "First ~300 chars of abstract...",
      "url": "/papers/w33000",
      "nid": "767372",
      "type": "working_paper",
      "displaytypename": "Working Paper",
      "newthisweek": false,
      "certifiedrandom": false
    }
  ],
  "facets": [
    {"id": "authorNames", "label": "Author & Editor", ...},
    {"id": "programs", "label": "Programs", ...},
    {"id": "topics", "label": "Topics", ...},
    {"id": "groups", "label": "Working Groups", ...}
  ]
}

Note on authors field: Values contain HTML anchor tags. Strip tags to get plain names:

import re
plain = re.sub(r'<[^>]+>', '', author_html)

Individual Paper Metadata (HTML meta tags)

For richer metadata on a single paper, parse <meta> tags from the paper page:

curl -sL "https://www.nber.org/papers/w33000" | grep 'citation_'
# citation_title, citation_author, citation_doi, citation_publication_date,
# citation_technical_report_number, citation_pdf_url

NBER Data Portal

# Business cycle dates (JSON, works directly)
curl "https://data.nber.org/data/cycles/business_cycle_dates.json"
# Returns: [{"peak": "2020-02-01", "trough": "2020-04-01"}, ...]

# CPS labor data extracts: https://data.nber.org/cps/
# Macrohistory database: https://data.nber.org/

NBER Programs (full names for API path)

Program Name (use in API path)Focus
Economic Fluctuations and GrowthMacro, business cycles
Labor StudiesEmployment, wages
Industrial OrganizationMarkets, competition
Public EconomicsTaxation, spending
Economics of HealthHealthcare markets
Development EconomicsDeveloping countries
International Finance and MacroeconomicsExchange rates, capital flows
International Trade and InvestmentTrade policy
Monetary EconomicsCentral banking
Corporate FinanceFirm finance
Asset PricingFinancial markets
Economics of EducationEducation economics
Economics of AgingDemographics
Children and FamiliesChild welfare
Law and EconomicsLegal institutions
Environment and Energy EconomicsEnvironmental policy
Political EconomyPolitical institutions

Python Usage

import re
import requests


SEARCH_BASE = (
    "https://www.nber.org/api/v1/working_page_listing"
    "/contentType/working_paper"
)


def _strip_html(text: str) -> str:
    """Remove HTML tags from a string."""
    return re.sub(r'<[^>]+>', '', text)


def _extract_paper_number(url: str) -> str:
    """Extract paper number from URL like /papers/w33000."""
    return url.rsplit("/", 1)[-1] if url else ""


def search_papers(query: str = "", program: str = "",
                  page: int = 1, per_page: int = 20,
                  new_this_week: bool = False) -> dict:
    """Search NBER working papers.

    Args:
        query: Search keywords (optional).
        program: Full program name, e.g. "Labor Studies" (optional).
        page: Page number (1-indexed).
        per_page: Results per page (max ~100).
        new_this_week: If True, return only new-this-week papers.

    Returns:
        Dict with 'total' count and 'papers' list.
    """
    if program:
        url = f"{SEARCH_BASE}/programs/{program}/search"
    else:
        url = f"{SEARCH_BASE}/_/_/search"

    params = {"page": page, "perPage": per_page}
    if query:
        params["q"] = query
    if new_this_week:
        params["newThisWeek"] = "true"

    resp = requests.get(url, params=params, timeout=30)
    resp.raise_for_status()
    data = resp.json()

    papers = []
    for item in data.get("results", []):
        number = _extract_paper_number(item.get("url", ""))
        papers.append({
            "title": item.get("title", ""),
            "authors": [_strip_html(a) for a in item.get("authors", [])],
            "number": number,
            "date": item.get("displaydate", ""),
            "url": f"https://www.nber.org{item['url']}" if item.get("url") else "",
            "pdf_url": f"https://www.nber.org/system/files/working_papers/{number}/{number}.pdf" if number else "",
            "abstract": item.get("abstract", ""),
            "new_this_week": item.get("newthisweek", False),
        })
    return {"total": data.get("totalResults", 0), "papers": papers}


def get_paper_metadata(paper_number: str) -> dict:
    """Get metadata for a specific paper (e.g. 'w33000') via citation meta tags."""
    resp = requests.get(
        f"https://www.nber.org/papers/{paper_number}", timeout=30
    )
    resp.raise_for_status()

    meta = {}
    for match in re.finditer(
        r'<meta\s+name="citation_(\w+)"\s+content="([^"]*)"', resp.text
    ):
        key, val = match.group(1), match.group(2)
        if key == "author":
            meta.setdefault("authors", []).append(val)
        else:
            meta[key] = val
    return meta


def get_business_cycle_dates() -> list:
    """Get NBER official business cycle dates."""
    resp = requests.get(
        "https://data.nber.org/data/cycles/business_cycle_dates.json",
        timeout=30,
    )
    resp.raise_for_status()
    return resp.json()


# === Examples ===

# Search for AI economics papers
results = search_papers("artificial intelligence labor market")
print(f"Found {results['total']} papers")
for p in results["papers"][:3]:
    print(f"[{p['number']}] {p['title']} ({p['date']})")
    print(f"  Authors: {', '.join(p['authors'])}")

# New papers this week
new = search_papers(new_this_week=True, per_page=5)
for p in new["papers"]:
    print(f"[NEW] {p['title']}")

# Papers in a specific program
labor = search_papers(query="minimum wage", program="Labor Studies", per_page=5)
for p in labor["papers"]:
    print(f"[{p['number']}] {p['title']}")

# Get detailed metadata for a specific paper
meta = get_paper_metadata("w33000")
print(f"Title: {meta.get('title')}")
print(f"DOI: {meta.get('doi')}")
print(f"PDF: {meta.get('pdf_url', 'N/A')}")

# Recession dates
cycles = get_business_cycle_dates()
for c in cycles[-3:]:
    print(f"Peak: {c.get('peak')} → Trough: {c.get('trough')}")

Key Datasets

DatasetDescription
Business Cycle DatesOfficial US recession start/end dates
CPS ExtractsCurrent Population Survey labor data
Macrohistory Database150 years of macro indicators
Patent DataPatent citation and classification
Trade DataBilateral trade statistics

References

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

a1

FreeSummary

Turn a broad research idea into clear, testable questions. Compare familiar and less conventional approaches, structure the selected question around its population and methods, and assess variables, feasibility, and potential theoretical contributions.

  • Turn a research topic into testable questions
  • Narrow an overly broad research question
  • Compare alternative research angles
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

a2

FreeSummary

Helps build a research framework by comparing theories, mapping relationships between variables, and deriving testable hypotheses. Explores less conventional options, examines weaknesses and competing explanations, and produces diagrams with anticipated reviewer objections.

  • Comparing theories for a research question
  • Deriving hypotheses from relationships between variables
  • Examining weaknesses and anticipated reviewer objections
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

a5

FreeSummary

Clarify the philosophical assumptions behind a research project and check whether they fit the proposed methods. Get a reasoned research stance, draft proposal wording, and guidance for explaining how the researcher's background and values shape the study.

  • Clarifying philosophical foundations for a research proposal
  • Explaining why the chosen research methods fit the study
  • Drafting a statement about the researcher's position
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

academic-paper

FreeSummary

Plan and draft academic papers through specialized agent roles covering literature, arguments, citations, and review. Get chapter guidance, revision roadmaps, Traditional Chinese and English abstracts, and documents formatted as LaTeX, DOCX, PDF, or Markdown.

  • Planning a paper chapter by chapter
  • Drafting a paper from research materials
  • Turning reviewer comments into a revision roadmap
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

Turn a detailed outline into a philosophy or interdisciplinary manuscript. Draft chapters with repeated quality reviews, check terminology and arguments across sections, and prepare the manuscript, evaluation reports, abstract, and metadata for submission.

  • Draft a full paper from a detailed outline
  • Review argument and citation quality chapter by chapter
  • Check terminology and argument flow across chapters
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

Simulate academic peer review through five reviewer roles tailored to the paper's field. Receive separate critiques, an editorial decision, and a prioritized revision roadmap, or check whether a revised manuscript addresses earlier comments.

  • Review a manuscript before journal submission
  • Examine research methods and statistical validity
  • Challenge core arguments and alternative explanations
brycewang-stanford/Auto-Empirical-Research-Skills4.7KUpdated Oct 20, 2026

See all skills by brycewang-stanford

Report a problem with this skill