pushshift alternativepullpusharctic shiftreddit datareddit api alternatives

Best Pushshift Alternatives in 2026: PullPush, Arctic Shift, Data Dumps, and Hosted Reddit APIs Compared

Pushshift is gone for public developers. This guide tests every real replacement, PullPush, Arctic Shift, Watchful1 data dumps, Hugging Face Parquet, and the official Reddit API, on historical depth, query latency, rate limits, and reliability.

Emma··Updated July 24, 2026
Best Pushshift alternatives in 2026 guide: a developer comparison of PullPush, Arctic Shift, Reddit data dumps, and hosted Reddit APIs. redditapis.com is an independent third-party API, not affiliated with Reddit Inc.

Pushshift was the infrastructure layer that made Reddit a viable research dataset. Billions of posts and comments, full-text search with no item caps, date-range queries going back to 2005. Then on May 2, 2023, Reddit revoked its API access. Over 1,700 scholarly articles cited Pushshift in their methodology sections. The shutdown disrupted research on mental health, COVID-19 response, misinformation, and political discourse worldwide.

Not affiliated with Reddit Inc. redditapis.com is an independent, third-party REST proxy for Reddit's API.

What you are left with now is a fragmented set of replacements, each covering a different slice of what Pushshift did. This guide tests each surviving option on the criteria developers and researchers actually care about: historical depth, query latency, rate limits, uptime track record, and the practical cost to migrate existing code.

Pushshift replacements compared on uptime, cost, coverage, and maintenance status across PullPush, Arctic Shift, data dumps, SocialGrep, and a maintained hosted API


TL;DR: No single tool replaces Pushshift. PullPush is the drop-in (same schema, ~1,000 req/hour, recurring outages). Arctic Shift is the high-throughput pick (more endpoints, no auth, 2005-2026, single-sub search only). Watchful1 Academic Torrents and the Arctic Shift Hugging Face Parquet cover full historical depth offline. The official Reddit API caps at 1,000 items per listing with no date-range search and a closed approval queue. SocialGrep and managed scrapers cover paid monitoring. If reliability beats $0, a maintained third-party REST API such as redditapis.com bills per call with no approval queue. See /reddit-api-alternatives and /pricing.

Here is the per-option breakdown this guide defends:

  • PullPush.io: Drop-in Pushshift replacement, same endpoint schema. Roughly 1,000 req/hour ceiling. Recurring outages documented through 2024-2025. Best for cross-subreddit full-text keyword search.
  • Arctic Shift: Higher throughput, more API endpoints, no auth required, covers 2005-2026. Full-text search limited to one subreddit or user at a time. Community-run with no uptime SLA.
  • Watchful1 Academic Torrents: Multi-terabyte offline archive, top subreddits, 2005-2025. No API dependency. Best for longitudinal research datasets.
  • Arctic Shift on Hugging Face: Billions of items in compressed Parquet. Query via DuckDB with no download. Best for SQL-style analysis without a torrent client.
  • Reddit official API: Hard cap of 1,000 items per listing. No date-range search. No comment search. Manual approval now required, often takes weeks, commonly rejected for non-commercial use.
  • Maintained hosted API: Flat per-call, bearer token, no approval queue. redditapis.com is one independent option. See /pricing.

The Reddit API drama that killed Pushshift was a public event, and developers documented it in real time:

Fed 🐻

Fed 🐻

@foliofed

Let's catch you up on the recent Reddit API drama 4/18 - Reddit announces changes to their API terms and upcoming paid tier as a response to LLM companies making $$ from using valuable Reddit data "for free". 3rd party app devs have many questions, as official pricing details


What Happened to Pushshift (and Why Every Tool Built on It Died)

Pushshift launched in 2015 and grew into one of the most consequential social media datasets in academic research. Its foundational 2020 paper has been cited in over 1,700 scholarly publications, making it one of the most-cited social media datasets in computational social science history. Researchers used it to study mental health terminology shifts on r/depression, model COVID-19 information spread, trace misinformation networks, and analyze political radicalization pathways.

Pushshift timeline: launched 2015, peaked around 2020 as the research standard, cut off by Reddit in May 2023, then re-enabled for verified moderators only

On May 2, 2023, Reddit revoked Pushshift's API access, citing terms-of-service violations. A Coalition for Independent Technology Research open letter signed by hundreds of researchers stated: "By cutting off Pushshift and casting doubt on the future of data access, Reddit puts independent research at risk." That letter documented disruption to thousands of academics worldwide across disciplines from public health to political science.

The original Pushshift dataset paper (Baumgartner et al., 2020) remains the standard methodology citation, which is exactly why its disappearance broke so much downstream work. The downstream tool casualties were immediate. Every application that relied on Pushshift's data stream lost its source:

  • Removeddit and Ceddit: tools for viewing deleted Reddit posts. No longer functional.
  • Unddit: the most widely used deleted-post viewer. Effectively dead.
  • Reveddit (reveddit.com): switched to its own API but access now requires Reddit moderator verification.
  • redditsearch.io: a Pushshift-powered full-text search UI for Reddit. No longer operational for its original purpose.

Reddit did re-enable Pushshift, but in a form that is useless to developers. The moderation-only program (documented at Reddit's mod support pages) requires subreddit moderator status, an explicit opt-in request, and restricts use to moderation purposes only. No historical research queries. No developer access. No API exposure to the public. The broader Reddit Data API wiki is now the only official route, and as covered in our Reddit Data API access guide, self-serve registration is closed.

For everyone who built tooling on Pushshift, the question is which of the surviving alternatives covers their actual use case. The answer depends on what you are building.


1. PullPush.io: The Drop-In Replacement That Still Struggles With Uptime

  • Historical depth: Full archive inherited from Pushshift (2005-2023), ongoing collection post-2023
  • Rate limit: 15 req/min soft cap, 30 req/min hard cap, ~1,000 req/hour long-term ceiling
  • Auth required: No
  • Best for: Cross-subreddit full-text keyword search, direct Pushshift code migration

PullPush is the closest thing to a direct replacement. It exposes the same endpoint pattern Pushshift used: api.pullpush.io/reddit/search/comment/ and api.pullpush.io/reddit/search/submission/ accept the same q, subreddit, author, before, and after parameters. If your existing code pointed at pushshift.io, pointing it at pullpush.io is largely mechanical.

The rate limit structure requires careful pacing for sustained collection. At 1,000 requests per hour, you need to space requests 3.6-4 seconds apart to avoid hitting the ceiling. The 30/minute hard cap means bursting faster than that triggers rejection immediately. For a single-user research project doing casual exploration, this is workable. For high-volume data collection, it is a hard constraint. If your work is closer to production scale, the rate-limit math in our throughput guide applies here too.

The reliability record through 2024-2025 is the real problem. UpDownRadar monitoring shows search.pullpush.io reporting down in late 2025. The PullPush community forum contains multiple separate threads titled variations of "PullPush is down again" and "Server Down," dating from 2024 onward. One documented maintenance window took the service offline for hardware upgrades and full reindexing, with no clear end-date guarantee. A separate forum thread documents a period where requests were taking over one minute per response during a performance degradation window.

Developers feel the difference. Practitioners building automation on PullPush still recommend it, but with caveats about its stability:

Suyog

Suyog

@SuyogAutomates

Day 5 of building 90 AI agents in 90 days Today, I built a tool that scrapes Reddit and gets you ideas to create content. All you have to do is get a subreddit and the keyword you want to look for (had a time crunch so had to make it as simple as possible). And it will do it… Show more

Embedded post media

For cross-subreddit full-text search, PullPush has an advantage over Arctic Shift. The q parameter searches across all subreddits simultaneously. If you are building keyword monitoring across communities or doing corpus-level linguistic analysis, this matters.

import requests, time

def search_pullpush(keyword, subreddit=None, after=None, before=None, size=100):
    params = {"q": keyword, "size": size}
    if subreddit:
        params["subreddit"] = subreddit
    if after:
        params["after"] = after
    if before:
        params["before"] = before
    resp = requests.get(
        "https://api.pullpush.io/reddit/search/comment/",
        params=params, timeout=30
    )
    resp.raise_for_status()
    time.sleep(4)  # respect 1,000/hour ceiling
    return resp.json().get("data", [])

Use PullPush when: you need cross-subreddit full-text search, you are migrating existing Pushshift code, and you can tolerate periodic outages with retry logic in place.


2. PullPush.io Reliability Record: Documented Outage Patterns

  • Outage frequency: Multiple per year documented across 2024-2025
  • Maintenance windows: Extended (weeks, not hours)
  • Monitoring source: UpDownRadar + community forum

A dedicated section on PullPush reliability is warranted because the marketing premise of "drop-in replacement" glosses over the operational reality. The community has its own running joke about the downtime, and the r/redditdev threads tracking it are blunt about the impact on real projects:

r/redditdev·u/No_Action_9027

[ Removed by Reddit ]

00
Open on Reddit

The hardware upgrade maintenance window that took the service offline for an extended period (with posts in the forum from frustrated users asking for estimated return times) is a structural indicator: PullPush is a volunteer-operated infrastructure project with limited capacity for redundancy or rapid recovery. This is not a criticism of the operators, who are providing a significant public service for free. It is a relevant factor for anyone building production systems or time-sensitive research pipelines on top of it.

Performance during high-load periods has also been documented as severely degraded. The forum thread documenting "requests taking 1+ minute per user" describes a period where the service was technically online but practically unusable for data collection at any volume.

BAScraper's documentation notes that due to lowered performance, using a single worker is recommended for PullPush unless the query is a short burst. That recommendation, from the maintainer of the most widely used wrapper library, reflects sustained real-world performance rather than worst-case speculation.

Practical recommendation: always implement exponential backoff and retry logic when querying PullPush. Do not use it as the sole data source for any time-sensitive collection pipeline. For critical research datasets, pair it with Arctic Shift as a fallback or go directly to the offline dumps for historical data. If reliability is the binding constraint, a maintained API is the cleaner answer, which is the whole reason redditapis.com exists as a third-party option.

The best PullPush alternative when uptime is the constraint

If PullPush going down mid-collection is your binding constraint, the practical PullPush alternative is a two-tier setup: Arctic Shift for high-throughput historical pulls, and a maintained hosted Reddit API for the live, always-on layer. Arctic Shift carries a much higher request ceiling and better uptime for bulk historical work, while a hosted Reddit API removes the volunteer-infrastructure risk entirely for anything time-sensitive or in production. Neither depends on Reddit's approval queue, and neither inherits PullPush's outage pattern. So the choice is not really "which free clone of PullPush", it is "how much reliability does this workload need", and you pick the tier that matches. See /pricing for the maintained option.


3. Arctic Shift: Highest Throughput, Best Coverage, Community-Run Caveats

  • Historical depth: December 2005 through the current month, with monthly releases
  • Rate limit: Dynamic, exposed via rate-limit headers
  • Auth required: No
  • Best for: High-concurrency data collection, recent data with low latency, many endpoint types

Arctic Shift is the other major free API alternative. It archives every public subreddit from December 2005 through the current month, with monthly torrent releases cross-posted to Academic Torrents with SHA256 checksums.

Data freshness comparison: how current each Pushshift alternative is, from the live official API and Arctic Shift through the Hugging Face Parquet and Watchful1 dump cutoffs to the dead public Pushshift

The API itself exposes more than a dozen endpoints, including:

  • /api/posts/search: search submissions by keyword, subreddit, author, date range
  • /api/comments/search: search comments with the same filters
  • /api/comments/tree: fetch a full comment thread by post ID
  • /api/users/interactions: get a user's comment and submission history
  • /api/time_series: aggregate post volume over time for a subreddit or keyword

No authentication is required. Rate limits are exposed via X-RateLimit-Remaining and X-RateLimit-Reset headers, so a well-written client can fully utilize the available quota without guessing. The throughput ceiling is much higher than PullPush for sustained collection.

Sustained throughput comparison on a log scale: PullPush at roughly 1,000 requests per hour and public JSON lower, versus Arctic Shift clearing roughly 120,000 per hour

One architectural limitation matters for cross-community keyword research: Arctic Shift's full-text search is scoped to a single user or subreddit at a time. There is no Reddit-wide q parameter equivalent. If your query is "find all comments mentioning X across all subreddits," Arctic Shift cannot do it in a single call. PullPush can.

The project carries an explicit caveat in its documentation: no uptime or performance guarantees. Arctic Shift is community-maintained with no formal SLA. Score data for archived content can be stale until the archive refreshes, so vote count data from very recent content is unreliable for trend analysis.

BAScraper's benchmarks show Arctic Shift handles many concurrent workers effectively, with typical response times around one second for basic queries and longer for complex ones. That is a significant concurrency advantage over PullPush for parallel collection jobs.

import asyncio, aiohttp

async def search_arctic_shift(session, keyword, subreddit, after=None, before=None):
    params = {"q": keyword, "subreddit": subreddit, "limit": 100}
    if after:
        params["after"] = after
    if before:
        params["before"] = before
    async with session.get(
        "https://arctic-shift.photon-reddit.com/api/comments/search",
        params=params
    ) as resp:
        remaining = int(resp.headers.get("X-RateLimit-Remaining", 100))
        if remaining < 10:
            await asyncio.sleep(1)
        return await resp.json()

Use Arctic Shift when: you need high throughput, your queries are scoped to specific subreddits or users, and you want the most current data with active monthly archive releases.


Start building with Redditapis

Reads $0.002, votes $0.005, writes $0.012, DMs $0.025. $0.50 free credits.

4. Arctic Shift vs. PullPush Head-to-Head: Latency, Throughput, and Query Scope

  • Summary: Different tools for different jobs. Neither fully replaces the other.

BAScraper, the Python library that wraps both services, includes benchmark data that makes the comparison concrete:

Metric PullPush Arctic Shift
Requests per minute (hard cap) 30 dynamic, far higher
Requests per hour (sustained) ~1,000 ~120,000
Recommended concurrent workers 1 10-20
Typical response time (basic) varies (1+ min when degraded) ~1 second
Cross-subreddit full-text search yes (q parameter) no (single sub/user only)
Auth required no no
Uptime SLA none, volunteer none, community

PullPush versus Arctic Shift head to head: throughput, concurrency, latency, coverage, and search scope, with the winning cell highlighted per row

BAScraper's maintainer states it plainly: Arctic Shift has better performance for simple queries, while PullPush performs better for complex queries. The "complex queries" here refers specifically to cross-subreddit keyword scans, where PullPush's Reddit-wide q parameter has no Arctic Shift equivalent.

For most longitudinal research tasks scoped to a set of specific subreddits, Arctic Shift's throughput advantage is decisive. For keyword corpus work across all of Reddit, PullPush is necessary.

If you are building a production pipeline and need reliability, the practical approach is to route subreddit-scoped queries through Arctic Shift at full concurrency, and reserve PullPush only for cross-subreddit full-text queries where it has no substitute. If you would rather not run that routing logic yourself, a maintained REST layer such as PRAW versus a hosted REST API covers the same ground without the uptime risk.


5. Watchful1 Data Dumps on Academic Torrents: The Offline-Complete Option

  • Historical depth: June 2005 through December 2025
  • Coverage: Top subreddits, multi-terabyte compressed
  • Auth required: No
  • Best for: Longitudinal research, offline processing, air-gapped pipelines

For researchers who need guaranteed completeness and do not want to depend on any external API, the Watchful1 Academic Torrents dump is the only option that delivers everything in one place.

The full dataset (2005-06 to 2025-12) is available as a single torrent containing tens of thousands of individually selectable files. Each file corresponds to a specific subreddit's data in zstandard-compressed NDJSON format (.zst). Monthly individual dumps let you update incrementally without re-downloading the full archive.

The file format is identical to what Pushshift used (NDJSON with the same field schema), so any existing Pushshift-era parsing code requires no modification. Python parsing scripts live at github.com/Watchful1/PushshiftDumps:

## single_file.py pattern (simplified)
import zstandard, json

def read_zst(filepath):
    with open(filepath, "rb") as fh:
        dctx = zstandard.ZstdDecompressor()
        with dctx.stream_reader(fh) as reader:
            for line in reader.read().splitlines():
                yield json.loads(line)

for obj in read_zst("r_Python_comments.zst"):
    print(obj["author"], obj["body"][:80])

The selective download capability is critical for practical use. A torrent client can download only the files for the specific subreddits you need. If your research covers r/MachineLearning, r/datascience, and r/learnpython, you download three files rather than the entire multi-terabyte set. The video walkthrough below shows how the original Pushshift dataset was structured, which maps directly onto these dumps:

There is no API, no authentication, no rate limit, and no external dependency after the initial download. This makes it the only viable option for air-gapped research environments, IRB-approved studies requiring local data custody, and pipelines where API availability cannot be guaranteed.

The trade-off is coverage currency. The December 2025 cutoff means data from January 2026 onward requires a supplemental source. Monthly incremental updates are published but require manual monitoring and download. There is no automatic sync, so for current data you still need a live path such as the REST vs PRAW comparison covers.

Use data dumps when: you are building a longitudinal dataset spanning years, need guaranteed completeness for a specific subreddit set, or are operating in an environment that prohibits external API dependencies.


6. Arctic Shift on Hugging Face: Zero-Setup SQL Queries Over Billions of Items

  • Dataset: Arctic Shift mirror on Hugging Face
  • Coverage: December 2005 through early 2026
  • Volume: Billions of items in compressed Parquet
  • Auth required: Hugging Face account for downloads; none for DuckDB streaming
  • Best for: SQL-style analysis, filtered sampling, exploratory research without storage commitment

The Hugging Face mirror of the Arctic Shift dataset enables DuckDB streaming queries without downloading any files. This is the most accessible entry point for exploratory analysis:

import duckdb

## Query without downloading anything
result = duckdb.sql("""
    SELECT author, body, score, created_utc
    FROM read_parquet('hf://datasets/.../comments/**/*.parquet')
    WHERE subreddit = 'MachineLearning'
      AND body LIKE '%transformer%'
      AND created_utc BETWEEN 1609459200 AND 1640995200
    LIMIT 1000
""").df()

The dataset covers roughly two decades of comment-months and submission-months. Selective month-level downloads are supported via the Hugging Face CLI:

huggingface-cli download <dataset> \
  --include "data/submissions/2024/01/*" \
  --repo-type dataset

This lets you download only the months relevant to your analysis, rather than committing to the full compressed footprint.

The Parquet format provides columnar storage efficiency, meaning filtering on subreddit, date range, or score costs only a fraction of a full scan. For large-scale linguistic research where you need SQL-style aggregations over multi-year corpora, this is substantially more practical than decompressing NDJSON files locally. DuckDB's documentation covers the remote-Parquet patterns directly.

The early-2026 cutoff means the most recent months are not available through this mirror. For recent data, the Arctic Shift API or PullPush fills the gap. Researchers in r/redditdev hit exactly this seam when they try to use Reddit as a current corpus:

r/redditdev·u/ashplease

Alternatives to Reddit Pushshift API for corpus data?

00
Open on Reddit

Use Hugging Face Arctic Shift when: you want SQL-style exploratory analysis, need filtered subsets of the billions-of-items corpus, and do not want to manage a torrent download or API rate-limit loop.


7. Reddit's Official API (2026) and the AI-Era Lockdown: What It Cannot Do for Historical Research

  • Historical depth: Last 1,000 items per listing, no date-range search
  • Rate limit: 100 OAuth queries/minute (free tier, averaged)
  • Auth required: Yes (OAuth, manually approved application)
  • Best for: Current content monitoring only

The official Reddit API is not a Pushshift replacement. This is not a positioning claim. It is a technical fact about what the API supports.

What the official Reddit API cannot do: the 1,000-item listing cap, no date-range search, no comment search, closed self-serve access, and multi-week approval, contrasted with a maintained hosted API row

Every listing endpoint (/new, /top, /hot, /rising, /controversial) has a hard cap of 1,000 items regardless of how you paginate. There is no mechanism to retrieve posts older than the 1,000th result in a listing. The /search endpoint returns results with preset time filters (past hour, day, week, month, year, all time) but does not support exact date-range parameters. Comment search is not a native feature; the common workaround is to retrieve post IDs via listing endpoints and then fetch comments by ID, which inherits the same 1,000-item limitation.

The access situation became more restrictive when Reddit's Responsible Builder Policy required manual pre-approval for all new API applications, including personal hobby projects. Reddit's stated target review time is 7 days. Developer community reports place the actual wait at multiple weeks, with frequent rejection for non-commercial or small-scale projects. A developer analysis from molehill.io described the shift bluntly: Reddit removed self-service access, so you now submit a request and wait for approval, and small commercial tools are often rejected unless they can pay for an enterprise tier.

The pricing structure for commercial access reflects Reddit's positioning as an enterprise data vendor rather than a developer platform. The 2023 fallout when Apollo's developer estimated $20M/year under the new pricing made that explicit. For historical research, monitoring beyond the last 1,000 posts, or full-text search with date ranges, the official API provides none of these capabilities at any price point on a self-service basis. The full access picture is in our Reddit Data API 2026 guide, and the OAuth flow itself is covered in the authentication walkthrough.

Use the official API when: you are monitoring current subreddit activity, building a real-time application that needs only recent content, and your use case fits inside the free-tier limits.


8. SocialGrep and Hosted Providers: When You Want Search, Not Dumps

  • SocialGrep pricing: consumer-accessible monthly tiers
  • Historical depth: back to 2010
  • Best for: Keyword monitoring, trend tracking, alerting on search volume

What each Pushshift alternative costs: free APIs and dumps trade engineering and storage, SocialGrep and managed scrapers charge monthly, and a maintained hosted API bills flat per call

SocialGrep fills a specific niche: real-time Reddit search with historical data back to 2010, an API, and alert functionality at consumer-accessible pricing. Its user base includes finance researchers, academics, marketers, and economists who need keyword monitoring rather than bulk archive access.

At its monthly tiers, SocialGrep is appropriate for teams that want to track mentions of a term or brand across Reddit without writing any parsing code. It provides search and alert functionality, not raw data export, and is unsuitable for longitudinal dataset construction or bulk collection.

For organizations that need Reddit data but cannot or will not operate their own data pipeline, third-party managed providers exist at higher price points:

  • Apify: pay-per-run Reddit scrapers and actors (see apify.com)
  • Bright Data: Reddit datasets at managed-volume pricing (see brightdata.com)
  • Oxylabs: similar Reddit scraping infrastructure (see oxylabs.io)

These services are appropriate for enterprise teams that need compliance support, do not want to build and maintain collection infrastructure, and have budget for the ongoing subscription. For individual researchers, hobbyists, or lean teams, the free alternatives (PullPush, Arctic Shift, data dumps) are the correct choice, and the pricing-versus-Apify breakdown shows where the lines fall.

Hosted providers are not Pushshift replacements for research purposes. They lack the bulk-export capability, the field-level completeness, and the volume depth that Pushshift provided. They are monitoring and alerting products with a data-access layer.


The cheapest Reddit API. Try it free.

Reads from $0.002 per call. $0.50 free credits. No credit card required.

9. Why SERP Scraping Is Not a Real Pushshift Alternative

  • Study: Poudel et al., ACM Web Conference 2024
  • Finding: Reddit SERP data is systematically biased toward high-karma, politically neutral, positive-sentiment posts
  • Conclusion: SERP is probably not a viable alternative to direct access to social media data

A common fallback suggestion when API access fails is to pull Reddit posts from Google or Bing search results. A 2024 peer-reviewed study published at the ACM Web Conference tests this hypothesis rigorously and finds it invalid.

Why SERP scraping fails as a Pushshift alternative: SERP-sourced posts average a score of 550 versus 49 in the full corpus, with political, explicit, and negative-sentiment content systematically underrepresented

The researchers measured Rank Turbulence Divergence between Reddit data retrieved via Google and Bing SERPs versus the full Reddit corpus. The results are stark:

  • SERP average post score: 550.69
  • Full corpus average post score: 48.97
  • RTD for SERP: 0.47 (vs approximately 0.30 baseline)

The study's conclusion: SERP is probably not a viable alternative to direct access to social media data.

The bias is not random noise. Content systematically underrepresented in SERP results includes political commentary, explicit content, and negative-sentiment posts, which are exactly the content categories most studied in computational social science research on radicalization, misinformation, and mental health.

What this means in practice: any dataset built from Google or Bing Reddit results will over-represent high-upvote, consensus-friendly content and under-represent the contentious, low-karma, or community-specific material that makes Reddit analytically interesting. A mental health study built on SERP data would miss the most acute distress signals. A misinformation study would miss low-karma fringe content that later goes viral. For accurate search-based access, a real search endpoint is the answer, as covered in the Reddit search API tutorial.

For exploratory keyword spotting at consumer scale, SERP is a usable shortcut. For any research claiming to represent Reddit's content distribution, it introduces unmeasurable bias that invalidates conclusions.


10. BAScraper: The Python Library That Abstracts Both Services

  • GitHub: github.com/maxjo020418/BAScraper
  • Best for: Developers who want a single async interface for both PullPush and Arctic Shift

BAScraper is the practical layer between your code and the two main Pushshift alternatives. It is an async Python library (asyncio-native) that handles service routing, rate-limit header parsing for Arctic Shift, and manual sleep-based pacing for PullPush's hourly ceiling.

Key configuration parameters:

  • service="pullpush" or service="arctic_shift": routes all queries to the chosen backend
  • task_num=1: recommended for PullPush due to sustained performance issues
  • task_num=10-20: appropriate for Arctic Shift
  • pace_mode: enables automatic request spacing against PullPush's long-term rate limit
  • the library reads Arctic Shift's X-RateLimit-Remaining and X-RateLimit-Reset headers automatically
from BAScraper.BAScraper import BAScraper_async
import asyncio

async def main():
    # Arctic Shift with 10 concurrent workers
    scraper = BAScraper_async(service="arctic_shift", task_num=10)
    comments = await scraper.search_comments(
        q="pushshift alternative",
        subreddit="datascience",
        after="2024-01-01",
        before="2025-01-01"
    )
    print(f"Retrieved {len(comments)} comments")

asyncio.run(main())

BAScraper does not handle the Watchful1 data dumps (those are offline files, not API endpoints). For mixed pipelines that combine API access with offline dump processing, you will need to write the dump-reading layer separately using the Watchful1/PushshiftDumps script patterns. If you would rather skip the wrapper entirely and call a single REST endpoint, the Python REST tutorial shows that pattern.

The library's benchmark notes reflect real-world conditions: Arctic Shift is the faster and more reliable backend for per-subreddit queries. PullPush is the necessary backend for cross-subreddit keyword scans. BAScraper lets you switch between them without changing your application logic. Fireship's overview of the original API change explains why all of this tooling had to exist in the first place:


11. Tools That Died When Pushshift Died: Know What to Avoid

The downstream casualty list matters because old Stack Overflow answers, GitHub issues, and Reddit threads still recommend these tools. Testing any of them will waste time in 2026.

Tools that died with Pushshift: Removeddit, Ceddit, Unddit, Reveddit, redditsearch.io, and the PSAW and PMAW wrappers, each marked dead or mod-only with what it used to do

  • Removeddit (removeddit.com): Dead. Retrieved deleted Reddit posts by fetching Pushshift's cached version. No Pushshift access means no deleted post recovery.
  • Ceddit: Dead. Same mechanism as Removeddit, same outcome.
  • Unddit (unddit.com): Effectively dead for general users. Analyses that tested every Reddit deleted-post recovery tool found most returning empty results or error pages. The Pushshift data stream was the only source for recovering deleted content at scale.
  • Reveddit (reveddit.com): Switched to its own API to survive, but now requires Reddit moderator verification to access the moderation-tier Pushshift data. Usable only by moderators of specific subreddits.
  • redditsearch.io: No longer operational for its original full-text search purpose. The domain may resolve but the search functionality that made it useful required Pushshift's backend.

The common thread: all of these tools were built as thin frontends over Pushshift's data stream. Without the stream, they are shells. Any tutorial, course, or code sample that references these tools as a data source needs to be treated as pre-2023 content that no longer applies. The same warning applies to anyone who still believes Pushshift itself is reachable, which is why people keep posting about it:

Archduke of Gudha

Archduke of Gudha

@mookooll

So Reddit APIs have your data. This guy is using arctic shift API. To get it removed &gt;go to Arctic Shift GitHub page. &gt; You can also DM the developer on Discord (raiderbv) or email them. Other reddit APIs which have your reddit data are pullpush and pushshift


12. Public JSON Endpoints: The Zero-Cost Read-Only Fallback

  • Rate limit: Approximately 10 requests/minute (unauthenticated)
  • Historical depth: Last 1,000 items per listing
  • Auth required: No
  • Best for: Subreddit monitoring, comment fetching by post ID, current-content trend tracking

Reddit exposes structured JSON at any URL by appending .json. No authentication, no API key, no application approval. This still works in 2026.

import requests, time

def get_subreddit_new(subreddit, limit=100):
    url = f"https://www.reddit.com/r/{subreddit}/new.json"
    headers = {"User-Agent": "myresearchtool/1.0"}
    resp = requests.get(url, params={"limit": limit}, headers=headers)
    time.sleep(6)  # 10 req/min unauthenticated
    return resp.json()["data"]["children"]

def get_post_comments(post_id):
    url = f"https://www.reddit.com/comments/{post_id}.json"
    headers = {"User-Agent": "myresearchtool/1.0"}
    resp = requests.get(url, headers=headers)
    time.sleep(6)
    return resp.json()

The same 1,000-item pagination ceiling applies. Full-text search with date ranges is not available. The endpoint does not work for private or quarantined subreddits. Reddit monitors for automated traffic patterns and throttles or blocks IPs that exceed the expected ceiling.

The JSON endpoint is appropriate for low-volume, current-content work: monitoring a subreddit's most recent posts, fetching comments from a specific post by ID, or tracking trend indicators on recent content. It is not a research database and never was.

For any workload that exceeds roughly 1,000 requests per day or needs historical data, you need one of the substantive alternatives above, or a maintained REST layer that handles the throttling for you. Benchmarks for throughput and error rates show where the JSON endpoint stops being viable.


Which Pushshift Alternative Should You Use? A Decision Framework by Use Case

The honest answer is that no single tool replaces what Pushshift was. Pushshift combined historical depth (2005 onward), cross-subreddit full-text search, bulk export, real-time ingestion, and a stable free API in one system. No surviving alternative offers all five. The choice depends on which of those properties your use case requires most.

Map your constraint to a pick:

  • Full historical depth, offline: Watchful1 dumps or Arctic Shift Hugging Face Parquet.
  • Reddit-wide keyword search: PullPush (the only Reddit-wide q parameter).
  • High-throughput recent data: Arctic Shift with BAScraper.
  • No setup, no approval queue, maintained: a hosted REST API such as redditapis.com.

Decision framework for picking a Pushshift alternative by use case: historical depth routes to dumps or Parquet, Reddit-wide search to PullPush, high-throughput recent data to Arctic Shift, and a maintained no-setup API to a hosted Reddit API

Use case 1: Longitudinal research dataset (multi-year, specific subreddits) Primary: Watchful1 Academic Torrents or Arctic Shift Hugging Face Parquet. Both cover 2005-2025/2026 at full depth. Watchful1 is better for specific subreddit subsets you can select per file; Hugging Face is better for SQL-style sampling across multiple subreddits without managing TB-scale downloads.

Use case 2: Cross-subreddit keyword search (all of Reddit, keyword-driven) Primary: PullPush API (only tool with Reddit-wide full-text search). Accept the hourly ceiling and implement retry logic for downtime. Supplement with PullPush recent data for content after the data dumps' cutoff.

Use case 3: High-throughput subreddit-scoped collection (recent data, low latency) Primary: Arctic Shift API with BAScraper. Best for per-community collection pipelines that need to stay current.

Use case 4: Exploratory SQL analysis over the full Reddit corpus Primary: Arctic Shift on Hugging Face, DuckDB streaming. No storage commitment, no download needed for filtered queries.

Use case 5: Current subreddit monitoring, no historical data needed Primary: Reddit official API (OAuth) or public JSON endpoints. Both cover recent content adequately. Official API gives higher rate limits; JSON endpoint requires no application approval.

Use case 6: A maintained API with no approval queue or uptime gambles Primary: a third-party hosted Reddit API such as redditapis.com, which bills per call and skips the Responsible Builder Policy ticket. See /pricing, the alternatives comparison, and the cost calculator to model it against the free options.

  • For Python-based projects: install BAScraper and use it as the abstraction layer over both PullPush and Arctic Shift, or call a single REST endpoint per the Python tutorial and skip the per-service tuning. If you need to send as well as read, the DM-via-API guide covers the write side.

The throughput gap between the free alternatives and Pushshift's original capability is real. PullPush's 1,000 requests per hour was not Pushshift's rate limit; it is a significant reduction from what Pushshift provided. Arctic Shift's ceiling is much closer to what production research pipelines need. The offline dumps eliminate the rate-limit constraint entirely at the cost of requiring local storage and manual update cycles.

The research community lost an irreplaceable shared infrastructure when Reddit revoked Pushshift's access. The alternatives above are the actual working options. None of them are as simple as pointing your code at pushshift.io was. The tradeoffs are real and the choice requires understanding your specific data requirements. If your constraint is reliability rather than budget, a maintained, independent, third-party API removes the two failure modes that recur across every free option: downtime and approval queues. Start at /signup for a flat per-call path, or read the REST vs PRAW comparison first.


All rate limits and data coverage figures current as of June 2026. Arctic Shift releases monthly; check the project releases for the current coverage date. Academic Torrents datasets are updated periodically; check academictorrents.com for the latest Watchful1 uploads.

Where these numbers come from.

Each row is a figure in this post and the artefact it was read from. Reddit's access rules and the third-party archives around them keep moving, so check the date on a source before you build against it.

Reddit Data API wiki
Reddit's own access documentation, cited as the only official route left after Pushshift closed to public developers.
Baumgartner et al., The Pushshift Reddit Dataset (ICWSM 2020)
The methodology paper behind the original dataset, and the citation the article points to when explaining why the shutdown broke so much downstream research.
ArthurHeitmann/arctic_shift
Source repository for the Arctic Shift archive, backing the coverage claim of every public subreddit from December 2005 to the current month.
Watchful1/PushshiftDumps
The parsing scripts referenced in the dump-processing section, and the evidence that the dump file format still matches the Pushshift-era NDJSON schema.
ACM Web Conference 2024, search-engine sampling of Reddit
The peer-reviewed test used to reject the common suggestion that Google or Bing results are a usable substitute for API access.

Frequently asked questions.

Pushshift is not available to the general public or to researchers. Since May 2023, Reddit has restricted Pushshift access to verified Reddit moderators for moderation purposes only. No public API, no bulk historical access, and no developer access is available. If you need programmatic Reddit data, see [/reddit-api-alternatives](/reddit-api-alternatives) for the live options.

PullPush.io is the closest free drop-in replacement, using the same endpoint schema and query parameters as Pushshift. For higher throughput and better uptime, Arctic Shift offers a far larger request ceiling with no authentication. For full offline access, the Watchful1 Academic Torrents dumps cover 2005 through 2025. If you want a maintained option with no approval queue, see [/pricing](/pricing).

Two options exist for pre-2023 historical data at full depth. Arctic Shift on Hugging Face lets you run DuckDB SQL queries over billions of items in compressed Parquet without downloading anything. The Watchful1 Academic Torrents dump is a multi-terabyte offline archive covering the top subreddits from 2005 onward. For recent data after the dump cutoff, pair it with a live API such as [/blogs/reddit-data-api-2026](/blogs/reddit-data-api-2026).

PullPush supports cross-subreddit full-text keyword search (the q parameter across all of Reddit) and uses the Pushshift endpoint pattern. Arctic Shift offers much higher throughput, handles more concurrent workers, and provides more endpoint types, but limits full-text search to a single subreddit or user at a time. For the official side of this trade-off, see [/blogs/reddit-data-api-2026](/blogs/reddit-data-api-2026).

If PullPush uptime is your problem, the strongest PullPush alternative is Arctic Shift for high-throughput historical pulls, or a maintained hosted Reddit API for the always-on live layer. Arctic Shift carries a far larger request ceiling and better reliability for bulk work, while a hosted API removes the volunteer-infrastructure outage risk entirely. See [/pricing](/pricing) for the maintained option.

No. A 2024 peer-reviewed study (Poudel et al., ACM Web Conference) measured Rank Turbulence Divergence between SERP-sourced Reddit data and the full corpus. SERP posts averaged a score of 550 vs 49 in the full corpus, and political, explicit, and negative-sentiment content is systematically underrepresented. For accurate data, use a direct API path such as [/reddit-search-api-tutorial-2026](/blogs/reddit-search-api-tutorial-2026).

BAScraper is an async Python library that routes requests to either PullPush or Arctic Shift, handles Arctic Shift's dynamic rate-limit headers, and exposes pacing controls for PullPush. It recommends a single worker for PullPush and supports concurrent workers for Arctic Shift. For a REST pattern that skips library setup entirely, see [/blogs/reddit-api-python-tutorial](/blogs/reddit-api-python-tutorial).

There is no like-for-like replacement. redditsearch.io relied entirely on Pushshift and is no longer operational. Unddit, Removeddit, and Ceddit are also effectively dead. Reveddit switched to its own API but now works only for verified moderators. For deleted-post recovery at scale, no public solution exists in 2026. See [/reddit-api-alternatives](/reddit-api-alternatives) for what does still work.

A third-party hosted Reddit API gives you a single bearer token with no Responsible Builder Policy ticket and no multi-week approval wait. redditapis.com is one such independent, third-party option that bills per call. Compare the access paths at [/blogs/reddit-api-pricing-vs-apify](/blogs/reddit-api-pricing-vs-apify) and start at [/signup](/signup).

Keep reading.

Continue exploring related pages.

Reddit API documentation

The complete 2026 reference: auth, all 36 endpoints, and code.

Get a Reddit API key

Instant bearer token, no waitlist and no enterprise contract.

Reddit Responsible Builder Policy

Why Reddit denies API applications, and the managed REST bypass.

Reddit API use cases

14 use cases from AI training to brand monitoring and DMs.

Reddit Search API

Search posts, comments, users, and communities over one REST endpoint.

Reddit MCP server

Wrap the REST API as MCP tools for Claude, Cursor, and any MCP client.

Reddit API for AI agents

Live Reddit context for tool calls, MCP servers, and RAG pipelines.

Redditapis pricing

Endpoint-level costs and quick monthly totals - reads from $0.002 / call.

Reddit API cost calculator

Estimate monthly spend using your request volume.

Reddit API guides and tutorials

Tutorials, walkthroughs, and API deep-dives for developers.

Reddit API alternatives

Evaluate alternatives by cost model, limits, and integration fit.

Official Reddit API vs Redditapis

Access, setup, rate limits, and pricing, side by side.

Affiliate program

Earn 20% lifetime commissions - capped at $5,000/yr.

Reddit Vote API tutorial

Upvote and downvote a post programmatically via the REST API.

Reddit Data API: REST, no PRAW

REST endpoints for Reddit data with no PRAW and no OAuth dance.

Reddit scraping benchmarks

Real throughput, error rates, and cost benchmarks for Reddit scraping.

Reddit API answers

Direct answers on cost, access, rate limits, endpoints, and auth.

How much the Reddit API costs

Per-call pricing from $0.002 a read, with $0.50 in free credits.

Reddit API in Python

One requests call with a bearer token, no PRAW and no OAuth flow.

Reddit shadowban checker

Check if a Reddit account is shadowbanned in seconds, free and no login.

Similar reads.

More guides on the Reddit API, scraping, pricing, and MCP servers.

Reddit for AI training data in 2026: an independent third-party developer guide to Arctic Shift historical dumps, a paginated REST API for current posts, JSONL formatting for LLM fine-tuning, and cross-source deduplication. redditapis.com is not affiliated with Reddit Inc.
arctic shift redditreddit data for ai training

Arctic Shift for Reddit: The Clean AI Training Data Pipeline (2026)

How to assemble a clean Reddit training corpus in 2026: what Arctic Shift gives you (2.5B items, ~261GB Parquet through February 2026), what it cannot (real-time data), and the REST API path for current posts, JSONL formatting, and cross-source dedup.

Emma·
Independent third-party reference on Reddit direct message and chat invite limits in 2026, separating the undocumented consumer cap from the documented Data API chat message limits
Reddit APIReddit DM

Reddit DM Limits in 2026: Daily Caps, Chat Requests, and What Resets Them

Reddit publishes no number for the daily chat invite cap, but it does publish chat message limits for the Data API. Both sets, verbatim, with what resets each.

Redditapis·
Deciding between building a Reddit scraper API in Python and using a managed Reddit data API
Reddit APIWeb Scraping

Reddit Scraper API in Python: When to Build Your Own vs Use a Managed API

A Reddit scraper API in Python is either a client you maintain or one you rent. Live 2026 endpoint tests, working code for both paths, and the volume where buying wins.

Redditapis·
Independent third-party guide to packaging the Reddit Data API as a reusable Agent Skill with a SKILL.md file and a bundled fetch script, giving an AI agent live Reddit access
Reddit APIAgent Skills

Package the Reddit API as an Agent Skill: Give Your AI Agent Live Reddit (2026)

Package the Reddit API as a reusable Agent Skill: a real SKILL.md, a bundled fetch script, one bearer token, and how a skill differs from an MCP server.

Redditapis·
Independent third-party tutorial for calling the Reddit Data API from the Bun runtime with native fetch and one bearer token, no wrapper library and no build step
Reddit APIBun

Reddit API with Bun: A Native fetch Client in TypeScript (2026)

Call the Reddit API from Bun with native fetch, one bearer token, built-in TypeScript, a Bun.serve proxy, and Bun's SQLite cache. No wrapper, no build.

Redditapis·
Independent third-party tutorial for calling the Reddit Data API from Go with plain net/http and one bearer token, no wrapper library and no OAuth developer app
Reddit APIGo

Reddit API in Go: A Runnable net/http Client for 2026

Call the Reddit API from Go with plain net/http, one bearer token, typed structs, after-cursor pagination, and a concurrent worker pool. No wrapper.

Redditapis·
Independent third-party guide to the redditapis-mcp npm package as the typed JS and TypeScript way into the Reddit Data API, installed via npx into any MCP client
Reddit APInpm

The Typed Reddit npm Package: redditapis-mcp as Your JS/TS Way In (2026)

redditapis-mcp is the typed JS/TS way into the Reddit API: install via npx into any MCP client, use its 11 read tools, or import its query builders.

Redditapis·
Independent third-party tutorial for building a fully typed Reddit Data API client in TypeScript with Zod validation and a discriminated-union comment tree, no wrapper library
Reddit APITypeScript

A Typed Reddit API Client in TypeScript: Zod, Unions, and Safe Parsing (2026)

Build a typed Reddit API client in TypeScript: response interfaces, Zod runtime validation, a discriminated-union comment tree, and branded fullnames.

Redditapis·