Feed Viewer logo Feed ViewerRead the web on your terms
Curation

How to Stop Duplicate RSS Stories From Cluttering Your Feed

You open your reader in the morning and the same product launch shows up seven times: once from the company blog, once from two tech sites, once from an aggregator and three more times from newsletters that you also pipe into RSS.

A laptop on a wooden desk showing a feed reader with a tidy list of headlines next to a notebook and a cup of coffee

You open your reader in the morning and the same product launch shows up seven times: once from the company blog, once from two tech sites, once from an aggregator and three more times from newsletters that you also pipe into RSS. Duplicate RSS stories are the quiet reason a feed reader starts to feel like work, and they get worse the better your source list gets.

I have run a reader with around 240 feeds for years, and duplicates used to eat roughly a fifth of my unread count. Getting that down to a handful a day took a mix of reader settings, a few source decisions and one habit change. Here is the full setup.

Why duplicate RSS stories happen in the first place

Duplicates come from three different places, and each one needs a different fix.

  • Same item, multiple feeds from one site. Many sites publish a main feed, a category feed and a tag feed. Subscribe to two of them and every overlapping post arrives twice.
  • Same item, changed URL. Some publishers add tracking parameters or switch from http to https, so your reader sees a new link and treats the post as new.
  • Same news, different writers. Five outlets covering one announcement are not technically duplicates, but they feel like it when you read them back to back.

The first two are mechanical problems your reader can often solve. The third is a curation problem, and it is the one most people try to fix with the wrong tool.

Fix the mechanical duplicates first

Start with a 15 minute audit. Export your subscriptions as OPML and open the file in any text editor. Sort or search by domain. In my first pass I found 19 sites where I followed both the main feed and a narrower one, which accounted for most of my exact duplicates.

  1. Pick one feed per site. If you want everything, keep the main feed and drop the category feeds. If you only want one section, keep that one and drop the main feed.
  2. Turn on your reader's duplicate detection. Several popular readers, including Inoreader and Feedly on their paid plans, can hide items with matching titles or links. Self hosted options like FreshRSS have similar settings or extensions. Set matching on title plus link if you can, not title alone.
  3. Clean tracking parameters. If a feed keeps re-sending posts after small edits, check whether its links include utm tags. Some readers strip these automatically; if yours does not, a filter rule on the URL usually helps.
  4. Stop feeding newsletters you already get as RSS. If a site has a feed and also a newsletter that you route into your reader, keep only one.

After this pass my exact duplicates dropped from about 40 a day to 6.

Handle same story, different source with folders and timing

The harder case is coverage overlap. Here, the answer is not more filtering. It is deciding which sources you actually trust for which kind of news.

Rank your sources by role

I sort feeds into three folders: primary sources (company blogs, official changelogs, a few individual writers), analysis (people who add opinion or context) and roundups. When a story breaks, I read the primary source first and skip the reworded news versions entirely. If I want context, I wait for the analysis folder the next day.

Use a delay on roundup feeds

Roundup and aggregator feeds repeat what you already saw. I read that folder only on Fridays. By then, the stories I already read are easy to mark as read in bulk, and the few I missed stand out. This is the same logic behind turning RSS stars into a weekly link roundup: let time do the deduplication.

Why aggressive keyword muting is the wrong fix

The common advice is to set mute rules for any big topic that floods your feed. Launch week for a new phone? Mute the phone's name. I tried this and it backfired twice.

First, keyword mutes are blunt. Muting a product name also hid the one honest long term review I actually wanted, published three weeks later. Second, mutes pile up silently. Six months on I had 31 active rules and could not remember why half of them existed, which meant my reader was hiding things I would have liked.

What works better is muting by source and time, not by topic. If one outlet floods you during a launch, mute that feed for 7 days. Most readers let you set an expiry on a filter, so it lifts itself. You keep the topic, you lose the noise, and nothing is hidden forever without your knowledge.

A weekly routine that keeps duplicates down

Settings decay. New subscriptions bring new overlap. A short routine keeps things clean.

  • Monday, 5 minutes: skim the list of items your duplicate filter hid. If it hid something real, loosen the rule.
  • When you subscribe to a new site: check if you already follow a feed from the same domain or a site that republishes it.
  • Once a month: sort feeds by unread count. Any feed with 100 or more unread items is either a duplicate machine or something you no longer read. Drop it.

If your backlog is already big when you start, deal with it before tuning anything. Our guide to clearing a read later backlog you keep ignoring works just as well on an overflowing reader.

Sites that republish other sites

Watch for syndication. Some outlets republish wire stories or partner content in full, which means a single article can arrive from four or five domains with slightly different headlines. If two sources share more than half of their stories in a given week, keep the one that publishes first and drop the other. A quick way to test this is to star every repeat for seven days and count which feeds the stars come from.

What a clean feed looks like

For me, a good day now means 60 to 90 new items, nearly all unique, and about 20 minutes of reading. Before the cleanup it was 150 items and a constant sense of reading the same headline again. The sources did not get worse. The overlap just stopped reaching me.

Frequently asked questions

How do I remove duplicate articles in my RSS reader?

Start by unsubscribing from overlapping feeds on the same site, since that causes most exact duplicates. Then enable your reader's duplicate filter if it has one, matching on both title and link. For coverage overlap between outlets, reorganize feeds by role rather than adding more filters.

Why does my RSS feed show the same post twice?

Usually the publisher changed the post's URL or GUID after an edit, so your reader sees it as new. It can also happen when you follow two feeds from one site that both include the post. Check the links on both copies to see which case it is.

Is it better to filter by keyword or by source?

For reducing repetition, source filters with an expiry date work better than keyword mutes. Keyword rules hide useful posts on the same topic and tend to pile up unnoticed. Keep keyword filters for topics you never want to see at all.

LF
Leocadia Fennimore

Leocadia has used RSS since the days of Google Reader and never stopped. She edits the site's feed and reader coverage and keeps around four hundred subscriptions under control.

More posts by Leocadia

More in Curation

01doorganico 084goad 3hot8 4465456 after5internprogram ahandfulofblessings ahmadpc ahomcybersecurity allodialresources annodex antiquesandperiodcollectibles aotc asianworldkashmir beedlectrics bloggertemplatefree bluefeatheragency bodyweightsolution campaign08blog carfixadvisor catstreetcollective cbstvsports cnfanspurchasing committeeof500yearsofdignityandresistance covertopsdjs cs-kaiyuangame cuestacomunicaciontotal cxoutlet dancebetgame deskgearhub destinyvillastay detectmagazine di33 diamondsteelbuildings donmo dyanadropship emarsysfinance emimattl escapechan eskitarih evautoplay everythingweddings-orlando farmzone foxstudiosscratch gamevui123 gleasongrade greetingsday hacklabasu haskell iw-kaiyun jagoanproperti jilidskripsi joltbusinessfinance juegodepokergratis juegospucca kaeru-festival latestmehndidesigns lestanzediottaviano litemagazines localcommunityhero lustrsazan mariashebets menswheels newwebstechs1 nikkit ootheday oxigenvpn plurfitness prefetial probudgetcarpetcleaning psychicmrsmartin pyaten qvantor rejoignezlogis rexzbot riselayouts ruchin rwxqsgd5 sakaltime shibiaowang shop-bot skrtips spotlesshaven strcoding tetapatrium topselller uneplanteartificielle vipertechcr webtech1223411 wo-kygaming yamaha-mekar yeknava yoybuysheets zenunwa yamaha-mekar jilidskripsi ankertoto ankertoto ankertoto