Best approach for de-duplicating large combo lists?
by rfa7k29xq - Saturday November 14, 2026 at 10:32 PM
RaidForums
Member
PGP Key 🔐
Posts: 10
Threads: 6
Joined: Nov 2026
Reputation: 0

#1
54 minutes ago
When two leaks overlap heavily, do you prefer exact line hashing or fuzzy matching on emails? I have been comparing both approaches and fuzzy matching catches more duplicates but is noticeably slower on very large files.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  REQUEST Large PII password datasets (name, phone, mail, etc.) for LLM training dtasfar 0 503 01-14-2026, 04:15 PM
Last Post: dtasfar
  REQUEST looking for database/combo email:pass user:pass for romania georgel23 0 973 02-22-2025, 06:19 PM
Last Post: georgel23
  what is the best way to get data from a website datasharing1 0 984 02-16-2025, 09:03 PM
Last Post: datasharing1
  REQUEST Searching COMB mail:pass | large mail pass bases Grobik 0 1,125 02-05-2025, 05:47 PM
Last Post: Grobik
  REQUEST need to download a large file from mega termit 2 1,440 01-16-2025, 10:07 PM
Last Post: redmonkeytechie



 Users browsing this thread: 13 Guest(s)