Navigate to top
Scientific record

An independently-verifiable benchmark record, 2009 – 2026

Plagiarism Detector is not a black box. Its detection engine has been entered into the field's primary scientific benchmark — the PAN competition — and judged by independent academic organizers across nine international evaluations. The complete record is below; every result links to its official source.

In brief Between 2009 and 2014 the engine competed in all six annual PAN International Competitions on Plagiarism Detection and in two PAN@FIRE cross-language tasks in India — winning the English–Hindi CL!NSS task in 2012. In 2026 the same lineage entered PAN's Voight-Kampff Generative AI Detection task and recorded the highest ROC-AUC (0.996) of any system in the evaluation, placing 3rd of 34 teams. The product has shipped continuously since 2007.
Complete competition record

Nine evaluations, every result sourced

YearCompetitionVenueTaskRankScoreSource
20091st International Competition on Plagiarism DetectionPAN @ SEPLN · San SebastiánExternal detection4 / 100.3045overview
20102nd International Competition on Plagiarism DetectionPAN @ CLEF · PaduaExternal detection8 / 180.5093overview · paper
20113rd International Competition on Plagiarism DetectionPAN @ CLEF · AmsterdamExternal (WordNet experiment)7 / 90.19overview · paper
2011CL!TR — Cross-Language Indian Text Re-UsePAN@FIRE · IIT Bombay, MumbaiHindi↔English reuse4 (best run)F 0.603leaderboard · overview
20124th International Competition on Plagiarism DetectionPAN @ CLEF · RomeText alignment6 / 100.538overview · paper
2012CL!NSS — Cross-Language Indian News Story Search 1STPAN@FIRE · ISI KolkataJournalistic reuse (en→hi)1 / 3NDCG@10 0.34overview · paper
20135th International Competition on Plagiarism DetectionPAN @ CLEF · ValenciaText alignment6 / 90.61523overview · paper
20146th International Competition on Plagiarism Detection 1ST*PAN @ CLEF · SheffieldText alignment1 std · 3/100.868overview · paper
2026Voight-Kampff Generative AI Detection TOP AUCPAN @ CLEF · JenaHuman-vs-AI text3 / 34ROC-AUC 0.996leaderboard

plagdet = the PAN overall plagiarism-detection score (precision, recall and granularity combined). NDCG@10 = ranking quality. ROC-AUC = threshold-independent classification quality. *2014: 1st on the standard test corpus, 3rd of 10 on the official ranking corpus. 2026: 3rd of 34 teams; highest ROC-AUC of any team or baseline.

From the lab to the product

The methods you're trusting

Each competition documented a technique that informs the shipping engine. The research and the software are one lineage — not marketing claims, but published, peer-reviewed methods.

N-gram fingerprinting

Fast candidate detection of reused passages (PAN 2010, 2014).

Text alignment

Precise matching of source ↔ suspicious passages with high precision (PAN 2012–2014).

Semantic and cross-language similarity

WordNet and TF-IDF / translation methods for paraphrase and cross-lingual reuse (PAN 2011; FIRE 2011–2012).

AI-generated-text detection

Distinguishing human from machine authorship — top ROC-AUC at PAN 2026.

Peer-reviewed publications

Bibliography

  1. Developing a High-Resolution Universal Multi-Type N-Gram Plagiarism Detector. Palkovskii & Belov. PAN @ CLEF 2014 Working Notes. CEUR-WS Vol-1180 ↗
  2. Using Hybrid Similarity Methods for Plagiarism Detection. Palkovskii & Belov. PAN @ CLEF 2013. CEUR-WS Vol-1179 ↗
  3. Applying Specific Clusterization & Fingerprint Density Distribution with a Genetic Algorithm. Palkovskii & Belov. PAN @ CLEF 2012. CEUR-WS Vol-1178 ↗
  4. Using a TF-IDF Weight Ranking Model in CL!NSS. Palkovskii & Belov. FIRE 2012, ISI Kolkata. FIRE working notes ↗
  5. Using WordNet-Based Semantic Similarity Measurement in External Plagiarism Detection. Palkovskii & Belov. PAN @ CLEF 2011. CEUR-WS Vol-1177 ↗
  6. Exploring Fingerprinting as an External Plagiarism Detection Method. Palkovskii & Belov. PAN @ CLEF 2010. CEUR-WS Vol-1176 ↗
  7. "Counter Plagiarism Detection Software" & "Counter-Counter Plagiarism Detection" Methods. Palkovskii. PAN'09. CEUR-WS Vol-502 ↗
About the author
YP

Yurii Palkovskii

Researcher and Lead Developer · Zhytomyr State University, Institute of Foreign Philology · SkyLine LLC

Author of seven peer-reviewed papers on plagiarism and AI-generated-text detection across the CLEF/CEUR-WS and FIRE proceedings, with results evaluated independently by the PAN organizing committee (Potthast, Stein, Rosso, Hagen et al.).

Every rank and score on this page is taken from the official competition overview paper or leaderboard linked beside it — verifiable independently of this website. Product in active development since 2007; current build #2965.