Efficiency of national and international software in detection of similarity and plagiarism in manuscripts
DOI:
https://doi.org/10.19132/1808-5245284.123123Keywords:
plagiarism, similarity and plagiarism, plagiarism detection, anti-plagiarism softwareAbstract
This study aims to identify the efficiency level of fourteen software for detecting similarities between a text with fragments extracted from online content on financial education, found on open access websites, proceedings of academic events and open and restricted access scientific journals. Fragments extracted from the sources were used to create a cohesive text, written in Portuguese, containing literal textual reproductions, paraphrases, translation from the English language and manipulation with insertion of hidden characters and replacement of words by synonyms. The similarity reports generated by the programs were analyzed according to four criteria: 1 identification of correctly cited fragments; 2 identification of plagiarized fragments; 3 identification of texts manipulated to deceive the software; 4 identification of original sources, which were scored on a scale of 0 to 4 points. Although the Turnitin, Strikeplagiarism and Plagscan software obtained the best performance indices, it was found that the programs operate with variable and limited efficiency, which reinforces the conviction that, although they are useful tools for the identification of plagiarism, they contribute significantly limited by aspects such as recognition mainly of literal textual reproductions that do not always correspond to the original source. The original sources of rewritten, manipulated and translated texts were not found by any software. The study contributes to the improvement of the user's ability to choose, use and analyze the similarity reports generated by software, whose efficiency can be greater in the case of using more than one program.
Downloads
References
ABREU, R. M. Proposta de arquitetura para um sistema de detecção de plágio multi-algoritmo. Rio de Janeiro: Universidade Federal do Rio de Janeiro, 2011.
AMOS, K. A. The ethics of scholarly publishing: exploring differences in plagiarism and duplicate publication across nations. Journal of the Medical Library Association, Chicago, v. 102, n. 2, p. 87-91, 2014.
ASSOCIATION FOR COMPUTING MACHINERY (ACM). Acm policy on plagiarism, misrepresentation, and falsification. Broadway, 2019. Disponível em: https://www.acm.org/publications/policies/plagiarism-overview. Acesso em: 25 fev. 2022.
BARBASTEFANO, R. G.; SOUZA, C. G. Percepção do conceito de plágio acadêmico entre alunos de engenharia de produção e ações para sua redução. Revista Produção Online, Florianópolis, v. 7, n. 4, 2007.
BENNETT, R. Factors associated with student plagiarism in a post‐1992 university. Assessment & Evaluation in Higher Education, Oxon, v. 30, n. 2, p. 137-162, 2005.
CHAUDHURI, J. Deterring digital plagiarism, how effective is the digital detection process? Webology, Iran, v. 5, n. 1, p. 1-10, 2008.
CHRISTOFE, L. Intertextualidade e plágio: questões de linguagem e autoria. Campinas: Universidade de Campinas, 1996.
FACHINI, G. J; DOMINGUES, M. J. C. S. Percepção do plágio acadêmico entre alunos de programas de pós-graduação em administração e contabilidade. In: SEMINÁRIOS EM ADMINISTRAÇÃO FEA-USP, 11., 2008, São Paulo. Anais [...]. São Paulo: USP, 2008. p. 1-14.
FOLTÝNEK, T. et al. Testing of support tools for plagiarism detection. International Journal of Educational Technology in Higher Education, New York, v. 17, n. 46, p. 31, 2020.
FOLTÝNEK, T; MEUSCHKE, N; GIPP, B. Academic plagiarism detection: a systematic literature review. ACM Computing Surveys, New York, v. 52, n. 6, 2019.
GOOGLE FOR EDUCATION. Use os relatórios de originalidade para procurar com rapidez e facilidade os trechos onde faltam citações das fontes. 2022. Disponível em: https://edu.google.com/products/originality. Acesso em: 25 fev. 2022.
GUPTA, D.; VANI, K. Study on extrinsic text plagiarism detection techniques and tools. Journal of Engineering Science and Technology Review, Greece, v. 9, n. 4, p. 150-164, 2016.
HANSEN, B. Combating plagiarism: is the internet causing more students to copy? The CQ Researcher, Thousand Oaks, v. 13, n. 32, p. 773-796, 2003.
HOUAISS, A. Eficiência. In: HOUAISS, A. Dicionário Houaiss da Língua Portuguesa. Rio de Janeiro: Objetiva, 2009.
INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS (IEEE). Plagiarism levels and corrective actions, as taken from section 8.2.4.D of the IEEE publication services and products board operations manual. Piscataway, 2021. Disponível em: https://pspb.ieee.org/images/files/files/opsmanual.pdf. Acesso em: 25 fev. 2022.
ISON, D. C. The influence of the internet on plagiarism among doctoral dissertations: an empirical study. Journal of Academic Ethics, Dordrecht, v. 13, n. 2, p. 151-166, 2015.
JAY, R. Portal plagiat. Berlin, 2022. Disponível em: https://plagiat.htw-berlin.de/software-en/. Acesso em: 22 fev. 2022.
KAKKONEN, T.; MOZGOVOY, M. Hermetic and web plagiarism detection systems for student essays-an evaluation of the state-of-the-art. Journal of Educational Computing Research, Thousand Oaks, v. 42, n. 2, p. 135-159, 2010.
KOOCHER, G. P.; KEITH-SPIEGEL, P. Peers nip misconduct in the bud. Nature, Berlin, v. 466, n. 7305, p. 438-440, 2010.
KÖSE, Ö; ARIKAN, A. Reducing plagiarism by using online software: an experimental study. Contemporary Online Language Education Journal, Turkey, v. 1, p. 122-129, 2011.
LUQUINI, E. Uma proposta para promover a aprendizagem nas disciplinas de programação utilizando-se de redes sociais modeladas por técnicas de detecçao de plágio. São Paulo: Universidade Presbiteriana Mackenzie, 2010.
MAURER, H; KAPPE, F. Plagiarism: a survey. Journal of Universal Computer Science, Austria, v. 12, n. 8, p. 1050-1084, 2006.
MAXWELL, A.; CURTIS, G. J.; VARDANEGA, L. Does culture influence understanding and perceived seriousness of plagiarism? International Journal, London, v. 4, n. 2, p. 25-40, 2008.
MCCABE, D. L.; TREVIÑO, L. K.; BUTTERFIELD, K. D. Cheating in academic institutions: a decade of research. Ethics & Behavior, Oxon, v. 11, n. 3, p. 219-232, 2001.
MICROSOFT. Check your document for similarity to online sources. 2022. Disponível em: https://support.microsoft.com/en-us/office/check-your-document-for-similarity-to-online-sources-6d942360-b5ca-445f-a84d-6e8c66fc40d2. Acesso em: 25 fev. 2022.
MUSSINI, J. A. Novas arquiteturas para detecção de plágio baseadas em redes P2P. Curtiba: Pontíficia Universidade Católica do Paraná, 2008.
NOORDEN, R.V. Science on the move. Nature, Berlin, v. 490, p. 326-329, 2012.
OLIVEIRA, A. M. Um método de detecção de plágio em códigos-fonte para disciplinas iniciais de programação. Manaus: Universidade Federal do Amazonas, 2016.
OLIVEIRA, M. M. Plágio na constituição de autoria: análise da produção acadêmica de resenhas e resumos publicados na internet. São Paulo: Universidade Presbiteriana Mackenzie, 2007.
OPEN AI. GPT-3 powers the next generation of apps. 2021. Disponível em: https://openai.com/blog/gpt-3-apps/. Acesso em: 25 fev. 2022.
PASSOW, H. J. et al. Factors influencing engineering students’ decisions to cheat by type of assessment. Research in Higher Education, New York, v. 47, n. 6, p. 643-684, 2006.
PERISSÉ, G. O Conceito de plágio criativo. Videtur, São Paulo, n. 18, p. 9-19, 2003.
PERTILE, S.; MOREIRA, V.; ROSSO, P. Comparing and combining content and citation: based approacheds for plagiarism detection. Journal of the Association for Information Science and Technology, Hoboken, v. 67, n. 10, p. 2511-2526, 2016.
PERTILE, S. L. Desenvolvimento e aplicação de um método para detecção de indícios de plágio. Santa Maria: Universidade Federal de Santa Maria, 2011.
POTTHAST, M. et al. Overview of the 5th international competition on plagiarism detection. CEUR Workshop Proceedings, Germany, v. 1179, p. 845-876, 2013.
RIBEIRO, M. D.; VASCONCELOS, S. M. R. Retractions covered by Retraction Watch in the 2013-2015 period: prevalence for the most productive countries. Scientometrics, Dordrecht, v. 114, p. 719-734, 2018.
SANJALAWE, K.; ANBAR, Y. M. The Plagiarism detection systems for higher education: a case study in Saudi Universities. International Journal of Software Engineering & Applications, Australia, v. 8, n. 2, p. 33-49, 2017.
SCANLON, P. M.; NEUMANN, D. R. Internet plagiarism among college students. Journal of College Student Development, Baltimore, v. 43, n. 3, p. 374-385, 2002.
STANLICK, N. An open letter to faculty: some thoughts on plagiarism from “Colonel Cheatbuster”. UCF Faculty Focus, Orlando, v. 7, n. 4, p. 9-10, 2008.
VASCONCELOS, S. et al. Discussing plagiarism in Latin American science. Brazilian researchers begin to address an ethical issue. EMBO reports, Hoboken, v. 10, n. 7, p. 677-82, 2009.
VAZ, T. R. D. O avesso da ética: a questão do plágio e da cópia no ciberespaço. Cadernos de Pós-Graduação, São Paulo, v. 5, n. 1, p. 159-172, 2006.
WEBER-WULFF, D. et al. Plagiarism detection software test. 2013. Disponível em: https://plagiat.htw-berlin.de/software-en/test2013/. Acesso em: 08 ago. 2022.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Marcelo Krokoscz

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
Authors will keep their copyright and grant the journal with the right of first publication, the work licensed under License Creative Commons Attribution (CC BY 4.0), which allows for the sharing of work and the recognition of authorship.
Authors can take on additional contracts separately for non-exclusive distribution of the version of the work published in this journal, such as publishing in an institutional repository, acknowledging its initial publication in this journal.
The articles are open access and free. In accordance with the license, you must give appropriate credit, provide a link to the license, and indicate if changes were made. You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.