Print Email Facebook Twitter Finding your digital sibling: which other GitHub projects are similar to yours? Title Finding your digital sibling: which other GitHub projects are similar to yours?: Finding similar repositories based on the available documentation Author Turcu, Alexandru (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Proksch, S. (mentor) Huang, S. (mentor) Olkhovskaya, Julia (graduation committee) Degree granting institution Delft University of Technology Programme Computer Science and Engineering Project CSE3000 Research Project Date 2024-02-01 Abstract This paper aims to study the importance of considering the documentation side of GitHub repositories when assessing the similarity between two or more applications. Readme and Wiki files, along with Comments from the source files, are the dimensions proposed to be analyzed through our methodology and experiments. We propose a pipeline that first extracts text fragments from these dimensions and then applies Natural Language Processing techniques to further prepare our data for evaluation. To gather a similarity score, we first vectorize our processed data with TF-IDF and then use cosine distance to obtain the score. Combinations of the three dimensions, ranging from using only one dimension to using all of them, are considered throughout our study. Moreover, additional information has been extracted from the plain text, such as referenced URLs and License usage, the similarity of which was calculated using Jaccard distance. Two experiments were performed. The first one aims to observe the behavioral tendencies of our methodology applied to a small dataset, while the second one aims to validate our results. By evaluating them, we found sufficient data that supported our presented conclusion: documentation represents a valuable asset in gathering a pool of similar applications. Subject GitHubText MiningDocumentation To reference this document use: http://resolver.tudelft.nl/uuid:6db01376-931b-4eb2-a494-4eee0c55cde7 Part of collection Student theses Document type bachelor thesis Rights © 2024 Alexandru Turcu Files PDF final_paper_acturcu.pdf 524.51 KB Close viewer /islandora/object/uuid:6db01376-931b-4eb2-a494-4eee0c55cde7/datastream/OBJ/view