ArnetMiner (also AMiner) is a free online service used to index, search, and mine big scientific data.
ArnetMiner (AMiner) is designed to search and perform data mining operations against academic publications on the Internet, using social network analysis to identify connections between researchers, conferences, and publications. This allows it to provide services such as expert finding, geographic search, trend analysis, reviewer recommendation, association search, course search, academic performance evaluation, and topic modeling.
ArnetMiner was created as a research project in social influence analysis, social network ranking, and social network extraction. A number of peer-reviewed papers have been published arising from the development of the system. It has been in operation for more than three years, and has indexed 130,000,000 researchers and more than 200 million publications. The research was funded by the Chinese National High-tech R&D Program and the National Science Foundation of China.
ArnetMiner is commonly used in academia to identify relationships between and draw statistical correlations about research and researchers. It has attracted more than 10 million independent IP accesses from 220 countries and regions. The product has been used in Elsevier's SciVerse platform, and academic conferences such as SIGKDD, ICDM, PKDD, WSDM.
ArnetMiner automatically extracts the researcher profile from the web. It collects and identifies the relevant pages, then uses a unified approach to extract data from the identified documents. It also extracts publications from online digital libraries using heuristic rules.
It integrates the extracted researchers’ profiles and the extracted publications. It employs the researcher name as the identifier. A probabilistic framework has been proposed to deal with the name ambiguity problem in the integration. The integrated data is stored into a researcher network knowledge base (RNKB).
The principal other product in the area are Google Scholar, Elsevier's Scirus, and the open source project CiteSeer.
- March 2006, Version 0.1, Functions include researcher profiling, expert search, conference search, and publication search. The system was developed in Perl;
- August 2006, Version 1.0, The system was re-implemented in Java;
- July 2007, Version 2.0, New functions include researcher interest mining, association search, survey paper finding (unavailable now);
- April 2008, Version 3.0, New functions include query understanding, new GUI, and search log analysis;
- November 2008, Version 4.0, New functions include graph search, topic modeling, NSF/NSFC funding information extraction;
- April 2009, Version 5.0, New functions include Profile edition, open API service, Bole search, course search (unavailable now);
- December 2009, Version 6.0, New functions include academic performance evaluation, user feedback, conference analysis;
- May 2010, Version 7.0, New functions include name disambiguation, paper-reviewer recommendation, ArnetPage creation;
- March 2012, Version II, renamed as AMiner, rewrote all the codes and redesign the GUI. New functions include: geographic search, ArnetAPP platform.
- June 2014, Version II, renamed as AMiner, rewrote all the codes and redesign the GUI. New functions include: geographic search, ArnetAPP platform.
- December 2015, a completely new version got online.
- May 2017, professional version got online.
- April 2018, New functions include Trend Analysis, a deep learning based Name Disambiguation
ArnetMiner published several datasets for academic research purpose, including Open Academic Graph, DBLP+citation (a data set augmenting citations into the DBLP data from Digital Bibliography & Library Project), Name Disambiguation, Social Tie Analysis. For more available datasets and source codes for research, please refer to.
- Digital Bibliography & Library Project
- Google Scholar
- Microsoft Academic Search
- List of academic databases and search engines
- Jie Tang; Jing Zhang; Limin Yao; Juanzi Li; Li Zhang; Zhong Su (2008). "ArnetMiner: extraction and mining of academic social networks". Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM.
- "Arnetminer: introduction". Retrieved 28 May 2010.
- "SciVerse - HUB - Home". Archived from the original on 9 September 2012. Retrieved 24 April 2012.
- "Trend Analysis". Retrieved 24 December 2018.
- Yutao Zhang; Fanjin Zhang; Peiran Yao; Jie Tang (2018). "Name Disambiguation in AMiner: Clustering, Maintenance, and Human in the Loop". Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. London: ACM.
- "Open Academic Graph". Retrieved 24 December 2018.
- "DBLP Papers + Citation Relationship". Retrieved 24 December 2018.
- "Name Disambiguation". Retrieved 24 April 2012.
- "Inferring Social Ties in Large Networks". Retrieved 24 April 2012.
- "Open Data and Codes by ArnetMiner". Retrieved 24 April 2012.
- Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, Zhong Su. Arnetminer: extraction and mining of academic social networks. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining (SIGKDD'2008)
- Chi Wang, Jiawei Han, Yuntao Jia, Jie Tang, Duo Zhang, Yintao Yu, and Jingyi Guo. Mining Advisor-Advisee Relationships from Research Publication Networks. InProceedings of the Sixteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD'2010).
- Jie Tang, Jimeng Sun, Chi Wang, and Zi Yang. Social Influence Analysis in Large-scale Networks. In Proceedings of the Fifteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD'2009). pp. 807–816.
- Jie Tang, Ruoming Jin, and Jing Zhang. A Topic Modeling Approach and its Integration into the Random Walk Framework for Academic Search. In Proceedings of 2008 IEEE International Conference on Data Mining (ICDM'2008). pp. 1055–1060.
- Jie Tang, Limin Yao, Duo Zhang, and Jing Zhang. A Combination Approach to Web User Profiling. ACM Transactions on Knowledge Discovery from Data (TKDD), (vol. 5 no. 1), Article 2 (December 2010), 44 pages.
- Yutao Zhang, Fanjin Zhang, Peiran Yao, and Jie Tang. Name Disambiguation in AMiner: Clustering, Maintenance, and Human in the Loop. In Proceedings of the Twenty-Fourth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'18). pp. 1002-1011.