网页指纹查重技术的研究

摘要院网页查重技术是浏览获取有用信息的关键技术，传统的查重方法中，选取关键词在网页中出现的频率来判断网页是否重复，如果关键词相近，可能造成查重误判的情况。本文提出网页本身特有的指纹技术，设计新的查重算法，通过与网页特征库中的指纹比较，完成网页的查重工作，提高查重的准确率。

• 作者: 张晓伟
• 出处: 《价值工程》 2014年5期
• 关键词: Abstract Webpage fingerprint checking is a key technology to scan and get useful information. The traditional method of webpageduplicate detection selects the frequency of occurrence of key words as the standard to verify whether it&rsquo s duplicate the similar key wordsmay mislead the duplicate detection. This paper proposed the unique webpage fingerprint technology designed new detection algorithm.Comparing with webpage feature of fingerprint the paper completes the webpage repeat-checking work and improves the accuracy ofduplicate detection.院网页指纹 网页查重 位置向量Key words webpage fingerprint webpage duplicate detection position vector中图分类号院TP393.0 文献标识码院A 文章编号院1006-4311（2014）15-0225-020
• 分类: [经济管理][企业管理]