Answers are grounded in this paper and cite their sources.
Rrefabricate a proficient search structure is very important due to current scale of the web. Information are mined by Search engines from the web and a program called web crawler which surfs the web in an efficient manner. Distributed crawler belongs to a variant of web crawler, uses a dispersed computation method. In this paper, we design and implement the concept of Efficient Distributed Web Crawler using enhanced bandwidth and hefty algorithms. Mostly Web Crawler doesn’t have any distributed cluster performance system and any implemented algorithm. In this paper a novel Hefty Algorithm and enhanced bandwidth algorithm are combined together for better distributed crawling system. The hefty algorithm, implemented to provide the strong and efficient surfing results while applying on the drug web search. We also implemented Enhanced Bandwidth algorithm to improve the efficiency of proposed crawler.
No takes yet. Share an insight, caveat, or question.
Ramachandran et al. (2020) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: