The search engine exists to show the most relevant results that the people are searching over the internet, so firstly it needs to discover the internet’s content. For that the content should be…