Turcone Robot
Turcone uses the robot it has developed to scan the internet, now this robot visits the sites with the following credential.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; TurconeBot/1.0; +http://www.turcone.com/bot.html) Chrome/103.0.5060.134 Safari/537.36
» Supports robots.txt
The Turcone robot complies with the standards specified at http://www.robotstxt.org/robotstxt.html, it uses the TurconeBot identity.
User-agent: TurconeBot
» Use of HTML Tags
TurconeBot takes into account some html tags placed in the page and acts accordingly. The following examples are considered by TurconeBot.
<title>Title</title> gets the page title from the title tag.
<meta name="Keywords" content="..." /> It takes the keywords of the page content from the meta keyword tag.
<meta name="Description" content="..." /> It takes the summary of the relevant page from the meta description tag.
<meta http-equiv="Content-Type" content="type; charset=..." /> Gets the character encoding of the page from the charset part.
<meta http-equiv="refresh" content="5;url=yönlendirilen-sayfa.html" /> TurconeBot detects the meta redirects on the pages and gets the relevant address.
<meta name="robots" content="index, follow" /> TurconeBot takes this into account when it is specified with meta robots whether the relevant page will be included in the search index.
<a href="...html" rel="nofollow">örnek</a> TurconeBot recognizes the rel="nofollow" parameter written in a href for unwanted addresses on the pages and does not take the relevant address.