On-site - ROBOTSTXT Factor
A JSON containing basic data about the robots.txt page found on the website. If website does not have a Robots page or the robots is invalid or could not be read, then returns null.
{
"valid":true,
"robotstxt":true,
"content":[
"/alert.html",
"/securimage_show.php",
"/print_",
"/membri/"
],
"sitemap":[
],
"url":"http://stiripesurse.ro/robots.txt",
"skipped":false
}
| Key | Type | Description |
|---|---|---|
| robotstxt | Boolean | Indicates if the website contains a Robots.txt page or not. |
| skipped | Boolean | Indicates if the robots allows Googlebot rules or not on its Robots.txt page. |
| valid | Boolean | Check if the Robots.txt page contains any warnings, if not has, then is valid. |
| content | Object | All the disallow content found inside the Robots.txt page. |
| sitemap | Object | A String arraylist that detects all the sitemaps found inside the Robots page. |
| url | String | The Robotx.txt URL path to access inside the website. |
More SEO Factors
- Google Adsense
- Alexa Global Rank
- amp
- Google Analytics
- Backlinks Anchors
- Backlinks
- Blog Page
- Citations Number
- Conversion Forms
- crawlable
- Doctype
- Duplicate Content
- Emails
- Custom 404 Page
- Facebook Shares
- Facebook Page
- Favicon Image
- Flash
- Frames
- Google Preview
- Google Page
- Google My Business Rating Score
- Google My Business Reviews Number
- Google Plus shares
- Headings
- HTML validity
- Alternative Text for Images
- Language
- Linkedin shares
- load-time
- Logo
- Meta description
- Meta Keywords
- mobile-check
- NAP as TEXT
- on-bing-maps
- Registered to Google Maps
- In-Page Links
- Phones
- Pinterest images
- Google My Business +1es Number
- Printer Friendly CSS
- rel-author
- Google Canonical URL
- Google Publishership
- Responsiveness
- robots.txt
- security-observatory
- IP Address
- Location
- XML SiteMap
- Speed Score
- SSL Http Check
- Structured Data
- Technologies
- Encoding
- Text/HTML ratio
- thumbnail
- Title
- Twitter recent backlinks
- Twitter Page
- URL
- url-protocol
- URL Underscore
- WWW resolve