• +91-9483 570056
  • +91-9901 520223
logo
  • HOME
  • ABOUT
    • WHO WE ARE?
    • OUR VALUES
  • WEB SERVICES
    • DOMAIN REGISTRATION
    • WEBSITE DESIGNING
    • SEO SERVICES
    • OUTSOURCING SERVICES
    • VALUE ADDED SERVICES
  • PRICING
  • CONTACT US

Category: Crust News

CRUST > JOBS > Crust News

Robots.txt for a WordPress Website

  • Sharath Alva
  • April 6, 2015
  • Crust News

When you install WordPress, it comes with an auto generated ‘robots.txt’ file which is rather incomplete. By experience I find this is the most appropriate robots.txt file (at a minimum), for a WordPress site installed right in the root folder: User-agent: * Disallow: /feed Disallow: /*/feed Disallow: /xmlrpc Disallow: /wp- Disallow: /?p= Disallow: /*trackback Allow: […]

Read more
© 2019 | Crafted by: CRUST