User-agent: Scrapy
Allow: /

User-agent: *                                                                             
Disallow: /cgi-bin             
Disallow: /wp-admin/           
Disallow: /wplp-qs/
Disallow: /?                   
Disallow: *?s=                 
Disallow: *&s=                
Disallow: /search              
Disallow: /author/             
Disallow: */embed              
Disallow: */page/              
Disallow: */xmlrpc.php         
Disallow: *utm*=               
Disallow: *openstat=           

Sitemap: https://www.questionstar.com/sitemap_index.xml