• 0

Robots.txt redirect issue


Question

So I have a website (http://stattik.net/) that I am trying to get setup with SEO as I really want to start it.  The website uses angular with routing to handle navigation.  I modified the .htaccess so that any images, css, icons, txt, xml, etc will not be routed through the index.html page however for some reason 

http://stattik.net/robots.txt keeps redirecting me back to the home page.  However http://stattik.net/sitemap.xml doesn't redirect nor does http://stattik.net/test.txt

 

Here is my entire .htaccess

 

RewriteEngine On

  Options -MultiViews
    RewriteEngine On

	#robots.txt
    RewriteRule ^robots.txt$ http://stattik.net/robots.txt [NC]
    
	#make www. link to non-www.
    RewriteCond %{HTTP_HOST} ^www\.stattik\.net$
    RewriteRule ^/?$ "http\:\/\/stattik\.net\/" [R=301,L]
    
    #any images, js, css,robots,sitemap,etc don't use the index.html
    RewriteCond %{REQUEST_FILENAME} !-f
    #RewriteCond %{REQUEST_FILENAME} !-d
    RewriteCond %{REQUEST_URI} !.*\.(img|js|css|txt|ico|xml)
    RewriteRule ^ index.html [QSA,L]

    #disable libwww-perl
    RewriteCond %{HTTP_USER_AGENT} libwww-perl.* 
    RewriteRule .* ? [F,L]

    #Cache static content for 6 months
    ExpiresActive On
    ExpiresByType image/png A15552000
    ExpiresByType image/jpeg A15552000
    ExpiresByType image/ico A15552000
    ExpiresByType text/javascript A15552000
    ExpiresByType text/css A15552000

Anyone have any ideas what could be going on?

Link to comment
https://www.neowin.net/forum/topic/1296152-robotstxt-redirect-issue/
Share on other sites

4 answers to this question

Recommended Posts

  • 0
  On 29/04/2016 at 19:31, firey said:

Yea, it's acting weird.  Seems fine in IE but not chrome.  Not sure what's going on with it.

Expand  

It's a caching issue probably, it's automatically completing the redirect on chrome to save time. Clear out the necessary cache and give it another go. Chances are that'll fix the issue since others are able to see it - which tells me the code is just fine.

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Kindle Scribe Essentials Bundle offers great value for students and professionals by Paul Hill Earlier this week, we featured the Kindle Scribe in a deals post. Amazon’s largest Kindle had fallen to its lowest price; these are still on offer if you’re interested. Now, the company has also decided to discount the Kindle Scribe Essentials Bundle, which includes the Kindle Scribe with Premium Pen, premium leather folio, and a 9W power adapter. The Premium Pen is already included with the Kindle Scribe, but this bundle adds the premium leather folio and 9W power adapter. The 64GB Kindle Scribe variants (available in two colors) cost $404.97, down from $569.97. By using this deal, you’re saving $165 off the list price and it’s $65 less than if you bought the bundle items separately. In the original deal, which is still available, you got the Kindle and the pen, so this bundle adds the 9W power adapter and the premium leather folio. If you are still looking for Father’s Day gifts, this Kindle Scribe Essentials Bundle will not arrive in time, even if you get a Prime member trial. What the Kindle Scribe does The Kindle Scribe features a large 10.2-inch glare-free display with a 300 ppi density. It comes with a Premium Pen that makes it feel like you’re writing on paper as you jot down your notes. To make writing easier, you get Active Canvas for in-book notes and a built-in notebook with templates. You can import and write on PDFs and documents via Send to Kindle, including sending directly from Word if you have a Microsoft 365 subscription. With the inclusion of the natural leather folio, which patinas over time, you are able to wake and sleep your Kindle Scribe by opening and closing the folio. It uses a magnetic attachment to ensure a secure close. Once you have written out your notes, the Kindle Scribe allows you to summarize them using artificial intelligence. You can even customize the length and tone of your notes. You can also refine your notes by converting your handwritten words into a script font. One of the standout features of other Kindle devices is their spectacular battery life, and the Kindle Scribe promises the same. The battery will last you up to 12 weeks for reading and up to 3 weeks for writing. Furthermore, Amazon has used 18% recycled materials including 100% recycled aluminum parts, and it comes in fully recyclable packaging. Finally, and it shouldn’t really need mentioning, the Kindle Scribe has full access to the Kindle Store so you can quickly and easily gain access to all of the latest books. Should you buy it? Anyone who has ever loved using a Kindle product should check out the Scribe as it has many of the same characteristics, but on a bigger scale and with writing capabilities. Students at college, especially those studying something like literature, could benefit. It could also be good for professionals who need to annotate documents. If you saw the deal earlier this week and were worried about scuffing up the device, then this deal may be more tempting thanks to the inclusion of the folio case. Amazon Kindle Scribe Essentials Bundle (16GB): $359.97 (Amazon US) / MSRP $519.97 Amazon Kindle Scribe Essentials Bundle (32GB): $374.97 (Amazon US) / MSRP $539.97 Amazon Kindle Scribe Essentials Bundle (64GB, Tungsten/Black Folio): $404.97 (Amazon US) / MSRP $569.97 Amazon Kindle Scribe Essentials Bundle (64GB, Metallic Jade/Dark Emerald Folio): $404.97 (Amazon US) / MSRP $569.97 This Amazon deal is US-specific and not available in other regions unless specified. If you don't like it or want to look at more options, check out the Amazon US deals page here. Get Prime (SNAP), Prime Video, Audible Plus or Kindle / Music Unlimited. Free for 30 days. As an Amazon Associate, we earn from qualifying purchases.
    • sounds like this same jet had electrical failures in a prior flight including the entertainment systems, and call buttons and other things not working
    • That's the publisher's fault and happens with or without GamePass. Microsoft at least offers the Play Anywhere option.
    • Windows Phone actually had some great features, the problem Microsoft had is that developers are not used to having to deal with stores etc. and they couldn't get them onboard. But there were a lot of good features, in fact we see more and more of them popping up on other OS' all the time.
  • Recent Achievements

    • First Post
      NeoToad777 earned a badge
      First Post
    • Week One Done
      JoeV earned a badge
      Week One Done
    • One Month Later
      VAT Services in UAE earned a badge
      One Month Later
    • First Post
      LsDmT earned a badge
      First Post
    • Week One Done
      evershinefacilityservice earned a badge
      Week One Done
  • Popular Contributors

    1. 1
      +primortal
      571
    2. 2
      ATLien_0
      247
    3. 3
      +Edouard
      162
    4. 4
      +FloatingFatMan
      151
    5. 5
      Michael Scrip
      113
  • Tell a friend

    Love Neowin? Tell a friend!