• 0

Robots.txt redirect issue


Question

So I have a website (http://stattik.net/) that I am trying to get setup with SEO as I really want to start it.  The website uses angular with routing to handle navigation.  I modified the .htaccess so that any images, css, icons, txt, xml, etc will not be routed through the index.html page however for some reason 

http://stattik.net/robots.txt keeps redirecting me back to the home page.  However http://stattik.net/sitemap.xml doesn't redirect nor does http://stattik.net/test.txt

 

Here is my entire .htaccess

 

RewriteEngine On

  Options -MultiViews
    RewriteEngine On

	#robots.txt
    RewriteRule ^robots.txt$ http://stattik.net/robots.txt [NC]
    
	#make www. link to non-www.
    RewriteCond %{HTTP_HOST} ^www\.stattik\.net$
    RewriteRule ^/?$ "http\:\/\/stattik\.net\/" [R=301,L]
    
    #any images, js, css,robots,sitemap,etc don't use the index.html
    RewriteCond %{REQUEST_FILENAME} !-f
    #RewriteCond %{REQUEST_FILENAME} !-d
    RewriteCond %{REQUEST_URI} !.*\.(img|js|css|txt|ico|xml)
    RewriteRule ^ index.html [QSA,L]

    #disable libwww-perl
    RewriteCond %{HTTP_USER_AGENT} libwww-perl.* 
    RewriteRule .* ? [F,L]

    #Cache static content for 6 months
    ExpiresActive On
    ExpiresByType image/png A15552000
    ExpiresByType image/jpeg A15552000
    ExpiresByType image/ico A15552000
    ExpiresByType text/javascript A15552000
    ExpiresByType text/css A15552000

Anyone have any ideas what could be going on?

Link to comment
https://www.neowin.net/forum/topic/1296152-robotstxt-redirect-issue/
Share on other sites

4 answers to this question

Recommended Posts

  • 0
47 minutes ago, firey said:

Yea, it's acting weird.  Seems fine in IE but not chrome.  Not sure what's going on with it.

It's a caching issue probably, it's automatically completing the redirect on chrome to save time. Clear out the necessary cache and give it another go. Chances are that'll fix the issue since others are able to see it - which tells me the code is just fine.

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Mp3tag 3.35 by Razvan Serea Mp3tag is a powerful and yet easy-to-use tool to edit metadata (ID3, Vorbis Comments and APE) of common audio formats. It can rename files based on the tag information, replace characters or words from tags and filenames, import/export tag information, create playlists and more. The program supports online freedb database lookups for selected files, allowing you to automatically gather proper tag information for select files or CDs. Mp3tag supports the following audio formats: Advanced Audio Coding (aac) Free Lossless Audio Codec (flac) Monkeys Audio (ape) Mpeg Layer 3 (mp3) MPEG-4 (mp4 / m4a / m4b / iTunes compatible) Musepack (mpc) Ogg Vorbis (ogg) OptimFROG (ofr) OptimFROG DualStream (ofs) Speex (spx) Toms Audio Kompressor (tak) True Audio (tta) Windows Media Audio (wma) WavPack (wv) Mp3tag 3.35 changelog: This version introduces a new Files options page, enhanced toolbar customization, support for RF64 WAV files, improved Discogs and MusicBrainz tag sources, and many other improvements and fixes. See the Release Notes for more details. Download: Mp3tag 64-bit | 5.7 MB (Freeware) Download: Mp3tag 32-bit | 5.2 MB Link: Mp3tag Homepage | Screenshot Get alerted to all of our Software updates on Twitter at @NeowinSoftware
    • The FIFA World Cup is not US centric.
    • It’s amusing how Microsoft is pushing IT admins as if this was a major, game-changing update. In reality, it’s just an enablement package that bumps the build number, which is disappointing compared to the more substantial 22H2 and 24H2 releases. Technically, 25H2, 26H1, and the upcoming 26H2 are essentially the same, differing only in support schedules. They could have included the Windows K2 improvements here, but chose not to. The era of Windows being in the backburner continues, and this 26H2 release feels like an afterthought. Shame, Nadella, shame.
    • Microsoft, totally not confusing /s 25H2 - Current for non-Arm based Windows 26H1 - Current for Arm based Windows 26H2 - Only for non Arm Windows
    • After I installed those, my older but capable Win 11 laptop (16GB RAM) reported it as 26H2 26300.8697. Then I installed it on my big laptop (128GB RAM! Hehe sorry), it reported it as 25H2 26220.8690. Ugh. Do I have to switch Insiders channels from Release to Beta?
  • Recent Achievements

    • Week One Done
      AMV earned a badge
      Week One Done
    • One Month Later
      AMV earned a badge
      One Month Later
    • Collaborator
      ryansurfer98 went up a rank
      Collaborator
    • One Month Later
      Eurosoft10 earned a badge
      One Month Later
    • Week One Done
      Eurosoft10 earned a badge
      Week One Done
  • Popular Contributors

    1. 1
      +primortal
      523
    2. 2
      +Edouard
      174
    3. 3
      PsYcHoKiLLa
      78
    4. 4
      Steven P.
      72
    5. 5
      Michael Scrip
      71
  • Tell a friend

    Love Neowin? Tell a friend!