1

Adding a robots.txt

Luc Didry edited this page 2018-10-26 17:39:45 +02:00

Lufi does not provides a robots.txt file to prevent search engines to index files since Lufi can be installed in a sub-directory (i.e. https://example.org/lufi).

You can put this in a robots.txt, in /var/www/html/robots.txt for example:

User-agent: *
Allow: /$
Allow: /js/
Allow: /css/
Allow: /font/
Allow: /img/
Disallow: /r/

Then, add this to your Nginx configuration (adapt to your prefix):

location = /robots.txt {
    root /var/www/html/;
}