Add robots.txt #1929

Closed
opened 2025-10-09 17:36:48 +03:00 by OVERLORD · 1 comment
Owner

Originally created by @ntimo on GitHub.

Hello,
I would like to suggest to add a robots.txt to disallow all indexing of the bitwarden installation.

User-agent: *
Disallow: /
Originally created by @ntimo on GitHub. Hello, I would like to suggest to add a robots.txt to disallow all indexing of the bitwarden installation. ``` User-agent: * Disallow: / ```
Author
Owner

@Jacobite89 commented on GitHub:

Setting the "X-Robots-Tag: none" HTTP-Header may be the better way.

e.g. this is my Caddyfile

#Caddyfile
vault.example.com {
  tls {$EMAIL}
  gzip

  header / {
    # Enable HTTP Strict Transport Security (HSTS)
    Strict-Transport-Security "max-age=31536000;"
    # Enable cross-site filter (XSS) and tell browser to block detected attacks
    X-XSS-Protection "1; mode=block"
    # Disallow the site to be rendered within a frame (clickjacking protection)
    X-Frame-Options "DENY"
    # Prevent search engines from indexing
    X-Robots-Tag "none"
  }

  # The negotiation endpoint is also proxied to Rocket
  proxy /notifications/hub/negotiate bitwarden:80 {
    transparent
  }

  # Notifications redirected to the websockets server
  proxy /notifications/hub bitwarden:3012 {
    websocket
  }

  # Proxy the Root directory to Rocket
  proxy / bitwarden:80 {
    transparent
  }
}

Source: https://developers.google.com/search/reference/robots_meta_tag?hl=en

@Jacobite89 commented on GitHub: Setting the "X-Robots-Tag: none" HTTP-Header may be the better way. e.g. this is my Caddyfile ``` #Caddyfile vault.example.com { tls {$EMAIL} gzip header / { # Enable HTTP Strict Transport Security (HSTS) Strict-Transport-Security "max-age=31536000;" # Enable cross-site filter (XSS) and tell browser to block detected attacks X-XSS-Protection "1; mode=block" # Disallow the site to be rendered within a frame (clickjacking protection) X-Frame-Options "DENY" # Prevent search engines from indexing X-Robots-Tag "none" } # The negotiation endpoint is also proxied to Rocket proxy /notifications/hub/negotiate bitwarden:80 { transparent } # Notifications redirected to the websockets server proxy /notifications/hub bitwarden:3012 { websocket } # Proxy the Root directory to Rocket proxy / bitwarden:80 { transparent } } ``` Source: https://developers.google.com/search/reference/robots_meta_tag?hl=en
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/vaultwarden#1929