# Alle Crawler willkommen User-agent: * Allow: / # Interne und personalisierte Bereiche gehören nicht in den Index Disallow: /admin Disallow: /sidekiq Disallow: /rails Disallow: /users Disallow: /forecast Disallow: /purchase Disallow: /subscriptions Disallow: /api_keys Disallow: /api_usage Disallow: /api/ Disallow: /data_requests Disallow: /weather_datasets Disallow: /electricity_prices Disallow: /model_predictions Disallow: /newsletters Disallow: /coupon_codes Disallow: /run_jobs Disallow: /stats Disallow: /webhooks Disallow: /set_locale Disallow: /up # Duplicate Content durch Filter-Parameter vermeiden Disallow: /*?*model_version= Disallow: /*?*raw_prices= Disallow: /*?*show_adjusted= Disallow: /*?*coupon= # Langsame Crawler wie MJ12bot gedrosselt User-agent: MJ12bot Crawl-delay: 10 # Link zur Sitemap Sitemap: https://www.energyforecast.de/sitemap.xml