diva-portal.org Review

 User-agent: Baiduspider
Disallow: /
User-agent: Yandex
Disallow: /
User-agent: Mail.Ru
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: coccoc
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
User-agent: Scrapy
Disallow: /
User-agent: Riddler
Disallow: /

User-agent: SemanticScholarBot
Crawl-delay: 30
Allow: /

User-agent: *
Crawl-delay: 10
Disallow: /webstats/
Disallow: /dream/
Disallow: /login/
Disallow: /smash/statistics.jsf
Disallow: /smash/builder.jsf
Disallow: /smash/references
Disallow: /smash/resultList.jsf

Sitemap: http://www.diva-portal.org/sitemap-index.xml

HTTP/1.1 302 Found
Date: Mon, 25 Aug 2025 04:55:08 GMT
Server: Apache/2.4.62 (Debian)
Location: http://www.diva-portal.org/smash/
Content-Length: 298
Keep-Alive: timeout=10, max=200
Connection: Keep-Alive
Content-Type: text/html; charset=iso-8859-1

HTTP/1.1 302 Found
Date: Mon, 25 Aug 2025 04:55:10 GMT
Server: WildFly/11
X-Powered-By: Undertow/1
Set-Cookie: JSESSIONID=q7_U6-KfzHqpHk3IziuUpCF82fCEEaQPg5q7kh9X.df3e8c5d0f8c; path=/smash; HttpOnly
Set-Cookie: dsrwid--9795=-9795; path=/; Max-Age=30; Expires=Mon, 25-Aug-2025 04:55:40 GMT
Location: http://www.diva-portal.org/smash/search.jsf?dswid=-9795
Content-Length: 0
Keep-Alive: timeout=10, max=200
Connection: Keep-Alive

HTTP/1.1 200 OK
Date: Mon, 25 Aug 2025 04:55:10 GMT
Server: WildFly/11
X-Powered-By: Undertow/1
Set-Cookie: JSESSIONID=iUz9wP8-aogpLJLtEIRb-qAIWrjGeHEpQ1DfBYZw.df3e8c5d0f8c; path=/smash; HttpOnly
Content-Type: text/html;charset=UTF-8
Vary: Accept-Encoding
Content-Encoding: gzip
Keep-Alive: timeout=10, max=199
Connection: Keep-Alive
Transfer-Encoding: chunked