User-agent: *
Allow: /
Allow: /html/
Disallow: *
Disallow: *.pdf