User-agent: * Disallow: /courses/ # private area Disallow: /courses_media/ # private area