User-agent: * Disallow: cc_* Disallow: cgi-bin/ Disallow: checkout* Disallow: clear* Disallow: conf* Disallow: cons* Disallow: credit* Disallow: enter* Disallow: images/ Disallow: logon* Disallow: logs/ Disallow: *~ Disallow: *test* Disallow: *.css Disallow: *.js Disallow: pipedream_products_site_fun* Disallow: random_right* Disallow: search_response* Disallow: select_shipping* Disallow: sexpert_email* Disallow: unbl* Disallow: update_from*