User-agent: * Disallow: # disallow all files with ? in url Disallow: /*?