User-agent: * Disallow: /booking-other.html Disallow: /crossmarketed.html Disallow: /images/ Disallow: /test* Disallow: /*.txt Disallow: /*.js