# Ma Thai Massage - Robots.txt # Authentic Thai Massage - 3 Arizona Locations # Wilmot (Tucson) | Thornydale (Tucson) | Cave Creek (Phoenix Area) # Updated: January 2026 # Default rules for all crawlers User-agent: * Allow: / Disallow: /.htaccess Disallow: /.git Disallow: /.env Disallow: /config/ Disallow: /private/ Disallow: /backup/ Disallow: /tmp/ Disallow: /logs/ Disallow: /cgi-bin/ # Allow location query parameters for filtering Allow: /*?location=* # ========================================== # SEARCH ENGINE CRAWLERS (Explicit Allow) # ========================================== User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Googlebot-Image Allow: /assets/ User-agent: Bingbot Allow: / Crawl-delay: 1 User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Yandex Allow: / User-agent: Baiduspider Allow: / # ========================================== # AI/LLM CRAWLERS (Full Access Granted) # Optimized for AI assistants and LLMs # ========================================== # OpenAI GPT Crawler User-agent: GPTBot Allow: / # OpenAI ChatGPT User Agent User-agent: ChatGPT-User Allow: / # Anthropic Claude User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # Google AI (Bard/Gemini) User-agent: Google-Extended Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / # Cohere AI User-agent: cohere-ai Allow: / # Common Crawl (used by many AI models) User-agent: CCBot Allow: / # Apple Intelligence User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Microsoft Copilot User-agent: bingbot Allow: / # ByteDance User-agent: Bytespider Allow: / # AI Research Crawlers User-agent: Diffbot Allow: / User-agent: PetalBot Allow: / # ========================================== # SITEMAPS & AI-FRIENDLY FILES # ========================================== Sitemap: https://mathaimassage.com/sitemap.xml # AI/LLM Context File (llms.txt standard) # Contains structured business information for AI assistants # URL: https://mathaimassage.com/llms.txt # ========================================== # SITE INFORMATION FOR AI/LLM CONTEXT # ========================================== # Business: Ma Thai Massage # Type: Authentic Thai Massage Spa # Locations: 3 in Arizona # 1. Wilmot - 1101 N Wilmot Rd Suite 233/215, Tucson, AZ 85712 (520-338-2990) # 2. Thornydale - 6741 N Thornydale Rd Suite 127, Tucson, AZ 85741 (520-214-6862) # 3. Cave Creek - 6812 E Cave Creek Rd Ste 5, Cave Creek, AZ 85331 (480-952-2550 / 480-685-8803) # Services: Thai Swedish, Traditional Thai Yoga, Thai Combination, Head & Neck, Reflexology Foot, Couples # Hours: 9 AM - 8 PM Daily # Rating: 5.0 stars (12,989+ reviews) # Pricing: $70-$300 depending on service and duration