Does anyone know Arc Search's user agent so we can block it?
@cory I think it might be PerplexityBot. I’m not 100% certain though.
https://blog.perplexity.ai/blog/arc-x-perplexity
https://darkvisitors.com/agents/perplexitybot
@knowler thank you! Going to make sure it’s added on my end and keep an eye out for anything else they’re using.
@cory Ok, so maybe not PerplexityBot, this is the user-agent string: ArcMobile2/11 CFNetwork/1492.0.1 Darwin/23.3.0
@knowler got it! So we'd need to block `ArcMobile2`? I haven't dug into this myself but can't imagine the entire string is required.
@cory It also doesn’t seem like they’re respecting robots.txt
@knowler oh lord — I wish I were surprised by that