Fern Docs: Custom robots.txt
buildwithfern.com backs 1 GrowthDex tactic. This page exists so readers and crawlers can follow the evidence trail from source to tactic.
Original source
Cited GrowthDex tactics
- Fern custom robots policy before crawler ambiguityWrite an explicit `robots.txt` policy before assuming search engines and AI crawlers will interpret a default wildcard the way you meant.