Bold Property Group — Bot Disclosure
Plain-English notes about our web-research crawler, so site owners know who's knocking.
What we do
We operate a small crawler that visits Australian real-estate agency websites to build a directory of firms and their publicly listed agents. It helps us match property briefs to the right people, and keeps our internal records current.
We never collect from members-only areas, never submit forms, never post or "interact" with any site, and never download content that isn't linked from your public navigation.
User-Agent
Our requests identify themselves with:
BoldPropertyGroup/1.0 (+https://boldpropertygroup.com.au/bot)
Rate
- One request every three seconds to any single hostname.
- At most eight pages per visit, typically team, contact, listings, and about.
- Visit cadence is weekly at most; for smaller sites, monthly or less.
What we respect
robots.txtis honoured. Blanket or path-specific disallows stop the crawler immediately, and we cache that decision for 24 hours.- We only store structured contact fields — names, phone numbers, email addresses, office locations, listing URLs. Not article or bio copy, not images, not raw HTML.
- All data is held in-house for internal prospecting. We don't resell or redistribute.
Opt out
If you'd rather we didn't visit your site, either add a disallow line to your robots.txt, or email [email protected] with the domain name and we'll add it to our permanent skip list within one business day.