FISH·INTEL

Fishing conditions
intelligence
Oregon to Wyoming


01  Crawler

About the Intelfish Bot

Identifiable crawler for our regulations-aggregation system.

This page exists so that anyone who sees a request from our crawler in their server logs can immediately understand who we are, what we are doing, and how to reach us. We believe identifiable bots are good citizens of the public web.

If you are an agency staff member who would like us to change anything about how we crawl your site — rate, paths, frequency, user agent recognition, anything else — please email us at [email protected] and we will respond within one business day.

Who we are

Intelfish LLC is a Pacific Northwest software company that operates Fish Intel, an iOS app that helps recreational anglers in Oregon, Washington, Idaho, Montana, Wyoming, and Alaska understand current fishing regulations, water and weather conditions, and other context relevant to a successful fishing trip.

To power Fish Intel, we operate a regulatory data platform that ingests publicly available fishing regulations from official state and federal agency websites, structures them into a machine-readable format, and serves them to the Fish Intel app with full source attribution and links back to the original agency publications.

This page describes the crawler that performs that ingestion.

What our bot does

Our crawler retrieves publicly available web pages from state and federal fisheries agencies and their administrative-code databases — agency-published codified rules, press releases, emergency orders, and rule-change announcements.

Our bot reads regulations, parses them into structured data, and stores them with full provenance metadata (source URL, source identifier, retrieval timestamp, parser version). We do not collect user data, scrape behind login walls, attempt to bypass technical access controls, or use the data for AI model training.

What our bot is not

Our bot is not an AI training crawler. We do not use the data we retrieve to train language models or any other AI systems. Our bot is a regulations-aggregation system whose only purpose is to give recreational anglers accurate, current information about the fishing rules that apply to them.

For agencies that block AI training crawlers in robots.txt (such as anthropic-ai, ClaudeBot, GPTBot, PerplexityBot, Google-Extended, and others): our user agent is distinct from those, and we crawl only paths permitted to general-purpose user agents. If you would prefer we not crawl your site at all, please email us and we will comply.

Our user agent

Every request from our bot carries this exact user agent string:

IntelfishBot/1.0 (+https://getfishintel.com/about-our-bot; [email protected])

If you see requests in your logs that claim to be from us but use a different user agent, those are not us — please let us know.

How often we crawl

We are conservative by design. Our per-URL cadence floor is 1 request per 15 minutes for the same URL — we never revisit the same agency page faster than that, regardless of season or source type. Most pages are polled far less often: codified administrative-code chapters get a weekly diff check; in-season pages typically get every 6 hours off-season, and every 15 to 30 minutes during peak anadromous and halibut windows on the highest-cadence surfaces (e.g., emergency-rule feeds). Across an entire agency domain we observe a separate burst-rate floor of 1 request per 2 seconds. Total request volume per agency per day is typically in the low hundreds, well below any reasonable burden threshold.

If your servers experience any load issue you suspect may be related to our crawling, please email us. We will reduce our rate immediately or pause entirely while we diagnose.

How we treat your data

The text of state and federal regulations is in the public domain under the Edicts of Government doctrine (Georgia v. Public.Resource.Org, 590 U.S. 255 (2020)). We treat it as such — we may store, index, structure, and serve it. We do not redistribute copyrighted private compilations of regulations, agency-published illustrations or photographs, or other adjacent original matter. We source from the official rule databases.

Every regulation we serve through Fish Intel includes:

We surface your authority. We do not replace it.

How to reach us

For any concern, request, partnership inquiry, or feedback about our crawler:

We will respond to every inquiry from a state or federal agency. If you do not receive a response within two business days, please assume your message did not arrive and try again.

If formal postal correspondence is required (e.g., legal service, partnership agreement signature), please email us first and we will provide an appropriate mailing address for the specific need.


Operated by Intelfish LLC, Pacific Northwest, USA.

Last reviewed: May 2026.

This page is reachable via direct URL only — agency staff who see our crawler in their server logs follow the URL embedded in the user-agent string. The page is not indexed by search engines and is not listed in our sitemap.