BetfrikaBot, Betfrika's web crawler

Who we are

BetfrikaBot is the crawler of Betfrika ASBL/e.V., a non-profit organization present in Europe and Africa.

It reads public pages of organizations (churches, associations, reuse centers, businesses…) to find their official contact details and a short description of their activity, so that we can offer them a partnership: books, collections, donations.

It always identifies itself with this User-Agent:

BetfrikaBot/1.0 (+https://www.betfrika.org/bot)

What it does

• It reads only a few pages per site, for example the home page, the legal notice or Impressum, the contact page and the “about” page. It may use your sitemap to find them, and re-reads them periodically to keep the contact details up to date.
• It reads one page at a time, with a pause of at least a few seconds between two pages of the same site.
• It follows your robots.txt: the rules written for User-agent: BetfrikaBot or, failing that, for User-agent: *, as well as Crawl-delay.
• It follows Content-Signal: BetfrikaBot does not pass the text of your pages to any AI model when your site forbids it (ai-input=no).

What it never does

• Work around a refusal: a 401, 403 or 429 response, a captcha or anti-bot page, a Disallow rule.
• Pretend to be a browser or another crawler.
• Create an account, fill in a form or get around a paywall.
• Keep photos.

What we keep, and for how long

It collects, in particular, the organization's business contact details (generic email address, phone number, postal address, website), its legal form and registration number, its social media accounts, the languages of its website, a short description of its activity and, depending on the type of organization, what the website publishes about the organization itself, for example a church's denomination or the origin of its community. This information is about the organization, never about a person.

The pages it reads and the intermediate responses of our tools are kept for at most 90 days (the pages' HTML code, 14 days), so that we can check what was taken from them.

The organization's contact details are kept as long as they serve our relationship with it. They are checked again regularly and erased on request.

A personal address or number found on a page is marked as such, is never used to contact you, and is erased with the pages, at the latest after 90 days.

Legal basis: the association's legitimate interest in offering a partnership to an organization (Article 6(1)(f) GDPR).

Where this data comes from

• The public pages of the organization's website.
• Public directories, for example those of church federations.
• Search services, to find the website's address.
• What we already knew about the organization (our records, a meeting, an exchange).

Who receives it

• Our servers, in the European Union (Microsoft Azure, in Germany and Ireland).
• The search services Serper and Google receive the organization's name and city, and a word that states its type (for example “church”), to find its website, never the content of its pages.
• Anthropic (United States) receives the text of a few pages to describe the organization: its activity and, depending on its type, its denomination or the origin of its community. We first remove email addresses, phone numbers and, as far as possible, names of people from that text. Never when the website forbids it (ai-input=no).

How to block it

Add these two lines to your site's robots.txt file:

User-agent: BetfrikaBot
Disallow: /

BetfrikaBot reads your robots.txt before reading your site, then re-reads it within 24 hours at most: the rule applies from that new check. To stop it as soon as possible, write to us (see below).

Contact, objection and erasure

We record your objection: BetfrikaBot no longer reads your site, and your organization is removed from our outreach. You can also ask for access to the contact details we collected, their rectification, their erasure or the restriction of their processing.

You can also lodge a complaint with a data protection authority, for example the one in your country.

Your rights and how we process data: Privacy Policy