mastodontech.de ist einer von vielen unabhängigen Mastodon-Servern, mit dem du dich im Fediverse beteiligen kannst.
Offen für alle (über 16) und bereitgestellt von Markus'Blog

Serverstatistik:

1,5 Tsd.
aktive Profile

#anubis

9 Beiträge8 Beteiligte0 Beiträge heute

Vom Internet, wie wir es noch vor 3 Jahren kannten, werden wir uns wohl erstmal verabschieden dürfen - Dank #AI / #llm.
Nicht nur, dass alles mit AI-Slop geflutet wird. Die Goldgräber-Stimmung sorgt für immer rücksichtslosere Crawler, die robots.txt u.ä. ignorieren. Die einen Seiten tun es aus Notwehr, die anderen aus Prinzip - aber ich gehe davon aus, dass immer mehr hinter #Anubis und ähnlichen Seiten verschwinden wird.
Das trifft auch Suchmaschinen. Also bekommen wir on top...

This AI scrapping war is disgusting

Today, my ingress node was dropping packets because EVERYONE decided to scrape the hell out of my Gitea instance (Forejo soon)

OpenAI, Microsoft, Amazon and some other rando were all trying to gather data THEY ALREADY HAD

I really need to configure Anubis at the ingress level...

#homelab#selfhosted#faang

Just released: #swad 0.12 🥂

swad is the "Simple Web Authentication Daemon". It basically offers adding form + #cookie #authentication to your reverse proxy (designed for and tested with #nginx "auth_request"). I created it mainly to defend against #malicious_bots, so among other credential checker modules for "real" logins, it offers a proof-of-work mechanism for guest logins doing the same #crypto #challenge known from #Anubis.

swad is written in pure #C with minimal dependencies (#zlib, #OpenSSL or compatible, and optionally #PAM), and designed to work on any #POSIX system. It compiles to a small binary (200 - 300 kiB depending on compiler and target platform).

This release brings (among a few bugfixes) improvements to make swad fit for "heavy load" scenarios: There's a new option to balance the load across multiple service worker threads, so all cores can be fully utilized if necessary, and it now keeps lots of transient objects in pools for reuse, which helps to avoid memory fragmentation and ultimately results in lower overall memory consumption.

Read more about it, download the .tar.xz, build and install it .... here:

github.com/Zirias/swad

Simple Web Authentication Daemon. Contribute to Zirias/swad development by creating an account on GitHub.
GitHubGitHub - Zirias/swad: Simple Web Authentication DaemonSimple Web Authentication Daemon. Contribute to Zirias/swad development by creating an account on GitHub.

@cadey a fait une présentation d'#Anubis dans les lightning talks de #BSDCan ce soir. Elle sera bientôt visible en ligne sur le site de la conférence, si vous voulez en savoir plus sur cet outil qui protège l'instance mastodon de Tetaneutral.net contre les scrapers depuis quelques mois.
bsdcan.org
Encore merci pour cet ouil !

www.bsdcan.orgBSDCan ConferenceBSDCan is a technical BSD conference held in Ottawa, Ontario, Canada.

Some people are really abusing the #Anubis . This website took over 20 seconds to open on my phone:

git.apiote.xyz/Bimba.git

20 seconds * 31kH = 620kH

Why??

This is getting out of hand. I agree that Anubis is a good measure for scrapers, but going crazy with the config is simply a **waste of everything** and would hurt the user too!

Seems now we have to make an extension to just close the tab if Anubis is running more than 5 seconds and is wasting phone battery!! 🤦

#Anubis is great. But what if the proof of work it was doing was in fact a tiny chunk of some scientific analysis, crowd sourcing CPU cycles for science and killing two birds with one silicon stone?