Zones in SWWAF_DNSBL_ZONES are asked about each client in the background, through SWWAF_DNSBL_RESOLVER or the host's resolver; no request waits. Verdicts last SWWAF_REPUTATION_CACHE_TTL, kept in reputation.json. SWWAF_REPUTATION_ACTION (limit:25) denies, limits or logs a listed client; each zone listing it raises reputation_hit. A failed query gives no verdict, raises source_failure, and pauses the zone a minute. A zone's key, its first label under dq.spamhaus.net, is masked everywhere but reputation.json. Zones compare without regard to case. Judgement call: answers in 127.255.255.0/24 or outside 127.0.0.0/8 are failures. Judgement call: the minute's pause after a failure; at most 1,000 queries at once. Judgement call: one zone given with two keys stops the start as listed twice. Rule suppressed: paralleltest on the DNSBL tests (Go's resolver shares state across synctest bubbles), funlen on the test of every logged setting. Model: opus-5-5
smallwebwaf
smallwebwaf is a simple, fast, logging web application firewall, MIT-licensed
and written in Go by @sneak, for people who host their
own services. It runs inside the container of the one application it protects,
between your reverse proxy (traefik) and the app: the app's Dockerfile builds
FROM the smallwebwaf image, traefik sends the app's requests to
smallwebwaf on port 8080, and smallwebwaf passes them on to the app on
127.0.0.1:8081. It needs no setting, and protects the app from the first
request with defaults chosen for a service on the open internet. It keeps its
state in memory and in JSON files you can read and edit, and writes a detailed
JSON log line for every request.
Status: the first two milestones are built
(#13 and
#14), and so are nine parts of
milestone 3: the static lists, the bans that broken rate limits lead to, the ban
ledger with the bans you make, keep and lift, the JSON state files with your
edits taken in while it runs and the paths the rate limits do not count, which
come next in the build order, observe mode and the rest of the request log's
fields, which come a little later, and the metrics endpoint and the header size
and the idle time as settings, which come last in it. So are the four parts of
the stage after it: the rule files, with the bans for a clear sign of attack,
the other admin endpoints, alerts to all three destinations, a JSON webhook,
Slack and ntfy, and remote log sending. So is the stage after that: the AS
number and country of every client, looked up through GeoJS or in the IPinfo
Lite database file, the byte limits, the biased thresholds, lower limits for the
AS numbers and countries you list, and the anomaly thresholds, alerts for
unusual traffic that refuse nothing. So are the first two parts of the stage
after that: the blocklists you name by URL, which it fetches and keeps, with a
file of AS numbers' percentages fetched the same way, and the DNS blocklists
(DNSBL zones), which it asks about each client in the background. smallwebwaf
passes each request to the app and the app's answer back, unchanged, within its
timeouts and size limits, works out each client's address, looks up its AS
number and country unless you switch that off, bans a client that sends too many
requests or too many bytes, not counting those for the paths you choose, with
lower limits for the clients of the AS numbers and countries you list, refuses a
client that comes from a country you refuse or from a network you refuse,
refuses, limits or only notes a client a blocklist or a DNSBL zone you name
lists, lets the networks you choose through, checks each request against the
rule files and bans a client whose request is a clear sign of attack, keeps its
bans, each client's counters and history, GeoJS's answers, the last good copy of
each list it fetches and the DNSBL zones' verdicts in JSON files across
restarts, takes in your edits of those files, such as a ban you make, keep or
lift, and of the rule files while it runs, writes a JSON log line for every
request, sends its log lines to a syslog server too if you name one, sends an
alert to a webhook, to Slack and to ntfy, each if you name one, for each ban it
makes or makes permanent, for traffic over an anomaly threshold you set, for a
client a blocklist or a DNSBL zone lists, for GeoJS failing, a list it cannot
fetch or a DNSBL zone that fails or refuses a query, for a rule file or state
file with an error and for a replacement of the lookup database it cannot read,
serves Prometheus metrics to a scraper that holds the metrics token, lets an
admin who holds the admin token list, add and lift bans and ask what it knows of
a client, and in observe mode passes on the requests it would refuse, logging
what it would have done with them. It comes as the image the app's own image is
built on. The rest of the design comes after that, in the order of the build
order in SPEC.md. The survey of existing tools that led to the
design is in EVALUATION.md.
Getting started
Build the smallwebwaf image from a clone:
git clone https://git.eeqj.de/sneak/smallwebwaf.git
cd smallwebwaf
make docker
make docker runs the tests and the linter, then builds the image, tagged
smallwebwaf, for amd64 and only on an amd64 host: the hashes the Dockerfile
checks Ubuntu's package lists against are those of Ubuntu's amd64 archive. Push
it to a registry your hosts pull from, and build each app's image on it, pinned
by digest, as "How it works, in short" below shows. make example-app builds a
small app on the image, the one in deploy/example-app, and checks that it
works.
To work on the code, make build builds the binary alone, with Go installed,
and make run builds and runs it, listening on port 8080 in front of an app at
SWWAF_UPSTREAM_URL, by default http://127.0.0.1:8081, with its state files
in bin/state unless SWWAF_STATE_DIR is set, and the default rule file of
share/rules.d unless SWWAF_RULES_DIR is set.
What it does so far
- Passes each request to the app and the app's answer back unchanged: method, path, query, headers, body and status. Bodies stream through in both directions and are never held whole in memory. A WebSocket, or any other upgraded connection, passes through, and the timeouts do not cut it.
- Works out the client's address. A TCP peer outside
SWWAF_TRUSTED_PROXIESis the client, and the forwarded headers it sends are replaced, not passed on. For a peer inside it,X-Forwarded-Foris read from the right, and the first address outsideSWWAF_TRUSTED_PROXIESis the client; if every address in it is inside, the leftmost is, and with no header the peer is. The app sees what it would see from traefik directly: the sameHost, the sameX-Forwarded-Proto, andX-Forwarded-Forwith the peer added at the end. It also gets the request's id inX-Request-ID, the same id as in the request's log line (seerequest_idin "Request log" below). - Enforces the timeouts and the size limits below. A limit passed before the
response has started gets
smallwebwaf's own answer:408for a client too slow to send its request,413for a request body that is too large,504for an app too slow to answer, and502for a response that is too large or an app that cannot be reached. A request that announces a body over the limit is refused before anything reaches the app. While a request body is still on its way, a request timeout that runs out answers408ifsmallwebwafwas waiting for the client to send more, and504if it was waiting for the app to take what it had. Once the response has started, a limit can only cut the connection. - Counts each client's requests over a minute, an hour and a day. A request that
takes the client over one of the rate limits below is refused with
SWWAF_BAN_RESPONSE,403by default, before anything reaches the app, and bans the client. A request whose path starts with one ofSWWAF_RATE_LIMIT_EXEMPT_PATHS, as that setting below describes, is neither counted nor refused by the rate limits; the static lists, bans, the country lists and the rule files still apply to it. A client is one IPv4 address, or one IPv6 /64, since one abuser usually holds a whole /64. Each window is counted in two fixed buckets, the earlier one weighted by how much of it the window still covers. At most 20,000 clients are kept, the least recently seen dropped first, with their history, and a restart gives no client a fresh allowance (see "State files" below). - Counts each client's bytes over a minute, an hour and a day, in the same way:
once a request passed to the app has ended, the body bytes of its answer, of
the request, or of both, as
SWWAF_BYTES_COUNTsays. For a WebSocket, or any other upgraded connection, what it carried from the app counts with the answer, and what it carried from the client with the request, once it closes. Bytes that take the client over one of the byte limits below break that limit, and ban the client as a broken rate limit does, so that its next request is refused. The byte limits never cut an answer or an upgraded connection short: the one whose bytes break a limit has already been passed on, or has closed. They leave out what the rate limits leave out: a client inSWWAF_ALLOW_NETSorSWWAF_RATE_LIMIT_EXEMPT_NETS, and a request for a pathSWWAF_RATE_LIMIT_EXEMPT_PATHSexempts. - Gives the clients of the AS numbers and countries the biased thresholds list,
SWWAF_ASN_LIMIT_PERCENT, the fileSWWAF_ASN_LIMIT_PERCENT_URLnames andSWWAF_COUNTRY_LIMIT_PERCENT, the percentage they give of every rate limit and byte limit, so that the same rules ban them after fewer requests, and, whileSWWAF_UNKNOWN_LIMIT_PERCENTis below 100, every client without a country that percentage. A client to which several apply gets the lowest. For the byte limits,SWWAF_ASN_BYTES_PERCENTgives an AS number it lists a percentage in place of thoseSWWAF_ASN_LIMIT_PERCENTand the file give it, andSWWAF_COUNTRY_BYTES_PERCENTgives a country it lists one in place of the oneSWWAF_COUNTRY_LIMIT_PERCENTgives it. Each client is counted on its own, against its own lowered limits: no budget is shared by a whole AS number or country, which one abuser could use up and so lock out everyone else there. The log line of each request the rate limits count gives its client's percentages below 100 and the settings that gave them, and so do the notes of a ban for a lowered limit, and its alert. - Bans a client that breaks a rate limit or a byte limit, as "Bans" in
SPEC.mddescribes: the first ban lasts an hour, and a limit broken again within a day of a ban ending bans for three times as long as that ban, so 1, 3, 9, 27 and 81 hours; a ban that would last longer than seven days is permanent instead. A ban covers the client's netblock: its IPv4 address, or the netblock around it thatSWWAF_BAN_SCOPE_V4_PREFIXsets, or its IPv6 /64. While it lasts, every request from the netblock is refused withSWWAF_BAN_RESPONSEafter the static lists and before the country lists, so the client is not looked up, and is not counted for the rate limits. A ban sets the client's counters back to zero. Each ban carries notes for deciding whether to lift it: the limit, whether it is on requests or bytes, its window and the requests or bytes counted in it, the client's percentage of that kind of limit and the setting that gave it when a biased threshold lowered the limit, the request that broke it, the client's AS number, AS name and country once they are looked up, the netblock's requests since it was first seen, how many of them the ban has refused, and how many bans the netblock had before, for a broken limit, for a clear sign of attack and by an admin. At mostSWWAF_MAX_BANSbanssmallwebwafmade are kept, past, active and permanent; past that, the earliest such ban of the netblock that has gone longest without a request is dropped first. The bans whose cause isadmin, those you make or keep, are kept besides, and never dropped.bans.jsonshows the bans and their notes, a restart lifts none, and you make, keep or lift a ban by editing it (see "State files" below). - Checks each request against the rules of the rule files (see "Rule files"
below) after the rate limits, and before its body is read. A
logrule that matches is noted in the log line; ablockrule refuses the request with403, and bans no one; abanrule refuses it withSWWAF_BAN_RESPONSEand bans the client's netblock for a clear sign of attack. Matching stops at the first rule that refuses. A client inSWWAF_ALLOW_NETSis not checked. - Bans a client for a clear sign of attack, as "Bans" in
SPEC.mddescribes: the first such ban lastsSWWAF_ATTACK_BAN_DURATION, seven days by default, and any request from the netblock while it lasts makes it permanent. Once it has run out, the netblock is served like any other, but its next clear sign of attack bans it permanently at once. Such a ban covers the same netblock as a ban for a broken limit, does not set the client's counters back to zero, and does not make the netblock's next ban for a broken limit longer. Its notes give the id and the target of the rule that matched in place of the limit. - Looks up the AS number and country of every client through GeoJS, or in the
IPinfo Lite database file while
SWWAF_LOOKUP_SOURCEisfile, after the static lists and bans, unlessSWWAF_LOOKUP_SOURCEisoff(see "Country and AS number lookup" below), for the request log, the client's history, the notes of its bans, their alerts, the metrics and the anomaly thresholds per AS number. The file answers at once. With GeoJS, a request waits for its client's first answer only while a setting acts on it, a country list,SWWAF_ADD_LOOKUP_HEADERSor a biased threshold that lowers a limit. Otherwise it goes on at once, and the answer reaches the client's history and the notes of its bans when it comes, but not the log lines of the requests that went on without it, nor the alerts already raised for those bans. - Refuses a request from a country you refuse with
SWWAF_BAN_RESPONSE, as soon as the client's country is known and before its body is read; such a request is not counted for the rate limits. A client on a private, loopback or link-local address has no country and is never looked up:SWWAF_EXCLUSIVELY_ALLOWED_COUNTRIESrefuses it unless it is inSWWAF_ALLOW_NETS, andSWWAF_DENIED_COUNTRIESdoes not refuse it. - Checks the client's own address against the blocklists
SWWAF_BLOCKLIST_URLSnames, after the country lists and before the rate limits (see "Blocklists" below). WithSWWAF_BLOCKLIST_ACTIONatdeny, its default, a request from a client a blocklist lists is refused withSWWAF_BAN_RESPONSEbefore its body is read; it is not counted for the rate limits, and makes no ban. Withlimit:<percent>the client gets that percentage of every rate limit and byte limit, the lowest of its percentages applying, as for a biased threshold, and withlognothing more is done. Whatever the action, the request's log line names the lists, and each raises an alert. - Checks the client's own address against the DNSBL zones
SWWAF_DNSBL_ZONESnames, after the blocklists and before the rate limits (see "DNS blocklists" below), by the verdicts it keeps. A zone is asked about a client in the background, and no request waits for its answer: the request that has it asked, and any other from the client before the answer comes, goes on as from a client the zone does not list. WithSWWAF_REPUTATION_ACTIONatlimit:25, its default, a client a zone's verdict lists gets a quarter of every rate limit and byte limit, the lowest of its percentages applying, as for a biased threshold. Withdeny, its requests are refused withSWWAF_BAN_RESPONSEbefore their bodies are read; they are not counted for the rate limits, and make no ban. Withlog, nothing more is done. Whatever the action, the request's log line names the zones, and each raises an alert. A client a blocklist refuses is not checked. - Checks the client's own address against the static lists, the three netblock
settings below, before anything else, its lookup included. A client in
SWWAF_ALLOW_NETSskips bans, the country lists, the blocklists, the DNSBL zones, the rate limits, the byte limits and the rule files, and is not looked up; the timeouts and size limits still apply. A client inSWWAF_DENY_NETSis refused withSWWAF_BAN_RESPONSEbefore its body is read, and the request is not counted for the rate limits; an address inSWWAF_ALLOW_NETStoo is let through. A client inSWWAF_RATE_LIMIT_EXEMPT_NETSis neither counted nor refused by the rate limits, and has no bytes counted by the byte limits; the country lists, the rule files and bans still apply to it. - In
observemode, withSWWAF_MODE=observe, refuses none of the requests thatSWWAF_DENY_NETS, a ban, the country lists, a blocklist, a DNSBL zone's verdict, a rate limit or a rule would refuse: it passes them to the app, and their log lines name whatenforcemode would have done (seewould_actionin "Request log" below). The checks run, and requests and bytes are counted, as inenforcemode, with three differences: neither a broken rate limit or byte limit nor abanrule makes a ban; a broken limit does not set the client's counters back to zero, so each request over a rate limit is logged as one that would be refused, and each whose bytes keep the client over a byte limit as breaking it; and a request under a ban does not make it permanent. As inenforcemode, the bytes counted are only those of the requestsenforcemode would have passed to the app. A ban it would have made, or made permanent, raises the alertenforcemode would have raised, marked as what would have happened (see "Alerts" below). The bans inbans.jsonare kept, and refuse requests again whensmallwebwafnext runs inenforcemode, as long as they last. The timeouts and size limits still apply, since they protectsmallwebwafand the app themselves, and a request for one ofsmallwebwaf's own endpoints without its token is still answered401. It is for trying a configuration before enforcing it. - Answers
GET /_smallwebwaf/healthzitself with200andok, before any check and without asking the app, for the image's health check. - Answers
GET /_smallwebwaf/metricswith its metrics (see "Metrics" below) for a request that carriesSWWAF_METRICS_TOKENasAuthorization: Bearer <token>, and with401for one that does not. While the token is unset the metrics answer404, as does any request under/_smallwebwaf/that is not for one of its endpoints. Unlike the health check, such a request goes through every check any other request goes through, and is answered where another would be passed to the app: a banned client stays refused, and each counts toward the client's rate limits. None of them reaches the app. - Lets an admin list, add and lift bans, and ask what it knows of a client,
through the endpoints
SWWAF_ADMIN_TOKENopens, which go through the checks as the metrics do (see "Admin endpoints" below). - Writes a line in the request log for each request (see "Request log" below).
- Sends every line it writes on stdout to a syslog server as well, while
SWWAF_LOG_REMOTE_URLnames one (see "Sending the log to a syslog server" below). - Sends an alert for each ban it makes or makes permanent, for a count over an
anomaly threshold, for a client a blocklist or a DNSBL zone lists, for GeoJS
failing, a list it cannot fetch or a DNSBL zone that fails or refuses a query,
for a rule file or state file with an error, and for a replacement of the
lookup database it cannot read, holding back repeats and, past an hourly
limit, rolling the rest into one summary, to each destination you name: as a
JSON object to the webhook
SWWAF_ALERT_WEBHOOK_URLnames, as a message to the Slack incoming webhookSWWAF_ALERT_SLACK_WEBHOOK_URLnames, and as a message to the ntfy topicSWWAF_ALERT_NTFY_URLnames (see "Alerts" below). - Counts requests and their bytes over a minute and an hour, per client, per
netblock around a client, per AS number, for the whole service and per named
netblock, and sends an
anomalyalert for a count over the anomaly threshold you set for it (see the anomaly thresholds below). These thresholds only alert: they refuse and ban nothing. A scope whose four thresholds are all off is not counted, and within a scope only the counts whose threshold is set are counted. Every request but the health check is counted, whatever is done with it: one that is refused, one from a client inSWWAF_ALLOW_NETSorSWWAF_RATE_LIMIT_EXEMPT_NETS, and one for a path inSWWAF_RATE_LIMIT_EXEMPT_PATHS, with its body bytes once it has ended, those of the answer, of the request or both, asSWWAF_BYTES_COUNTsays. A request is counted for its client's AS number only if the lookup has given that by the time the request ends: no request waits for it, and a client inSWWAF_ALLOW_NETS, which is not looked up, counts for no AS number. At most 20,000 counters are kept, the one counted least recently dropped first, andalerts.jsonkeeps them across a restart (see "State files" below).
Settings
Each setting is an environment variable, or a file one names (see "Settings given as files" below), and each has a default, so none has to be set. A setting that is set but invalid stops the start with a message naming it, and the effective settings are logged at start.
SWWAF_LISTEN_ADDR(default:8080): wheresmallwebwaflistens.SWWAF_UPSTREAM_URL(defaulthttp://127.0.0.1:8081): the app, ashttporhttps, a host and an optional port, and nothing more.SWWAF_INSTANCE_NAME(default: the host's name, which docker sets to the first 12 characters of the container's id unless the deployment names one): the name every log line and alert gives asinstance, and every metric carries as its labelinstance(see "Metrics" below). Set it, for example tofsn1app1/gitea, for a name that stays the same when a deploy replaces the container, and that tells instances apart when several log to one place. A name that is not valid UTF-8, such as one saved in Latin-1, stops the start.SWWAF_MODE(defaultenforce):enforce, orobserveto pass on the requestssmallwebwafwould refuse and log what it would have done (see "What it does so far" above).SWWAF_TRUSTED_PROXIES(default10.0.0.0/8,172.16.0.0/12,192.168.0.0/16, the private address ranges): the netblocks whoseX-Forwarded-Foris believed. A list given replaces the default; set but empty, it trusts nothing.SWWAF_CLIENT_REQUEST_TIMEOUT(default60s): how long a client may take to send its request line and headers, and then, from the end of the headers, its body.SWWAF_CLIENT_REQUEST_HEADER_MAX_BYTES(default32K): the largest request line and headers a client may send. Over it, the answer is431and nothing reaches the app. It must be more than4K, and cannot beoff: Go's HTTP server always has such a limit, and reads 4 KiB past the one it is given before it refuses.SWWAF_CLIENT_IDLE_TIMEOUT(default120s): how long a kept-open connection may wait for its next request beforesmallwebwafcloses it. The default is longer than the 90 seconds after which traefik closes a connection it is not using, so traefik never sends a request on a connectionsmallwebwafis closing.SWWAF_CLIENT_RESPONSE_TIMEOUT(default30m): how long the response may take to reach the client, from the end of the request to the last byte.SWWAF_UPSTREAM_REQUEST_TIMEOUT(default60s): how long connecting to the app and sending it the whole request may take.SWWAF_UPSTREAM_RESPONSE_TIMEOUT(default30m): how long the app may take to send its whole answer, from the end of the request to the last byte.SWWAF_REQUEST_MAX_BYTES(default100M): the largest request body.SWWAF_RESPONSE_MAX_BYTES(default5G): the largest response body.SWWAF_ALLOW_NETS(default empty): netblocks whose clients skip bans, the country lists, the blocklists, the DNSBL zones, the rate limits, the byte limits and the rule files, such as your monitoring or your own networks.SWWAF_RATE_LIMIT_EXEMPT_NETS(default empty): netblocks whose clients the rate limits and the byte limits do not apply to, such as a machine that talks to the app all day.SWWAF_DENY_NETS(default empty): netblocks whose clients are always refused.SWWAF_RATE_LIMIT_PER_MINUTE(default1000),SWWAF_RATE_LIMIT_PER_HOUR(default10000) andSWWAF_RATE_LIMIT_PER_DAY(default50000): the most requests a client may make in a minute, an hour and a day. The defaults are several times what one busy person produces, since a browser loading a heavy page makes a few hundred requests and several people often share one address.SWWAF_RATE_LIMIT_EXEMPT_PATHS(default empty): path prefixes whose requests the rate limits neither count nor refuse, and whose bytes the byte limits do not count, such as/assets/for static assets; each starts with/. A request whose path, percent-decoded, contains..anywhere or a backslash, or whose path as sent holds an encoded slash (%2For%2f), is never exempt, since the app may act on it as a path outside every prefix:/assets/..%2Floginas/login. Any other request is exempt when its path as sent, the path the app receives, before any query string and not percent-decoded, starts with a prefix, character for character./assets/matches/assets/app.jsand/assets/, but not/assets,/Assets/app.js,/%61ssets/app.js,/static/assets/app.js,/static/../assets/app.jsor/assets%2Fapp.js. A character the client sends percent-encoded, such as a space, is written percent-encoded in a prefix, as in/my%20files/, and there are no wildcards:*is a character like any other.SWWAF_BYTES_LIMIT_PER_MINUTE(default10G),SWWAF_BYTES_LIMIT_PER_HOUR(default20G) andSWWAF_BYTES_LIMIT_PER_DAY(default50G): the most bytes a client may have counted in a minute, an hour and a day. A request's bytes are counted once its answer has ended, so each default is above the largest request body and the largest response together,SWWAF_REQUEST_MAX_BYTESandSWWAF_RESPONSE_MAX_BYTES: at the defaults no download breaks a limit on its own.SWWAF_BYTES_COUNT(defaultboth): which body bytes the byte limits count:responsefor those of the answers,requestfor those of the requests, orboth.SWWAF_LOOKUP_SOURCE(defaultgeojs): where each client's AS number and country are looked up:geojs, the GeoJS web service, which is then told the address of every new visitor,file, the IPinfo Lite database fileSWWAF_LOOKUP_DB_PATHnames, oroff, which looks up no client and sends no address to GeoJS. Withoff, a country list that is not empty,SWWAF_ADD_LOOKUP_HEADERSset totrue, a biased threshold that lowers a limit, a list of them that is not empty,SWWAF_ASN_LIMIT_PERCENT_URLset orSWWAF_UNKNOWN_LIMIT_PERCENTbelow 100, or an anomaly threshold per AS number that is notoff, stops the start, with a message naming it andSWWAF_LOOKUP_SOURCE.SWWAF_LOOKUP_DB_PATH(default empty): the IPinfo Lite database file, in its.mmdbform, forSWWAF_LOOKUP_SOURCE=file.filewithout it, or it with any otherSWWAF_LOOKUP_SOURCE, the default included, stops the start, with a message naming both.SWWAF_LOOKUP_TIMEOUT(default1s): how long a request waits for its client's first answer from GeoJS while a setting acts on it, and how long a request to GeoJS may take before it is abandoned.SWWAF_ADD_LOOKUP_HEADERS(defaultfalse):truepasses the app the client's AS number, such asAS64496, inX-Client-ASN, and its country inX-Client-Country, leaving out one that is unknown. A request then waits for its client's first answer, as it does while a country list is set. Whatever this setting says, anyX-Client-ASNorX-Client-Countrythe client sent, in any case, is removed, so that the app never receives a client's own.SWWAF_DENIED_COUNTRIES(default empty): countries whose clients are refused, for examplecn,ru,kp.SWWAF_EXCLUSIVELY_ALLOWED_COUNTRIES(default empty): when set, the only countries whose clients get through, for exampleus,de. A client whose country cannot be found is refused too, so that new clients are not let in whenever GeoJS stops answering.SWWAF_ASN_LIMIT_PERCENT(default empty): AS numbers, each with the percentage of every rate limit and byte limit its clients get, such asAS14061:50,AS16276:50,AS45102:25. A lowered limit is rounded down to a whole number: half of 1000 requests a minute is 500, and half of 5 is 2.0is a zero allowance: the client's first request breaks a limit, and bans it.SWWAF_COUNTRY_LIMIT_PERCENT(default empty): the same by country, such ascn:25,ru:50.SWWAF_ASN_BYTES_PERCENTandSWWAF_COUNTRY_BYTES_PERCENT(default empty): the same for the byte limits alone. For an AS number or a country one of them lists, its percentage takes the place, for the byte limits, of the oneSWWAF_ASN_LIMIT_PERCENTorSWWAF_COUNTRY_LIMIT_PERCENTgives, so thatSWWAF_ASN_LIMIT_PERCENT=AS14061:50withSWWAF_ASN_BYTES_PERCENT=AS14061:100halves that AS number's rate limits and leaves its byte limits whole.SWWAF_UNKNOWN_LIMIT_PERCENT(default100): the percentage of every limit a client without a country gets: one the lookup cannot place, one on a private, loopback or link-local address, which is never looked up, and one whose answer from GeoJS has not come in time.SWWAF_ASN_LIMIT_PERCENT_URL(default unset): thehttporhttpsURL of a file of AS numbers, each with its percentage of every rate limit and byte limit, one such asAS14061:50to a line, whose percentages count as those ofSWWAF_ASN_LIMIT_PERCENTdo, so that one list can serve several instances. For an AS number both give a percentage, the lower applies, and an AS number the file lists twice gets the lower of its two. It is fetched and kept as a blocklist is (see "Blocklists" below). A URLSWWAF_BLOCKLIST_URLSnames too stops the start.SWWAF_BLOCKLIST_URLS(default empty): the blocklists, ashttporhttpsURLs without a user or a fragment, such ashttps://www.spamhaus.org/drop/drop.txt(see "Blocklists" below). A URL listed twice stops the start.SWWAF_BLOCKLIST_REFRESH(default24h): how long after a list was last fetched, or a fetch of it failed, it is fetched again, for the blocklists andSWWAF_ASN_LIMIT_PERCENT_URL. Less than1hstops the start: the Spamhaus lists may be fetched no more than once an hour.SWWAF_BLOCKLIST_ACTION(defaultdeny): what is done with a client a blocklist lists:denyrefuses its requests withSWWAF_BAN_RESPONSE,limit:<percent>, such aslimit:25, gives it that percentage of every rate limit and byte limit, andlogdoes nothing more than note the lists in the log line and raise the alert.SWWAF_DNSBL_ZONES(default empty): the DNSBL zones each client is asked about, such asdnsbl.dronebl.org(see "DNS blocklists" below). A zone is a DNS name of at most 189 characters: labels of letters, digits and hyphens, of up to 63 characters each, neither starting nor ending with a hyphen, joined by dots. A Spamhaus zone is the name of its keyed query service, with the key in it, such as<key>.xbl.dq.spamhaus.net, and is shown with its key masked (see "DNS blocklists" below). A zone that is not such a name stops the start, as does one listed twice, even with its letters in another case or with another key. Do not name a zone meant for mail (see "DNS blocklists" below).SWWAF_DNSBL_RESOLVER(default unset): the resolver the zones are asked through, an IP address with an optional port, 53 when none is given, such as192.0.2.53or[2001:db8::53]:5353. Unset, it is the host's, as/etc/resolv.confnames it. Several zones refuse queries that come through a public resolver.SWWAF_REPUTATION_ACTION(defaultlimit:25): what is done with a client a zone's verdict lists, asSWWAF_BLOCKLIST_ACTIONis for a blocklist:deny,limit:<percent>orlog. A zone's verdict is less certain than a list such as DROP, so by default a client it lists gets a quarter of every rate limit and byte limit.SWWAF_REPUTATION_CACHE_TTL(default24h): how long a zone's verdict on a client is used after the zone gave it.SWWAF_REPUTATION_TIMEOUT(default2s): how long a query to a zone may take before it fails.SWWAF_BAN_RESPONSE(default403): how a refused client is answered, one that is banned, breaks a rate limit, matches abanrule, is inSWWAF_DENY_NETS, comes from a refused country, is in a blocklist whileSWWAF_BLOCKLIST_ACTIONisdenyor is listed by a DNSBL zone whileSWWAF_REPUTATION_ACTIONisdeny:403,429, orcloseto close the connection without an answer. Behind traefik,closedoes not leave the client unanswered: traefik answers502, as it does whenever its backend drops a connection. Ablockrule always answers403.SWWAF_LIMIT_BAN_DURATION(default1h): the ban for a first broken rate limit or byte limit.SWWAF_LIMIT_BAN_REPEAT_WINDOW(default24h): a rate limit or byte limit broken again within this time after a ban ended, other than one for a clear sign of attack, bans for three times as long as that ban.SWWAF_MAX_BAN_DURATION(default7d): a ban for a broken rate limit or byte limit that would be longer is permanent instead.SWWAF_ATTACK_BAN_DURATION(default7d): the ban for a first clear sign of attack.SWWAF_MAX_BANS(default5000): the most banssmallwebwafmade that are kept, past, active and permanent. The bans you make or keep are kept besides.SWWAF_BAN_SCOPE_V4_PREFIX(default32): the length of the netblock around an IPv4 client that a ban covers, such as24to ban the surrounding /24. An IPv6 ban covers the client's /64.SWWAF_STATE_DIR(default/var/lib/smallwebwaf): the directory of the state files, an absolute path. A directorysmallwebwafcannot write stops the start.SWWAF_STATE_WRITE_DELAY(default10s): how long after a ban is madebans.jsonis written, with every ban made in between.SWWAF_STATE_COUNTER_INTERVAL(default15m): how often every state file is written.SWWAF_LOG_REQUEST_HEADERS(defaultaccept,accept-language,accept-encoding,content-type,origin,range): the request headers whose values the request log gives, in either case.Authorization,CookieandSet-Cookieare never logged, even when listed (see "Request log" below). An entry namingHostorTransfer-Encodingstops the start, since Go's HTTP server takes both out of the request; the request's host is the fieldhost.SWWAF_ADMIN_TOKEN(default unset): the token an admin sends for the ban endpoints and/_smallwebwaf/clients/<ip>(see "Admin endpoints" below), a long random value. While it is unset they are off; one shorter than 32 characters stops the start. The settings logged at start show********in its place. Given as a file, withSWWAF_ADMIN_TOKEN_FILE, it can be kept out of the app's reach (see "Settings given as files" below).SWWAF_METRICS_TOKEN(default unset): the token a scraper sends for the metrics, a long random value. While it is unset the metrics are off; one shorter than 32 characters stops the start. The settings logged at start show********in its place. Given as a file, it can be kept out of the app's reach (see "Settings given as files" below).SWWAF_METRICS_TOP_N(default50): how many AS numbers and how many countries get series of their own in the metrics by AS number and by country; the others are counted asother.SWWAF_RULES_DIR(default/etc/smallwebwaf/rules.d): the directory of the rule files. A directory that does not exist stops the start.SWWAF_RULES_ENABLED(defaulttrue):falsereads no rule file, and checks no request against one.SWWAF_LOG_REMOTE_URL(default unset): a syslog server that every line on stdout is also sent to, assyslog+udp://,syslog+tcp://orsyslog+tls://with a host and a port, such assyslog+tls://logs.example:6514. Unset or empty, nothing is sent.SWWAF_LOG_REMOTE_TLS_CA_FILE(default unset): a file of PEM certificates, which the certificate of asyslog+tlsserver must chain to instead of the host's own. A file that cannot be read or holds no certificate stops the start.SWWAF_LOG_REMOTE_BUFFER(default10000): the most lines held while they wait to be sent.SWWAF_LOG_REMOTE_FACILITY(defaultlocal0): the syslog facility the lines are sent with:kern,user,mail,daemon,auth,syslog,lpr,news,uucp,cron,authpriv,ftp, orlocal0tolocal7.SWWAF_LOG_REMOTE_APP_NAME(defaultSWWAF_INSTANCE_NAME): the app name the lines are sent with, 1 to 48 printable ASCII characters without a space. WhileSWWAF_LOG_REMOTE_URLis set, anSWWAF_INSTANCE_NAMEthat is not such a name stops the start too, unless this setting gives one that is.SWWAF_ALERT_WEBHOOK_URL(default unset): the webhook each alert is posted to, anhttporhttpsURL without a user or a fragment, such ashttps://alerts.example/smallwebwaf(see "Alerts" below). Unset or empty, no alert is sent to a webhook. Since many webhooks carry their secret in the path or the query, the settings logged at start show********in place of them, and a value that stops the start is not shown.SWWAF_ALERT_WEBHOOK_HEADERS(default empty): headers sent with each alert, such as one that authenticates it, as a list of a name,:and a value, such asAuthorization:Bearer 0123456789abcdef. A value cannot hold a comma. The settings logged at start show********in place of each value.SWWAF_ALERT_SLACK_WEBHOOK_URL(default unset): the Slack incoming webhook each alert is posted to as a message, such ashttps://hooks.slack.com/services/T0123/B4567/abcdef. Unset or empty, no alert is sent to Slack. It is checked and logged asSWWAF_ALERT_WEBHOOK_URLis.SWWAF_ALERT_NTFY_URL(default unset): the ntfy topic each alert is published to, as the topic's full URL, such ashttps://ntfy.sh/my-alerts. Unset or empty, no alert is sent to ntfy. It is checked and logged asSWWAF_ALERT_WEBHOOK_URLis, since anyone who knows a topic on a server open to all can read it.SWWAF_ALERT_NTFY_TOKEN(default unset): an ntfy access token, sent to ntfy with each alert asAuthorization: Bearer <token>, for a topic that needs one. The settings logged at start show********in its place. A control character in it, such as the carriage return of a file saved with Windows line ends, stops the start, and whileSWWAF_ALERT_NTFY_URLis set, so does one inSWWAF_INSTANCE_NAME, which ntfy is sent in the title.SWWAF_ALERT_EVENTS(defaultban,permanent_ban,waf_block,anomaly,reputation_hit,source_failure,file_error): the events alerts are sent for.waf_blockcomes with the Core Rule Set; nothing raises it yet.SWWAF_ALERT_COOLDOWN(default15m): how long a repeat of an alert is held back (see "Alerts" below).SWWAF_ALERT_MAX_PER_HOUR(default60): the most alerts sent in an hour; the rest of the hour's alerts are rolled into one summary.SWWAF_ANOMALY_CLIENT_REQUESTS_PER_MINUTE,SWWAF_ANOMALY_CLIENT_REQUESTS_PER_HOUR,SWWAF_ANOMALY_CLIENT_BYTES_PER_MINUTEandSWWAF_ANOMALY_CLIENT_BYTES_PER_HOUR(defaultoff): the anomaly thresholds per client, the most requests and the most bytes a client may have counted in a minute and in an hour before ananomalyalert is sent for it. They refuse and ban nothing. Each scope below has the same four thresholds, their names ending inREQUESTS_PER_MINUTE,REQUESTS_PER_HOUR,BYTES_PER_MINUTEandBYTES_PER_HOUR, and each isoffby default, since what is unusual depends on each service's normal traffic, which the metrics show.SWWAF_ANOMALY_NET_REQUESTS_PER_MINUTE,..._PER_HOUR,SWWAF_ANOMALY_NET_BYTES_PER_MINUTEand..._PER_HOUR(defaultoff): the anomaly thresholds per netblock around a client, which isSWWAF_ANOMALY_NET_V4_PREFIX(default24) long, from 0 to 32, for an IPv4 client, andSWWAF_ANOMALY_NET_V6_PREFIX(default48) long, from 0 to 128, for an IPv6 one.SWWAF_ANOMALY_ASN_REQUESTS_PER_MINUTE,..._PER_HOUR,SWWAF_ANOMALY_ASN_BYTES_PER_MINUTEand..._PER_HOUR(defaultoff): the anomaly thresholds per AS number.SWWAF_ANOMALY_TOTAL_REQUESTS_PER_MINUTE,..._PER_HOUR,SWWAF_ANOMALY_TOTAL_BYTES_PER_MINUTEand..._PER_HOUR(defaultoff): the anomaly thresholds for the whole service.SWWAF_WATCH_NETS(default empty): named netblocks, each a name,=and a netblock, such asoffice=203.0.113.0/24,scraper-x=198.51.100.0/22. An item without=, without a name or without a valid netblock, or a name listed twice, stops the start.SWWAF_WATCH_REQUESTS_PER_MINUTE,..._PER_HOUR,SWWAF_WATCH_BYTES_PER_MINUTEand..._PER_HOUR(defaultoff) are the anomaly thresholds of each named netblock as a whole, which counts every client inside it; a client inside several is counted in each.
Durations are in Go's syntax, with d for days (90s, 15m, 7d). Sizes are
bytes, with an optional K, M or G, which are powers of 1024 (1K is 1024
bytes). Rate limits and the anomaly thresholds on requests are whole numbers of
requests, and byte limits and the anomaly thresholds on bytes are sizes.
Netblocks are in CIDR form, and a bare address stands for itself alone.
Countries are the two-letter codes ISO 3166-1 assigns today, and xk for
Kosovo, in either case (de and DE are the same); any other code, such as
nk (North Korea is kp) or the withdrawn su, stops the start, and so does a
code on both country lists. AS numbers are AS and the number, in either case.
Percentages are whole numbers from 0 to 100, and an entry of a list of them is
an AS number or a country, : and a percentage; an AS number or a country
listed twice in one of them stops the start. off switches a timeout, a size
limit, a rate limit, a byte limit, an anomaly threshold, SWWAF_ALERT_COOLDOWN
or SWWAF_ALERT_MAX_PER_HOUR off; SWWAF_CLIENT_REQUEST_HEADER_MAX_BYTES,
SWWAF_LOOKUP_TIMEOUT, SWWAF_UNKNOWN_LIMIT_PERCENT,
SWWAF_BLOCKLIST_REFRESH, SWWAF_REPUTATION_CACHE_TTL,
SWWAF_REPUTATION_TIMEOUT, the ban settings, the state settings,
SWWAF_METRICS_TOP_N, SWWAF_LOG_REMOTE_BUFFER, SWWAF_ANOMALY_NET_V4_PREFIX
and SWWAF_ANOMALY_NET_V6_PREFIX cannot be off.
Several limits are fixed rather than settings. At most 20,000 clients are kept, with their counters and history, and an IPv6 client is counted by its /64. At most 100,000 answers from GeoJS are kept, for 7 days each, at most 20,000 anomaly counters, and at most 100,000 verdicts of the DNSBL zones, with at most 1,000 queries to them under way at once.
Settings given as files
Any setting may instead be given as a file that holds its value: the variable
named like the setting with _FILE added, such as SWWAF_METRICS_TOKEN_FILE,
names the file. smallwebwaf reads the file once, at start, and its health
check reads only the files of SWWAF_LISTEN_ADDR and SWWAF_UPSTREAM_URL, each
time it runs. The file's contents are the value, less one newline at their end
so that a file written with echo or an editor works, and are checked as the
setting's own value would be. Setting both the setting and its _FILE form, or
naming a file that cannot be read, stops the start with a message naming the
variable. The settings logged at start name the file, and show a token given in
one as ********, as they show one given directly.
SWWAF_LOG_REMOTE_TLS_CA_FILE, whose value names a file already, has no _FILE
form.
The app starts with the same environment variables as smallwebwaf, so it can
read a token given as one. A token given as a file is out of the app's reach
only while the smallwebwaf user alone can read the file: make it on the host,
owned by uid 65532, the smallwebwaf user, with mode 0400, and mount the
directory that holds it into the container read-only; the container sees the
same owner and mode. For example, on the host:
mkdir -p /srv/app/tokens
openssl rand -hex 32 > /srv/app/tokens/metrics
chown 65532:65532 /srv/app/tokens/metrics
chmod 0400 /srv/app/tokens/metrics
and for the container, -v /srv/app/tokens:/etc/smallwebwaf/tokens:ro and
-e SWWAF_METRICS_TOKEN_FILE=/etc/smallwebwaf/tokens/metrics.
Request log
smallwebwaf writes one JSON object per line on stdout for every request,
refused ones included:
{"type":"request","time":"2026-10-03T12:00:00.123Z","instance":"fsn1app1/gitea","client_ip":"203.0.113.9","method":"GET","scheme":"https","host":"app.example","path":"/","query":"","protocol":"HTTP/1.1","status":200,"request_bytes":0,"response_bytes":5120,"referer":"","user_agent":"curl/8.9.1","request_id":"7Q2NHZ4KJ3VXW5YB6R3MEFTD2A","peer_ip":"172.18.0.2","forwarded_for":"203.0.113.9","client_group":"203.0.113.9/32","asn":"AS64496","as_name":"Example Net","country":"DE","request_headers":{"accept":"*/*"},"response_content_type":"text/html; charset=utf-8","upstream_status":200,"action":"forward","counts":{"minute":1,"hour":12,"day":40,"minute_bytes":5120,"hour_bytes":61440,"day_bytes":204800},"duration_total":3.217,"duration_checks":0.041,"duration_upstream_connect":0.052,"duration_upstream_first_byte":2.874,"duration_upstream_total":3.104}
A field that does not apply to a request is left out of its line, apart from
type, the fields from time to user_agent, request_id, peer_ip,
client_group, asn, as_name, country, action and duration_total,
which every line has.
timeis when the request arrived, in UTC.instanceisSWWAF_INSTANCE_NAME.schemeis theX-Forwarded-Protoa trusted proxy sent, and otherwisehttp.pathandqueryare as the client sent them.request_idis theX-Request-IDa trusted proxy sent, or a new random one of 26 letters and digits when it sent none, or when the peer is not a trusted proxy. A request passed to the app takes it there inX-Request-ID.peer_ipis the TCP peer, normally traefik.forwarded_foris theX-Forwarded-Forheader as received, several lines of it joined with,.client_groupis the client as the rate limits count it: its IPv4 address as a /32, or the /64 of its IPv6 address.asn,as_nameandcountryare the client's AS number, such asAS64496, the name of that AS, and its country, as GeoJS or the lookup database gives them. Each is empty whenSWWAF_LOOKUP_SOURCEisoff, for a client inSWWAF_ALLOW_NETSorSWWAF_DENY_NETS, for a client on a private, loopback or link-local address, when GeoJS has not answered by the time the request went on, for a client whose address the lookup database does not hold, and for a request whose client a ban covers, even when the answer is known.asnandas_nameare empty too when GeoJS knows no AS number for the client, which it gives as 64512, andcountrywhen GeoJS cannot place the client.content_typeis the request'sContent-Type, andcontent_lengththe length the request announced for its body, which is left out for none or zero.request_headersare the request's headers thatSWWAF_LOG_REQUEST_HEADERSnames, by name in lower case, several lines of one joined with,.Authorization,CookieandSet-Cookieare never among them, whatever the setting says:has_authorizationandhas_cookieare there instead, and true, when the request has anAuthorizationor aCookieheader.websocketis there, and true, when the app switched the connection to another protocol, as it does for a WebSocket.statusis what the client was sent,0if nothing was;upstream_statusis what the app answered, and is left out when the app did not answer.response_content_type,cache_controlandlocationare theContent-Type,Cache-ControlandLocationheaders of the answer: the app's, as passed on, or those ofsmallwebwaf's own answer.request_bytesandresponse_bytescount body bytes.actionisforwardfor a request passed to the app,deniedfor one refused because its client is inSWWAF_DENY_NETS, in a blocklist whileSWWAF_BLOCKLIST_ACTIONisdeny, or listed by a DNSBL zone whileSWWAF_REPUTATION_ACTIONisdeny,bannedfor one refused because a ban covers its client or because it matched abanrule, which bans its client,country_deniedfor one refused for its client's country,rate_limitedfor one that broke a rate limit and banned its client,rule_blockedfor one ablockrule refused,too_largefor a request or response over its size limit,timed_outfor one that ran out of time,upstream_errorwhen the app could not be reached or its answer broke off, andadminfor onesmallwebwafanswered at its own endpoint.would_actionis there inobservemode for a request thatSWWAF_DENY_NETS, a ban, the country lists, a blocklist, a DNSBL zone's verdict, a rate limit or a rule would have refused inenforcemode, and names the action that refusal would have had:denied,banned,country_denied,rate_limitedorrule_blocked.actionthen names what was done:forwardfor a request passed to the app, and another action, such astoo_large, for one a size or time limit refused.limit_percentis there for a request the rate limits count whose client a biased threshold,SWWAF_BLOCKLIST_ACTIONfor a blocklist that lists it, orSWWAF_REPUTATION_ACTIONfor a DNSBL zone whose verdict lists it, gives less than the whole of the rate limits, and gives the percentage it gets, withlimit_percent_settingnaming the setting that gave it, such asSWWAF_ASN_LIMIT_PERCENT, orSWWAF_ASN_LIMIT_PERCENT_URLfor the file it names.bytes_percentandbytes_percent_settingare the same for the byte limits. Each is left out when the client gets the whole of those limits.countsgives the client's requests in the minute, the hour and the day as the rate limits count them, this request included: in each window, those in the bucket under way and a share of those in the bucket before, so a count can have a fraction. For a request that broke a limit, they are the counts that broke it. It is left out for a request the rate limits do not count: the health check, one from a client inSWWAF_ALLOW_NETSorSWWAF_RATE_LIMIT_EXEMPT_NETS, one for a path thatSWWAF_RATE_LIMIT_EXEMPT_PATHSexempts, and one thatSWWAF_DENY_NETS, a ban, the country lists, a blocklist or a DNSBL zone's verdict refuse, or would refuse inobservemode. Itsminute_bytes,hour_bytesandday_bytesgive the client's bytes in each window as the byte limits count them, in the same way: for a request whose bytes they count, with its own, once it has ended; for any other, those counted before it.rule_idsis there for a request that matched rules of the rule files, and lists their ids in the order they matched, up to the one that refused it.limit_hitis there for a request that broke a rate limit, or whose bytes broke a byte limit, and names the window whose limit it went over ascountsnames it:minute,hourordayfor a rate limit, andminute_bytes,hour_bytesorday_bytesfor a byte limit, the shortest if it went over several.offenceis thenlimit. A request whose bytes broke a byte limit is not refused: itsactionis what it would have been otherwise, such asforward.reputationis there for a request whose client a blocklist or a DNSBL zone's verdict lists, and gives the URLs of the blocklists that list it, in the orderSWWAF_BLOCKLIST_URLSnames them, then the zones whose verdict lists it, in the orderSWWAF_DNSBL_ZONESnames them, whateverSWWAF_BLOCKLIST_ACTIONandSWWAF_REPUTATION_ACTIONsay. A zone whose verdict on the client has not come yet, or was givenSWWAF_REPUTATION_CACHE_TTLago or more, is not named. It is left out for a client the blocklists are not checked for: one inSWWAF_ALLOW_NETS, and oneSWWAF_DENY_NETS, a ban or the country lists refuse first, or would inobservemode. The zones are not checked either for a client a blocklist refuses, or would inobservemode.ban_expiresis there for a request that made a ban or was refused under one, or inobservemode would have been refused under one, and gives when the ban ends, in the same form astime, orpermanent.abortedis there, and true, when the client went away early.- The timings are in milliseconds, to the microsecond.
duration_totalruns from when the request's headers had been read to when its line is written, andduration_checksover the same start to when the checks were done; the health check runs none, and its line has noduration_checks.duration_upstream_connect,duration_upstream_first_byteandduration_upstream_totalare there for a request passed to the app, and run from when it was handed to the app: until there was a connection to it, new or kept open from an earlier request, until the first byte of its answer arrived, and until the end. The first two are left out when that never happened, as for an app that cannot be reached.
No body is logged, and no header but those above. smallwebwaf's own messages
(start, the settings, stop, errors) share the stream as JSON lines marked
"type":"process", each with instance as a request's line has it.
Go's HTTP server, on which smallwebwaf is built, reads a request's line and
headers before smallwebwaf sees the request, and some requests end there,
without a line in the log: headers over SWWAF_CLIENT_REQUEST_HEADER_MAX_BYTES,
which it answers 431, headers slower than SWWAF_CLIENT_REQUEST_TIMEOUT,
whose connection it closes without an answer, and requests it cannot read at
all, which it answers itself, mostly with 400.
Sending the log to a syslog server
While SWWAF_LOG_REMOTE_URL is set, every line smallwebwaf writes on stdout,
request lines and its own, is also sent to that syslog server, as the message of
an RFC 5424 record: one record to a datagram over UDP, and over TCP and TLS each
record after its length in bytes and a space. A record gives the facility
SWWAF_LOG_REMOTE_FACILITY names, the severity informational, the time the line
was written, in the same form as a request line's time, the host's name, and
the app name SWWAF_LOG_REMOTE_APP_NAME gives. stdout is unchanged.
The lines wait in a buffer of SWWAF_LOG_REMOTE_BUFFER lines and are sent from
there, so a server that is slow or cannot be reached never holds up a request or
stdout. When the buffer is full, its oldest line is dropped to make room. A line
whose sending fails is dropped too, and the connection closed. That failure,
like a failed attempt to connect, is logged and followed by the next attempt to
connect a second later, twice as long after each further failure up to a minute,
and a second again after a connection that stayed up for a minute before it
failed. A line too long for one UDP datagram is dropped alone, with no wait and
nothing logged. UDP gives no sign of what arrives, and over TCP and TLS a line
sent on a connection the server has just closed can be lost before a failure
shows; such a loss is not counted.
As smallwebwaf stops, it sends the lines still waiting, on the connection open
or a new one, for at most two seconds, and gives up the rest; stdout has carried
them.
Alerts
smallwebwaf sends each alert to each destination you name: to
SWWAF_ALERT_WEBHOOK_URL it posts the alert as one JSON object, with
Content-Type: application/json and the headers SWWAF_ALERT_WEBHOOK_HEADERS
gives, as "Alert webhook schema" in SPEC.md describes, and to
SWWAF_ALERT_SLACK_WEBHOOK_URL and SWWAF_ALERT_NTFY_URL a message made from
it, as below. An alert is for one of these events, and is sent when
SWWAF_ALERT_EVENTS names its event:
ban: a bansmallwebwafmakes, for a broken rate limit or byte limit or a clear sign of attack.permanent_ban: a permanent ban it makes, or a ban for a clear sign of attack that a request made permanent.anomaly: a count of requests or bytes over an anomaly threshold, raised by each request that ends with the count over it, inobservemode as inenforcemode. It refuses and bans nothing.reputation_hit: a request whose client a blocklist or a DNSBL zone's verdict lists, one alert for each blocklist and each zone that lists it, whateverSWWAF_BLOCKLIST_ACTIONandSWWAF_REPUTATION_ACTIONsay, inobservemode as inenforcemode.source_failure: GeoJS failing or refusingsmallwebwaf, a fetch of a list failing (see "Blocklists" below), or a query to a DNSBL zone failing or refused (see "DNS blocklists" below).file_error: a rule file edited while it runs that has an error, an edit of a state file set aside as<name>.bad, a state file it could not write while running, or a replacement of the lookup database it could not read, which it does not use.
The bans you make, in bans.json or through the ban endpoints, raise no alert.
In observe mode, a request that would have made a ban, or made one permanent,
raises the alert enforce mode would have raised, for the ban as it would have
been, with mode, observe, in its detail: no ban was made, or made
permanent. A request that would have made a ban whose alert would be held back,
by the cooldown or past SWWAF_ALERT_MAX_PER_HOUR, raises none, and is not
counted. This is the alert for a ban for a broken rate limit, shown indented; it
is sent on one line:
{
"instance": "fsn1app1/gitea",
"time": "2026-10-06T12:00:00.123461Z",
"event": "ban",
"client": "203.0.113.9",
"netblock": "203.0.113.9/32",
"asn": "",
"as_name": "",
"country": "",
"reason": "requests per minute over the limit of 1000",
"detail": {
"ban_expires": "2026-10-06T13:00:00.123Z",
"cause": "limit",
"notes": {
"asn": "",
"as_name": "",
"country": "",
"kind": "requests",
"limit": 1000,
"window": "minute",
"count": 1001,
"request": {
"time": "2026-10-06T12:00:00.123456789Z",
"method": "GET",
"host": "app.example",
"path": "/owner/repo/commits/branch/main?page=812",
"status": 403,
"user_agent": "scraper/1.0"
},
"requests": 5210,
"refused": 0,
"earlier_bans": {
"limit": 0,
"attack": 0,
"admin": 0
}
}
},
"suppressed_repeats": 0
}
instanceisSWWAF_INSTANCE_NAME, andtimewhen the alert was raised, in UTC.clientis the address of the client whose request raised the alert, andnetblockthe netblock of the ban, or for ananomaly, the netblock counted: the client's own, the netblock around it or a named netblock, and none for an AS number or the whole service, or for areputation_hit, the client's own, asclient_groupgives it; both are empty forsource_failureandfile_error.asn,as_nameandcountryare, for a ban, the client's as the ban's notes give them when the alert is raised: empty, as in this alert, when GeoJS had not answered about the client by then; for ananomaly, the client's as the lookup gave them by the time its request ended; for areputation_hit, the client's as its request's log line gives them.reasonis a short sentence; for a ban, the ban'sreasoninbans.json; for ananomaly, what was counted over which threshold, such asrequests per minute of the netblock 203.0.113.0/24 over the threshold of 1000; for areputation_hit,listed by a blocklistorlisted by a DNSBL zone.detailis what is particular to the event: for a ban, itscause, when it ends asban_expires, in the form the request log gives it, and itsnotes, asbans.jsongives them; for ananomaly, thescope,client,net,asn,totalorwatch, as the settings name them, theasncounted forasnand thenameof the named netblock forwatch, thewindow,minuteorhour, thekind,requestsorbytes, thecount, which is weighted as the rate limits weigh theirs, and thethreshold; for areputation_hit, thesource, the URL of the blocklist or the zone; forsource_failure, thesource,geojs, the URL of the list or the zone, theerror, and for GeoJS, when it is asked again,asking_again_in; forfile_error, thefile, which for an edit set aside is the file it was renamed to, and theerror, which for a file that does not parse names where in it the error is.suppressed_repeatsis how many repeats the cooldown held back before this alert, and for asummary, those no other alert gives (see below).
Slack and ntfy are each sent the alert as a message: a title, the instance and
the event, such as fsn1app1/gitea: ban, and a text, the reason, then a line
for each of the client, the netblock and the country, the file, the
source, the error and the mode the detail gives, and the
suppressed_repeats, leaving out those that are empty or 0. Slack is posted, as
JSON, the title in bold and the text below it, with &, < and > escaped, so
that nothing in them is read as a link or a mention. ntfy is posted the text,
with the title as Title, SWWAF_ALERT_NTFY_TOKEN, while it is set, as
Authorization: Bearer <token>, and the priority and the tag, which ntfy shows
as an emoji, of the alert's event, as Priority and Tags:
| Event | Priority | Tag |
|---|---|---|
ban |
default |
no_entry |
permanent_ban |
high |
no_entry |
waf_block |
default |
shield |
anomaly |
high |
chart_with_upwards_trend |
reputation_hit |
low |
label |
source_failure, file_error |
high |
warning |
summary |
default |
bar_chart |
For the alert above, ntfy is sent these headers and this text:
Title: fsn1app1/gitea: ban
Priority: default
Tags: no_entry
requests per minute over the limit of 1000
client: 203.0.113.9
netblock: 203.0.113.9/32
and Slack this JSON object, shown indented; it is sent on one line:
{
"text": "*fsn1app1/gitea: ban*\nrequests per minute over the limit of 1000\nclient: 203.0.113.9\nnetblock: 203.0.113.9/32"
}
An alert for the same event as the last one sent, on the same netblock, and for
a reputation_hit about the same blocklist or zone, or for a file_error about
the same file, or for a source_failure about the same source, or for an
anomaly in the same scope, with the same netblock, AS number or name, whatever
its window and kind, less than SWWAF_ALERT_COOLDOWN after it, is a repeat: it
is held back and counted, and the next alert sent for them gives that count as
suppressed_repeats. As each hour of the clock, in UTC, ends, the cooldowns
that have run out are dropped, and the repeats they held back, which no alert
sent since has given, go in that hour's summary.
Past SWWAF_ALERT_MAX_PER_HOUR alerts in an hour, the hour's other alerts are
held back and counted by event. An alert held back this way starts no cooldown.
Once the hour has ended, one alert sums up the alerts held back and the repeats
of the cooldowns dropped: its event is summary, its reason says how many
of each were held back, its detail gives the hour as when it started, the
count of alerts held back, and the count for each event, as events, and its
suppressed_repeats gives the repeats. An hour with neither ends without a
summary.
Each destination has a queue of its own, of at most 1000 alerts, from which they
are sent to it one at a time, the oldest first, so a destination that is slow or
down holds up neither the others nor any request. A destination takes an alert
by answering with a 2xx status, and refuses it with a 4xx status other than
408 and 429: a refused alert is logged, counted as dropped, and given up, so
that the next is sent. Any other answer, a redirect included, a connection that
fails, or no answer within 10 seconds is a failure: it is logged, naming the
destination's setting and not its URL, and the alert is sent again a second
later, twice as long after each further failure in a row, up to a minute. With
1000 alerts waiting for a destination, the oldest is dropped to make room for a
new one. The cooldowns, the hour under way and the alerts still waiting for each
destination are kept in alerts.json (see "State files" below), so that after a
restart the alerts waiting are sent, and the cooldowns go on.
State files
smallwebwaf keeps its state in memory and a copy of it in five JSON files in
SWWAF_STATE_DIR, /var/lib/smallwebwaf by default, as "Persistent state" in
SPEC.md describes. Each has a top-level version, 1, and lists its
entries by client address, but for the alerts waiting, the anomaly counters,
which are listed by scope first, and the copies of the lists, listed by URL,
with times in UTC.
bans.json: every ban with its notes, indented to be read. A permanent ban'sexpiresisnull. A ban'scauseislimitfor a broken rate limit or byte limit orattackfor a clear sign of attack, for a bansmallwebwafmade, andadminfor one you made or keep. Itsreasonis a short text: for a bansmallwebwafmade, the limit broken, such asrequests per minute over the limit of 1000orbytes per hour over the limit of 21474836480, or the rule that matched, such asmatched the rule env-file; for yours, what you wrote. Itsliftedis when you lifted it, and is left out until you do. Thekindin the notes of a ban for a broken limit isrequestsorbytes, what the limit is on. For a limit a biased threshold lowered, the reason and the notes'limitgive the lowered limit, and the notes'limit_percentandlimit_percent_settingthe client's percentage of that kind of limit and the setting that gave it.clients.json: each client's two buckets of requests in the minute, the hour and the day, its two buckets of bytes in each,minute_bytes,hour_bytesandday_bytes, and its history: when it was first and last seen, its AS number, AS name and country as last looked up and when the lookup gave them, its requests, how many were forwarded and how many refused (onesmallwebwafanswered at its own endpoints is neither, unless it was refused with401for a missing or wrong token), the body bytes in each direction, its responses by status class and its offences by kind. Each client is on a line of its own, sogrepshows everything about one.lookups.json: GeoJS's answers, one to a line, each with the client's AS number, AS name and country, when GeoJS gave it and when it was last used.reputation.json: each list fetched from a URL (see "Blocklists" below), indented to be read, underlists: itsurl, when it was lasttried, the fetch failed or not, and its last good copy: when that wasfetched, and itslines, as fetched, comment lines included, each on a line of its own, both left out while no fetch of it has succeeded; and underverdicts, each verdict of a DNSBL zone still in use (see "DNS blocklists" below): itszone, theclient's address, whether the zonelistedthe client, and when the zone gave it,fetched. As the file is read, the lists the settings no longer name, and the verdicts of the zones they no longer name, are dropped.alerts.json: the state of the alerts (see "Alerts" above), indented to be read: undercooldowns, for each event and netblock, with thesourcetoo for areputation_hit, or event andfileorsource, or for ananomaly, itsscopewith itsnetblock,asnorname, or event alone, when the last alert was sent,sent, and the repeats held back since,suppressed_repeats; underhour, the hour under way, from itsstart, the alertssentin it and thoseheld_backfor its summary, by event; underwaiting, for each destination you name,webhook,slackorntfy, the alerts still waiting to be sent to it, the oldest first, each as the webhook is sent it; and underanomaly_counters, each anomaly counter: itsscope, as ananomalyalert names it, with thenetblockof a client, of a netblock around a client or of a named netblock, theasnof an AS number and thenameof a named netblock, and its two buckets of requests in the minute and the hour,minuteandhour, and of bytes,minute_bytesandhour_bytes, each left out while it is empty. As an hour ends, the cooldowns that have run out are dropped, and the hour's summary gives the repeats they held back. As the file is read, the alerts waiting for a destination you no longer name are dropped. A file whosewaitingis a list, as it was before alerts went to Slack and ntfy too, stops the start: put the list under"webhook", or remove the file.
bans.json is written SWWAF_STATE_WRITE_DELAY after a ban is made, lifted
through DELETE /_smallwebwaf/bans/<client>, or made permanent, with every such
change in between, and every file every SWWAF_STATE_COUNTER_INTERVAL and when
smallwebwaf stops. Each write goes to a temporary file in the same directory,
which then replaces the file, so a crash leaves the old file or the new one,
whole. A write that fails is logged, raised as a file_error alert while
smallwebwaf runs, and tried again at the next write. A hard kill loses what
changed since the last write.
At start the files are read back: each client keeps its counts, so a restart
gives it no fresh allowance, each anomaly counter keeps its counts, each ban
keeps refusing every client in its netblock until it ends, even after
SWWAF_BAN_SCOPE_V4_PREFIX has changed, and the copy of each list stays in use
until a fetch of it succeeds. A netblock whose address has bits past its length,
such as 203.0.113.9/24, is read as the netblock it is in, 203.0.113.0/24.
Buckets and answers whose time has passed are dropped, and so is an anomaly
counter left with no bucket; a verdict past its time is neither used nor written
again. A missing file is empty state, as on a first start. A file that does not
parse, or has another version, stops the start with a message naming the file,
and the line and column where Go's JSON decoder gives them; so does a state
directory smallwebwaf cannot write. So does an entry without a field it needs,
named with the entry's place in the file: a ban's netblock, start or
expires, which is null for a permanent ban; a client's client, or the
start of a window in which it has requests or bytes; an answer's client,
country, which is "" for a client GeoJS cannot place, or answered; a
cooldown's event or sent; an alert waiting's event or time; an anomaly
counter's netblock, unless it counts an AS number or the whole service, its
asn, for an AS number, its name, for a named netblock, or the start of a
window in which it has requests or bytes; a list's url, fetched or lines,
which is [] for an empty list; a verdict's zone, client, listed, which
is false for a client the zone does not list, or fetched. So does a ban
whose cause is not limit, attack or admin, alerts waiting for a
destination that is not webhook, slack or ntfy, an anomaly counter whose
scope is not client, net, asn, total or watch, and a copy of a list
with a line that would make its fetch fail. An answer's asn or as_name left
out reads as empty.
While it runs, smallwebwaf watches SWWAF_STATE_DIR and takes in your edit of
a state file as soon as you save it: what the file then holds replaces what
smallwebwaf held for it, as if read at start. It tells its own writes from
yours by comparing the file with what it last read or wrote, and before it
writes a file it takes in any edit made since, so your edit is not overwritten;
a change smallwebwaf made after you opened the file, such as a new ban, is
lost when you save over it. An edit that would stop the start, because it does
not parse, has another version, leaves out a field an entry needs, gives a ban
another cause, names another destination, gives an anomaly counter another
scope or gives a list's copy a line that would make its fetch fail, does not
stop the running smallwebwaf: it keeps what it holds, and at the file's next
write renames your file to <name>.bad, such as bans.json.bad, writes the
file again from memory, logs the file and where the error is, and raises a
file_error alert for it. It waits for that write because an editor's file can
be read before the editor has finished writing it. Mend the .bad file and move
it back. A file you remove is written again at its next write.
To ban a netblock, add an entry to bans.json with its netblock, its start
and its expires, null for a ban that never ends; its reason and its
notes may be left out, and so may its cause, which is then admin, and is
written so at the file's next write. A ban whose cause is admin is never
dropped and does not count toward SWWAF_MAX_BANS. A ban whose cause is
attack becomes permanent at the first request it refuses; one whose cause is
admin does not. This bans.json bans 203.0.113.0/24 for good:
{
"version": 1,
"bans": [
{
"netblock": "203.0.113.0/24",
"start": "2026-10-06T12:00:00Z",
"expires": null,
"reason": "probes for logins"
}
]
}
To keep a ban smallwebwaf made, so that it is never dropped, set its cause
to admin: "cause": "admin".
To lift a ban, add lifted to its entry, with the time you lift it, such as
"lifted": "2026-10-06T13:00:00Z". From when the edit is taken in, the ban
refuses nothing, whatever time lifted gives, and does not make the netblock's
next ban longer; it is kept in bans.json with its notes, as any other ban is.
To forget a ban altogether, delete its entry: it then refuses nothing either,
and does not make the netblock's next ban longer.
The ban endpoints add and lift bans without an edit of the file (see "Admin endpoints" below).
Rule files
smallwebwaf reads every *.rules file in SWWAF_RULES_DIR,
/etc/smallwebwaf/rules.d by default, in the order of their names, and checks
each request against their rules in that order, as "Rule files" in
SPEC.md describes. A file whose name starts with ., such as an
editor's lock file .#50-app.rules, is not a rule file, as a shell's *.rules
would not match it. A rule is a line of four fields separated by spaces or tabs:
an id, a target, an action and a regex, which runs to the end of the line.
Spaces and tabs at the end of a line are not part of its regex, so a line with
only those after its action has no regex, and is not a rule. Blank lines and
lines that start with # are ignored.
# id target action regex
env-file path ban (?i)^/\.env(\.[a-z]+)?$
scanner-agent user_agent ban (?i)\b(sqlmap|nikto|nuclei|wpscan)\b
- The id is letters, digits,
-and_, and no two rules share one. The request log, the metrics and a ban's notes name the rule by it. - The target is what the regex is matched against:
pathorquery, as the client sent it, before any decoding;uri, the path and the query together, both as sent and once percent-decoded, so that an encoded probe does not slip past;method;host;user_agent;referer; orheader:<Name>, any one request header butHostandTransfer-Encoding, which Go's HTTP server takes out of every request; the request's host is the targethost. A header sent more than once is matched with its values joined by,, and one not sent as empty text. No body is read. - The action is
log,blockorban(see "What it does so far" above). Keepbanfor requests no real visitor sends, and anchor a path at the site root with^/: a file of the same name deeper in a site can be ordinary content, such as a file in a repository on a code forge. - The regex is in Go's syntax, RE2, which has no backreferences or lookaround,
and takes time linear in the text it reads. It matches anywhere in the target
unless anchored with
^and$;(?i)at its front makes it ignore case.
A line that is not a rule, a header: name with a character no header name can
have, such as header:User-Agent:, a rule for the Host or the
Transfer-Encoding header, a regex that does not compile or an id used twice
stops the start with a message naming the file and the line, and so does a
SWWAF_RULES_DIR that does not exist. An empty directory is no error, and the
log says that it holds no rules. While it runs, smallwebwaf watches the
directory, and reads the rule files again once the directory has had no change
for 2 seconds after one is edited, added or removed, so that a file saved in
place, appended to or copied in with scp is read only once whole, unless its
writing stops for longer. It also reads them 2 seconds after it starts watching,
so that an edit saved while it started is not missed. If they then hold one of
those errors, the rules stay as they were, the earlier version of the edited
file included, the log and a file_error alert name the file and the line, and
the files are read again after the next change.
The image ships one rule file, share/rules.d/00-default.rules here: rules that
ban probes no real visitor sends, for secrets, version control directories,
backups, logs and web shells at the site root, and the user agents of common
scanners; one that blocks ../ twice in a row in the path or the query; and one
that only notes a request without a user agent. An app's Dockerfile adds rules
of its own in a file beside it, named to sort after it, such as this
50-gitea.rules for an app that serves no WordPress:
wp-probe path ban (?i)^/(wp-login\.php|xmlrpc\.php|wp-admin/)
COPY 50-gitea.rules /etc/smallwebwaf/rules.d/50-gitea.rules
A directory mounted over /etc/smallwebwaf/rules.d replaces the default file,
and single files mounted into it add to it. Docker does not show a single
mounted file being replaced, which is how many editors save, so rules to be
edited while smallwebwaf runs belong in a mounted directory, with a copy of
00-default.rules if its rules are to stay. To run without rules, mount an
empty directory or set SWWAF_RULES_ENABLED=false.
Metrics
GET /_smallwebwaf/metrics answers with the metrics in the Prometheus text
format, for a scraper that sends SWWAF_METRICS_TOKEN, through traefik like any
other request. No metric carries a client's address.
Every metric below, Go's and the process's included, carries the label
instance, SWWAF_INSTANCE_NAME, as a constant label set once on the registry
the metrics are kept in, rather than as a label each metric declares. Prometheus
gives each series it scrapes an instance label of its own, the address it
scraped, and keeps this one as exported_instance unless the scrape sets
honor_labels: true.
smallwebwaf_requests_total,smallwebwaf_request_bytes_totalandsmallwebwaf_response_bytes_total: requests, and their body bytes each way, bystatus_class, such as2xx, ornonewhen nothing was sent, and byaction, as the request log names it.smallwebwaf_request_duration_seconds: how long requests took, andsmallwebwaf_upstream_duration_seconds: how long those passed to the app took from then on, as histograms;smallwebwaf_requests_in_flight: the requests under way.smallwebwaf_rate_limit_hits_totalbywindow,minute,hourorday, andkind,requestsfor a rate limit orbytesfor a byte limit,smallwebwaf_size_and_time_limit_hits_totalbylimit, the setting whose limit was passed,smallwebwaf_offences_totalbykind, andsmallwebwaf_bans_made_totalbycause,limit,attackoradmin, the last for the bans you add throughPOST /_smallwebwaf/bans, and those whosecauseisadminthat you add tobans.jsonwhilesmallwebwafruns;smallwebwaf_active_bansandsmallwebwaf_permanent_bans, neither of which counts a lifted ban.smallwebwaf_rule_matches_total: the requests that matched each rule, byrule_idandaction, the rule's own; andsmallwebwaf_rules_loaded: the rules read from the rule files.smallwebwaf_country_requests_total,smallwebwaf_country_request_bytes_total,smallwebwaf_country_response_bytes_total, andsmallwebwaf_country_list_refusals_total, the requests the country lists refused, bycountry, for the requests whose client's country is known. TheSWWAF_METRICS_TOP_Ncountries with the most requests since the start have series of their own, and the others are counted asother. A country that drops out of them loses its series, and its later requests count asother; one that comes into them gets a series that counts from then on.smallwebwaf_asn_requests_total,smallwebwaf_asn_request_bytes_totalandsmallwebwaf_asn_response_bytes_total, byasn, the client's AS number, for the requests whose client's AS number is known, with theSWWAF_METRICS_TOP_Nbusiest AS numbers kept as the countries are.smallwebwaf_geojs_requests_total: the requests to GeoJS;smallwebwaf_geojs_failures_total: those that failed, an answer that leaves out an address asked about included; andsmallwebwaf_geojs_unanswered_total: the requests that needed their client's answer, for a country list,SWWAF_ADD_LOOKUP_HEADERSor a biased threshold, and went on without it because GeoJS had not given it in time.- While
SWWAF_LOOKUP_SOURCEisfile,smallwebwaf_lookup_database_last_read_timestamp_seconds: when the lookup database in use was read; andsmallwebwaf_lookup_database_read_failures_total: the replacements of it that could not be read. - By
source, the URL of each listSWWAF_BLOCKLIST_URLSorSWWAF_ASN_LIMIT_PERCENT_URLnames:smallwebwaf_reputation_hits_total: the requests whose client the blocklist lists, a series that comes with the first;smallwebwaf_reputation_failures_total: the fetches of the list that failed; andsmallwebwaf_reputation_last_fetch_timestamp_seconds: when the copy of it in use was fetched,0while there is none. - By
source, each zoneSWWAF_DNSBL_ZONESnames:smallwebwaf_reputation_hits_total: the requests whose client the zone's verdict lists, a series that comes with the first;smallwebwaf_reputation_queries_total: the queries made to the zone; andsmallwebwaf_reputation_failures_total: those that failed. smallwebwaf_tracked_clients: the clients in the table of clients.smallwebwaf_state_file_writes_total,smallwebwaf_state_file_write_failures_total,smallwebwaf_state_file_last_write_timestamp_secondsandsmallwebwaf_state_file_size_bytes, byfile; and, byfiletoo,smallwebwaf_state_file_edits_taken_in_total: your edits taken in, andsmallwebwaf_state_file_edits_set_aside_total: those renamed to<name>.badbecause they would stop the start.- While
SWWAF_LOG_REMOTE_URLis set,smallwebwaf_remote_log_lines_sent_total: the lines sent to it;smallwebwaf_remote_log_lines_dropped_total: those dropped, from a full buffer or because their sending failed; andsmallwebwaf_remote_log_buffer_depth: those waiting in the buffer. - For each destination you name, by
destination,webhook,slackorntfy:smallwebwaf_alerts_sent_total: the alerts it took;smallwebwaf_alerts_failed_total: the requests to it that failed;smallwebwaf_alerts_suppressed_total: the alerts held back, as repeats or for an hour's summary, which are the same for every destination; andsmallwebwaf_alerts_dropped_total: those dropped from its full queue, or given up as it refused them. - Go's own
go_metrics and the process'sprocess_metrics.
The requests Go's HTTP server ends before smallwebwaf sees them (see "Request
log") are not counted. The metrics of the features still to come, such as the
Core Rule Set, come with them.
Admin endpoints
While SWWAF_ADMIN_TOKEN is set, smallwebwaf answers these requests itself,
on the app's own address and through traefik like any other request, for a
request that carries the token as Authorization: Bearer <token>:
GET /_smallwebwaf/bans: every ban held, past, active and permanent.POST /_smallwebwaf/bans: bans a netblock, as adding an entry tobans.jsondoes. The body is a JSON object ofnetblock,durationand, if you like,reason.netblockis a netblock such as203.0.113.0/24, or a client's address, which bans the netblock a ban on that client covers: its IPv4 address, or the netblock around it thatSWWAF_BAN_SCOPE_V4_PREFIXsets, or its IPv6 /64.durationis a duration such as1hor7d, orpermanent. The ban starts at once, itscauseisadmin, and it is made even while another ban on the netblock lasts. A body that is not such an object, has another field, has anything but whitespace after the object, or is longer than 4 KiB is answered400, saying what is wrong, and so is an IPv4-mapped netblock, such as::ffff:203.0.113.0/120, or a value with a zone, such asfe80::1%eth0.DELETE /_smallwebwaf/bans/<client>: lifts every active ban on a netblock that<client>, an address, is in, as addingliftedto its entry inbans.jsondoes, and answers404when no ban on it is active.GET /_smallwebwaf/clients/<ip>: whatsmallwebwafknows of the client at the address<ip>: underclient, the client asclients.jsonholds it, with its counters and its history, which holds its AS number, AS name and country as last looked up and its offences, ornullwhen the table of clients does not hold it; and underbans, every ban on a netblock the address is in, with its notes.
The ban endpoints answer with the bans listed, made or lifted, under bans,
each as an entry of bans.json (see "State files" above), and a ban they make
or lift is written to bans.json SWWAF_STATE_WRITE_DELAY later. Refusals, and
the answers to requests that cannot be read, are plain text.
A request without the token, or with another, such as the metrics token, is
answered 401, in observe mode too. While the token is unset, each of these
answers 404, as does any request under /_smallwebwaf/ that is not for one of
its endpoints. Like the metrics, these requests go through every check any other
request goes through, and are answered where another would be passed to the app:
a banned client stays refused, so an admin whose own address is banned lifts
that ban by editing bans.json, and each request counts toward the client's
rate limits. A client in SWWAF_ALLOW_NETS skips the checks, and still needs
the token.
With the token in $TOKEN, for an app at https://app.example:
# Every ban.
curl -H "Authorization: Bearer $TOKEN" https://app.example/_smallwebwaf/bans
# Ban 203.0.113.0/24 for seven days.
curl -H "Authorization: Bearer $TOKEN" \
--json '{"netblock": "203.0.113.0/24", "duration": "7d", "reason": "probes for logins"}' \
https://app.example/_smallwebwaf/bans
# Lift the bans on 203.0.113.9.
curl -H "Authorization: Bearer $TOKEN" -X DELETE \
https://app.example/_smallwebwaf/bans/203.0.113.9
# What smallwebwaf knows of 203.0.113.9.
curl -H "Authorization: Bearer $TOKEN" \
https://app.example/_smallwebwaf/clients/203.0.113.9
Why
Small self-hosted sites now receive a great deal of traffic nobody asked for:
scrapers that ignore robots.txt and crawl every commit of every repository on
a public git server, vulnerability scanners walking through lists of WordPress
and .env paths, and credential-guessing bots. Most of it comes from a small
number of hosting networks and countries. A single-person operation has no abuse
desk and no CDN contract; it needs something small that can be put in front of
one service and left alone.
The existing tools each solve part of this. Rule-based firewalls catch attack
payloads but do not limit request rates. Rate limiters count requests but cannot
tell a residential visitor from a rented server farm. The products that do most
of it want several containers, a database and a web console. None of them can
say "clients from these networks are banned after half as many requests as
anyone else", which is the most useful thing to be able to say when nearly all
abuse comes from a known list of AS numbers. EVALUATION.md
goes through the candidates one by one.
smallwebwaf is meant to fill that gap:
- protect a service from misbehaving scrapers and scanners with per-client request and byte limits over a minute, an hour and a day;
- lower those limits for the countries and AS numbers that abuse commonly comes from, so their clients are banned after fewer requests than others;
- ban abusers: briefly at first, longer each time they come back, and permanently when they keep at it; a scanner's first probe bans it for seven days;
- log everything in a form that is easy to search and ship elsewhere;
- stay small enough to understand: one binary in the app's own container, environment variables, no database, no required setting.
Proposed features
- Reverse proxy for one application, streaming in both directions, with
WebSocket support. One
smallwebwafper app, inside the app's own container. - Internet-ready out of the box: no setting is required, and every setting has a
default chosen for a service facing the internet in 2026. Every setting's name
starts with
SWWAF_, so that it cannot clash with the app's own. - Real client address worked out from
X-Forwarded-For, trusting only the proxy networks you list, by default the private address ranges. IPv6 clients are counted by /64 by default. - Size and time limits on requests and responses, with the time limits both
between the client and
smallwebwafand betweensmallwebwafand the app: by default a request may take 60 seconds and 100 MiB, a response 30 minutes and 5 GiB. - Rate limits per client on requests per minute, per hour and per day, and on bytes per minute, per hour and per day, on by default and set well above what real visitors need.
- Netblocks that bypass rate limiting, netblocks that bypass everything, and netblocks that are always refused.
- AS number and country lookup for every client, on by default through the free GeoJS web service, which is sent the address of every new visitor. The IPinfo Lite database file, which you download and mount, can be used instead, or lookups switched off (see "Country and AS number lookup" below).
- Country lists:
SWWAF_DENIED_COUNTRIESrefuses every request from the countries listed,SWWAF_EXCLUSIVELY_ALLOWED_COUNTRIESevery request from anywhere else. Such a request gets the answer a banned client gets as soon as the client's address has been looked up, before its body is read and without the rule files or the Core Rule Set looking at it, and no ban is made. - Biased limits: listed AS numbers and countries get a percentage of every limit, for example 50 percent for common abuse-source networks, so their clients are banned after fewer requests. Zero percent is a zero allowance: the first request breaks the limit and bans the client.
- Attack detection:
- a directory of plain text rule files, one regex per line, for catching scanning and penetration probes; easy to edit by hand, and picked up while running;
- the OWASP Core Rule Set, run by the Coraza engine, refusing the requests it flags; it reads the URL and headers of every request, and request bodies only once you switch that on, since on a code forge they are full of code it would take for attacks;
- trap paths, and a ban for a client that the rule files or the Core Rule Set refuse again and again.
- Bans:
- a clear sign of attack, such as a probe for a
.envfile or a scanner's user agent, bans for seven days on the first request, and any further request during those days makes the ban permanent; - breaking a limit bans for an hour; breaking one again within a day of a ban ending triples the length, and a ban that would last longer than seven days is permanent instead;
- every ban carries notes on why it was made, to help decide whether to lift it.
- a clear sign of attack, such as a probe for a
- IP reputation: downloadable blocklists, DNS blocklists, AbuseIPDB, and an optional feed of decisions from a CrowdSec engine. Lookups happen in the background and never delay a request. None is on until you add it.
- Alerts on attacks and bans to a generic webhook, Slack or ntfy, with a cooldown and an hourly cap so a wide attack cannot flood the channel.
- Anomaly alerts when requests or bytes per minute or hour cross a threshold you set, for a single client, its surrounding netblock, an AS number, a named netblock or the whole service.
- Observe mode: log and alert on every decision while refusing nothing.
- Request log: one JSON object per request on stdout with the usual web log fields, the decision taken and why, AS number and country, and timings. Optionally also sent to a remote syslog server.
- Prometheus metrics, for a scraper that holds the metrics token.
- State (bans with their notes, each client's counters and history, the GeoJS
answers, the reputation cache, the alerting state) held in memory and kept in
readable JSON files, written regularly and at every stop, so a restart loses
nothing. Edit a file, or add a rule file, and the running
smallwebwafpicks up the change. Nothing is read from disk while serving a request. The files for the bans, the clients, the GeoJS answers, the copies of the lists, the verdicts of the DNSBL zones and the alerts are built, with an edit taken in while running (see "State files" above); the rest comes with its features. - Health checks, the metrics, and listing, adding and lifting bans or asking why
a given address was refused, all on the one port every request uses: under
/_smallwebwaf/on the app's own address, through traefik like any other request. The metrics need the metrics token, and the ban management the admin token.
Not planned: TLS termination, routing for several apps, browser challenges (captcha or proof of work), a web console, or defence against floods large enough to fill the host's network link.
How it works, in short
For each request smallwebwaf:
- works out who the client really is;
- lets it straight through if it is on the bypass list, refuses it if it is on the deny list or currently banned;
- looks up its AS number and country, and refuses it if that country is denied, or is not among the only ones allowed;
- checks it against the blocklists, and for a cached reputation verdict;
- picks the client's limit percentage from those;
- checks the minute, hour and day request counters against the limits, and bans the client if it breaks one;
- checks the request against the rule files and the Core Rule Set, and bans the client at once for a clear sign of attack;
- forwards it to the app and streams the response back, within the size and time limits;
- counts the bytes and any refusal by the rule files or the Core Rule Set, bans the client if it broke a limit, updates its history and the anomaly counters, sends any alerts that are due, and writes the log line.
A minimal deployment is the app's own Dockerfile, built on the smallwebwaf
image, with no setting. That image is built on Ubuntu 26.04 LTS, the newest
long-term support release of Ubuntu, pinned by digest, and moves to the next one
when it ships. It has nixpkgs installed, so the app adds the packages it needs
from nixpkgs. Beyond its FROM line the app's Dockerfile adds the app's binary,
any packages it needs, and the app's runit service, which starts the app as a
user of its own, listening on 127.0.0.1:8081:
# The smallwebwaf image, pinned by digest.
FROM <registry>/smallwebwaf:<pinned digest>
# Packages the app needs, if any, from the nixpkgs in the image.
RUN nix-env -iA nixpkgs.git
# The app's binary, and a user of its own to run it.
COPY app /usr/local/bin/app
RUN useradd --system --no-create-home --shell /usr/sbin/nologin app
# The app's runit service.
COPY --chmod=755 app.run /etc/service/app/run
with app.run beside the Dockerfile, where --listen and --trusted-proxies
stand for the app's own options:
#!/usr/bin/env bash
set -euo pipefail
main() {
sleep 1
exec chpst -u app:app /usr/local/bin/app \
--listen 127.0.0.1:8081 \
--trusted-proxies 10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,127.0.0.1/32,::1/128
}
main "$@"
- The image's entrypoint,
runsvinit, has runit startsmallwebwafand the app side by side, each as its own user, and start either again a second after it exits. Leave outENTRYPOINTandUSERfrom the app's Dockerfile. nix-env -iA nixpkgs.<name>installs a package from the nixpkgs in the image, and the app finds it on itsPATH, after Ubuntu's own commands. That nixpkgs is fixed at one commit, so the samesmallwebwafimage always gives the app the same packages; newer ones come with a newersmallwebwafimage.- Deploy it as you deploy any app, with traefik's labels on this one container pointing at port 8080. upaas needs no change for this.
- The app has to trust
127.0.0.1and::1for forwarded headers, besides the private address ranges, since the requests it gets now come fromsmallwebwafon loopback. An app left at the usual default, the private ranges alone, sees every visitor as127.0.0.1. - Port 8080 is the only one the app must leave free: the health check, the
metrics and ban management are all on it, under
/_smallwebwaf/. The image's health check passes whilesmallwebwafanswers and the app accepts connections.SWWAF_LISTEN_ADDRcan movesmallwebwafto another port, which the app then leaves free instead; the health check follows it, and traefik's labels must point at it. The address part ofSWWAF_LISTEN_ADDRstays empty (for example:9000, never127.0.0.1:9000), sosmallwebwafkeeps listening on every address: traefik reaches it on the container's address, and the health check on127.0.0.1. smallwebwafkeeps its state files in/var/lib/smallwebwaf. Mount a volume there to keep bans and client history when a deploy replaces the container; without one, it still starts. At each start therunscript ofsmallwebwafgives that directory and every file in it to thesmallwebwafuser, so a host directory mounted there needs no change of owner.docker stophas runit stop both processes.smallwebwafthen stops taking requests and gives those in progress five seconds to finish.
A rule file is one rule per line: a name, what to match against, what to do, and a regex.
env-file path ban (?i)^/\.env(\.[a-z]+)?$
scanner-agent user_agent ban (?i)\b(sqlmap|nikto|nuclei|wpscan)\b
SPEC.md has the full design: the deployment, every environment
variable, the ban rules, the rule file format, the state files, the log fields,
the metrics, failure behaviour and the build order.
Country and AS number lookup
smallwebwaf looks up the AS number and country of every client through GeoJS,
a free web service that needs no account and no file, for the request log, the
client's history, the notes of its bans, their alerts and the metrics, and for
the country lists and the anomaly thresholds per AS number when you set them.
This means that GeoJS is told the address of every new visitor, whether or not a
setting uses the answer, unless you set SWWAF_LOOKUP_SOURCE=off. The only
visitors it is not told about are those in SWWAF_ALLOW_NETS or
SWWAF_DENY_NETS, those whose netblock a ban covers, and those on a private,
loopback or link-local address. An IPv6 visitor is asked about by the first
address of its /64. Each answer is kept for seven days, in memory and in
lookups.json, so that it survives a restart, and a visitor whose answer is
kept is not asked about again.
A request waits for its client's first answer only while a setting acts on it
before the request goes on: a country list, SWWAF_ADD_LOOKUP_HEADERS, or a
biased threshold that lowers a limit. A new visitor then waits up to
SWWAF_LOOKUP_TIMEOUT, a second by default, and without an answer counts as
coming from an unknown country until the answer arrives. Otherwise no request
waits: it goes on at once and is logged without the answer, which reaches the
client's history and the notes of its bans when it comes. The addresses waiting
are asked about together, up to 200 in one request, one request at a time; at
most 10,000 visitors wait, and one more is not asked about until there is room,
counting meanwhile as coming from an unknown country. GeoJS publishes no rate
limit but may block a caller it thinks asks too much. While GeoJS fails,
visitors with a kept answer are unaffected and new ones count as coming from an
unknown country, which SWWAF_EXCLUSIVELY_ALLOWED_COUNTRIES refuses, and whose
limits SWWAF_UNKNOWN_LIMIT_PERCENT sets. GeoJS is then left alone for a
second, twice as long after each further failure up to five minutes, and asked
again by the next request from a visitor without an answer.
To keep your visitors' addresses on your own host, set
SWWAF_LOOKUP_SOURCE=off, or use the database file instead of GeoJS:
SWWAF_LOOKUP_SOURCE=file looks every client up in the free IPinfo Lite
database (ipinfo_lite.mmdb), at once, with no wait and nothing sent off the
host. A client whose address it does not hold counts as coming from an unknown
country. You download the database with your own IPinfo account, mount the
directory that holds it into the container, point SWWAF_LOOKUP_DB_PATH at the
file and refresh it when you choose; smallwebwaf never downloads it itself. It
reads the whole file into memory at start, and a file that is missing or that it
cannot read stops the start. It reads the file again once it has gone 2 seconds
without a change after you replace it, so that a file still being copied in is
read only once whole, and also 2 seconds after it starts watching, so that a
file replaced while it started is not missed. A replacement it cannot read is
logged and sent as a file_error alert, and the file read before stays in use.
It has to be the directory rather than the file itself that you mount: docker
does not show a single mounted file being replaced, so a refresh would go
unseen. IPinfo releases it under the Creative Commons Attribution-ShareAlike 4.0
International License and asks for attribution, in its own words on
https://ipinfo.io/lite: "The attribution requirements can be met by giving our
service credit as your data source. Simply place a link to IPinfo on the
website, application, or social media account that uses our data." Its example
of such a credit is a link mentioning "IP address data is powered by IPinfo". A
service that uses the database through smallwebwaf should carry that link.
Neither source can place a private address, so a client on one, such as a
visitor on your local network, another container or your monitoring, has no
country: SWWAF_EXCLUSIVELY_ALLOWED_COUNTRIES refuses it unless you list it in
SWWAF_ALLOW_NETS, SWWAF_DENIED_COUNTRIES does not refuse it, and
SWWAF_UNKNOWN_LIMIT_PERCENT sets its limits. Such addresses are never sent to
GeoJS.
Blocklists
SWWAF_BLOCKLIST_URLS names blocklists: text files of addresses and netblocks,
one to a line, written as the Spamhaus DROP list,
https://www.spamhaus.org/drop/drop.txt, is. Anything after a ; or a # on a
line is left out, and so is a line left blank. A bare address stands for itself
alone, as in the settings. An IPv4-mapped address or netblock, such as
::ffff:192.0.2.0/120, is read as the IPv4 one it stands for, here
192.0.2.0/24, since a client's IPv4 address is checked as IPv4; a mapped
netblock shorter than /96 stands for none, and is not a netblock. None is
named by default: a list judges a client by what others saw it do, while the
defaults judge it by what it does to your service.
smallwebwaf fetches each list, and the file SWWAF_ASN_LIMIT_PERCENT_URL
names, SWWAF_BLOCKLIST_REFRESH after it last fetched it or tried to, 24 hours
by default and never less than one, one list after another. Since
reputation.json keeps when each list was last tried, the fetch failed or not,
even one cut off as smallwebwaf stopped, whose request the server may have
had, at start smallwebwaf fetches at once only a list it has never tried, and
one it last tried that long ago; any other waits its turn, so that restarts do
not fetch a list more often. A fetch fails when the server answers other than
200, when it does not finish within a minute, when the list is longer than 16
MiB, or when a line of it is not an address or a netblock, or for
SWWAF_ASN_LIMIT_PERCENT_URL, not an AS number, : and a percentage. The copy
fetched before then stays in use, and the failure is counted, logged and raised
as a source_failure alert; a fetch cut off as smallwebwaf stops is not a
failure. The last good copy of each list is kept whole, comment lines included,
in reputation.json (see "State files" above), so that a restart keeps it in
use too. Each list is named by its URL, in the request log, the alerts and the
metrics, so keep a secret out of it.
A client in SWWAF_ALLOW_NETS is not checked. Any other is checked by its own
address after the country lists, and SWWAF_BLOCKLIST_ACTION says what is done
with one a list lists, as "What it does so far" above describes. deny suits
lists of networks that send nothing legitimate, such as DROP; limit:<percent>
suits lists of addresses shared with ordinary visitors, such as those of Tor's
exits.
The Spamhaus DROP list is The Spamhaus Project's, https://www.spamhaus.org. Its
terms, on its DROP page, ask that a product using it credit The Spamhaus Project
and keep the list's date and copyright lines with the data, which the copy in
reputation.json does; a service that uses DROP through smallwebwaf uses data
from The Spamhaus Project, and should say so. They also ask that it be fetched
automatically no more than once an hour, once a day being more than enough in
most cases, and Spamhaus may block an address that fetches it more often. Each
smallwebwaf fetches its own copy, on its own schedule, so on a host where
several apps run it, sharing one address, their fetches can come less than an
hour apart whatever SWWAF_BLOCKLIST_REFRESH is: each fetches a list again that
long after its own last try, so those first started within the same hour, with
the same refresh, keep fetching within the same hour.
DNS blocklists
SWWAF_DNSBL_ZONES names DNS blocklists, DNSBL zones, which list an address by
answering a query for a name made from it. None is named by default, for the
reason none of the blocklists is. smallwebwaf asks each zone about a client's
own address in the background, the first time it sees the client: the request
goes on at once, as from a client the zone does not list, and so does every
request from it until the zone has answered. The name asked about is the one RFC
5782 gives: the four numbers of an IPv4 address in reverse order, so that
192.0.2.99 is asked about in dnsbl.dronebl.org as
99.2.0.192.dnsbl.dronebl.org, or the 32 hex digits of an IPv6 address in
reverse order, each followed by a dot. An IPv6 client is asked about by its own
address, not by its /64.
A zone that answers that the name does not exist, or has no address, does not
list the client, and one that answers with an address in 127.0.0.0/8 lists it.
Any other answer gives no verdict, and is a failure: an address in
127.255.255.0/24, with which Spamhaus refuses a query, such as one sent
through a public resolver or one past its limit; an address outside
127.0.0.0/8, such as a resolver gives that answers even for names that do not
exist; an error the resolver answers with, such as a refusal; and no answer
within SWWAF_REPUTATION_TIMEOUT. A failure is counted, logged and raised as a
source_failure alert, held back as a repeat within SWWAF_ALERT_COOLDOWN, and
the zone is not asked again for a minute, so that a zone that refuses queries is
not asked on every request.
Each verdict, the zone listing the client or not, is kept, in memory and in
reputation.json (see "State files" above), so that a restart keeps it, and is
used for SWWAF_REPUTATION_CACHE_TTL after the zone gave it, 24 hours by
default. The client's first request after that has the zone asked again, and
until it answers, no verdict of the zone applies to the client. At most 100,000
verdicts are kept, the one fetched longest ago dropped first, and at most 1,000
queries are under way at once; past that, a zone is asked about a client at the
client's next request.
A client in SWWAF_ALLOW_NETS is not checked, nor is one a blocklist refuses.
SWWAF_REPUTATION_ACTION says what is done with one a zone's verdict lists, as
"What it does so far" above describes.
Do not name a zone meant for mail, such as one of residential and dynamic
address ranges, which ordinary visitors come from, or one that includes such a
list, as Spamhaus's zen does: it would refuse them, or lower their limits.
Spamhaus's zones answer through its keyed query service, named with the key in
it, such as <key>.xbl.dq.spamhaus.net. The key of a zone under
dq.spamhaus.net is its first label, and smallwebwaf shows ******** in its
place wherever it names the zone, as ********.xbl.dq.spamhaus.net: in the
settings logged at start, an error that stops the start, its own messages, the
request log, the alerts and the metrics. Only reputation.json keeps the zone
with its key. A key in the name of any other zone is shown as given. Several
zones refuse queries that come through a public resolver; SWWAF_DNSBL_RESOLVER
names another resolver to ask through.
How the code is laid out
cmd/smallwebwaf: the binary, which only callsinternal/smallwebwaf.internal/smallwebwaf: the process: it reads the settings, the rule files, the lookup database and the state files, listens, serves requests untilSIGTERMorSIGINT, and stops, writing the state files. Run assmallwebwaf healthcheck, it is the image's health check instead.internal/config: reads the settings, the one place they are read.internal/proxy: what happens to each request: it works out the client, runs the checks, passes the request to the app and the answer back with the standard library'shttputil.ReverseProxywithin the timeouts and size limits, and writes the request's log line. Itscheckmethod is where a request is refused before anything reaches the app: forSWWAF_DENY_NETS, for a ban, for the country lists, for a blocklist, for a DNSBL zone's verdict, for a rate limit, which bans the client, for ablockorbanrule, the latter banning the client, and for an announced body over the size limit; inobservemode, only for the size limit, with what it would have refused for noted in the log line. A request under/_smallwebwaf/thatchecklets through is answered byanswerAdmininstead of reaching the app. Once the answer to a request passed to the app has ended,countBytescounts its bytes for the byte limits, and once any request but the health check has ended,countAnomaliescounts it for the anomaly thresholds.internal/metrics: the metrics, counted as the other parts tell it what happened, and served in the Prometheus text format.internal/bans: the ban ledger: each netblock's bans with their notes, how long a new ban lasts, when a ban for a clear sign of attack becomes permanent, and which bansmallwebwafmade is dropped whenSWWAF_MAX_BANSare held.internal/rules: reads the rule files at start and again as they change, and tells which of their rules a request matches.internal/lookup: looks up each client's AS number and country through GeoJS, keeps the answers, and hands each new one to the proxy, which adds it to the client's history and to the notes of its bans; or in the lookup database, which it reads again when the file is replaced.internal/lookup/lookuptestwrites lookup databases for the tests.internal/reputation: fetches the blocklists and the fileSWWAF_ASN_LIMIT_PERCENT_URLnames as they are due, keeps the last good copy of each, and tells which blocklists list an address and what percentage the file gives an AS number; and asks the DNSBL zones about clients in the background, through the standard library's resolver, keeps their verdicts, and tells which zones' verdicts list an address.internal/ratelimit: the table of clients: counts each client's requests and bytes, tells when they take it over a rate limit or a byte limit, and keeps each client's history.internal/anomaly: the anomaly counters: counts each request and its bytes per client, per netblock around a client, per AS number, for the whole service and per named netblock, in the bucketsinternal/ratelimitcounts in, and raises ananomalyalert for a count over its threshold.internal/state: reads the state files at start, takes in an admin's edit of one while running, and writes them when they are due and at the stop.internal/requestlog: the lines on stdout: the request log line and the process's own messages.internal/remotelog: sends the lines on stdout toSWWAF_LOG_REMOTE_URL, each as a syslog record, from a buffer of its own. It is written with the standard library alone, whoselog/syslogwrites only the older syslog format.internal/alerts: takes the alerts the other parts raise, holds back repeats and those past the hourly limit, and sends the others to the webhook, Slack and ntfy, each from a queue of its own.Dockerfile: the lint and test phases, the stagesscript/tidybuilds, then the image, whose last stage installs Ubuntu's packages, nixpkgs,runsvinitandsmallwebwaf, withshare/smallwebwaf.runas runit'srunscript forsmallwebwafandshare/rules.d/00-default.rulesas its default rule file.deploy/example-app: an app built on the image, whichscript/example-appchecks.
Besides the Go standard library, github.com/hashicorp/golang-lru/v2 keeps the
table of clients to 20,000 and the GeoJS answers to 100,000, dropping the least
recently seen, the DNSBL zones' verdicts to 100,000, dropping the one fetched
longest ago, the anomaly counters to 20,000, dropping the one counted least
recently, and the banned netblocks in the order they were last seen, from which
the ledger picks the ban to drop past SWWAF_MAX_BANS, and
github.com/prometheus/client_golang keeps the metrics and serves them, and
github.com/fsnotify/fsnotify tells smallwebwaf when a state file or a rule
file is saved, or the lookup database replaced, and
github.com/oschwald/maxminddb-golang/v2 reads the lookup database, which the
tests write with github.com/maxmind/mmdbwriter. The country codes are the list
in internal/config/config.go.
Entrypoints
This repository adheres to the
Scripts to Rule Them All
standard: the scripts in script/ are the entrypoints for working on it, and
the Makefile targets are thin shims that call them. The scripts are POSIX sh,
so that they run in minimal containers.
script/bootstrap: installs what the other scripts need on the host:make,git,curl, Go forgofmt, node and yarn, and prettier.script/setup: readies a fresh clone: runsscript/bootstrap, thenscript/install-precommit.script/projectname: prints the project's name,smallwebwaf, whichscript/dockerand the others tag their images with.script/test: checks thatgo.modandgo.sumare asgo mod tidywrites them, then runs the tests, as thetestphase of theDockerfile.script/tidy: writesgo.modandgo.sumasgo mod tidywrites them, with the Go of thetestphase, in thetidystage of theDockerfile;make tidyruns it.script/lint: runs golangci-lint, as thelintphase of theDockerfile.script/fmt: formats the Go code withgofmtand the Markdown with prettier.script/fmt-check: checks the formatting, and changes nothing.script/check: runsscript/test,script/lintandscript/fmt-check.script/docker: builds the image, whose build runs the tests and the linter first.script/cibuild: what CI runs:script/bootstrap,script/check, then the image build.script/precommit: run by the git pre-commit hook; runsscript/check.script/install-precommit: installs that hook;make hooksruns it.script/build: buildsbin/smallwebwafon the host, with Go installed, for working on the code by hand;make buildruns it.script/run: buildsbin/smallwebwafwithscript/buildand runs it, with its state files inbin/stateunlessSWWAF_STATE_DIRis set, and the rule files ofshare/rules.dunlessSWWAF_RULES_DIRis set;make runruns it.script/example-app: builds the image and, on it, the example app indeploy/example-app, runs it with a volume for the state files, and checks that the health check passes, that a request reaches the app throughsmallwebwaf, that a second request in a minute bans the client, that a probe for/.envbans another client, whose next request makes the ban permanent, thatsv stopanddocker stopstop it in order, and that a new container on the same volume still refuses the banned client; then removes the containers, the volume and both images. It needs network access, for nixpkgs' binary cache, andscript/checkdoes not run it;make example-appdoes.
TODO
- The rest of the design, in the order of the build order in
SPEC.md.
Documents
SPEC.md: the design.EVALUATION.md: what already exists, what each tool covers and misses, and why none was adopted.REPO_POLICIES.md: the policies this repository follows.
License
MIT. See LICENSE.