233 Commits

Author SHA1 Message Date
Mike Dilger
a701e148dc Version 1.2.0 v1.2.0 2024-03-22 06:51:22 +13:00
Mike Dilger
c8b365f264 rename dump to chorus_dump 2024-03-22 06:50:13 +13:00
Mike Dilger
585dda0cb8 Do not log IP addresses -- hash IP addresses with SHA256:
We need to match repeat requests as being from the same IP address so we can keep
IP address reputations. If someone has a suspect IP address, they can hash it and
then find it in our logs, so this is not perfect protection. But if they are
trying to get IP addresses they won't find any.
2024-03-17 14:13:04 +13:00
Mike Dilger
b80f14d56b Use parking lot RwLock, move away from async RwLock, honor config changes to allow_scraping 2024-03-16 14:44:42 +13:00
Mike Dilger
6a65c116ca Fix recent bug 2024-03-16 13:28:30 +13:00
Mike Dilger
e0d0a63066 Update systemd config files with ExecRestart 2024-03-16 13:12:09 +13:00
Mike Dilger
54bb5450f6 Reload config on HUP signal; change and synchronize default config 2024-03-16 12:57:53 +13:00
Mike Dilger
a701da6dda update BEHAVIOR.md 2024-03-12 11:24:19 +13:00
Mike Dilger
f6c8d214a4 config.open_relay optionally run as an open public relay 2024-03-12 10:52:44 +13:00
Mike Dilger
dc4811c0ef Missing config file options now take the default 2024-03-12 10:06:47 +13:00
Mike Dilger
d88b3cae06 fix contrib/chorus.toml 2024-03-05 11:07:30 +13:00
Mike Dilger
32699d9b2a Use tc_index and ac_index 2024-03-05 10:57:19 +13:00
Mike Dilger
6d9868d745 Change definition of scraper in documentation 2024-03-05 10:57:19 +13:00
Mike Dilger
5a7f9fee7a Log index counts and sizes 2024-03-05 10:57:16 +13:00
Mike Dilger
6ef2ebc871 Add tc_index and ac_index (not utilized yet) 2024-03-05 10:00:40 +13:00
Mike Dilger
e19174f124 Fix loop continue/break (affects performance only) 2024-03-05 10:00:40 +13:00
Mike Dilger
37d97b5abc consistent renaming, remove a slightly wrong comment 2024-03-05 08:44:54 +13:00
Mike Dilger
437782e770 Two new config variables for allowing short scrapes 2024-03-05 08:27:42 +13:00
Mike Dilger
3ee285b7b7 store: Rename indexes; Improve scraping (use since and until on ci_index) 2024-03-05 08:13:57 +13:00
Mike Dilger
fda607a6a6 Version 1.1.1 v1.1.1 2024-03-02 13:12:26 +13:00
Mike Dilger
42be3c6243 sample.config.toml change 2024-03-02 13:10:47 +13:00
Mike Dilger
014a0ff7fe cargo clippy 2024-03-02 13:10:41 +13:00
Mike Dilger
c86ab862ef Fix issues around limit in multiple-group scans 2024-03-02 13:10:36 +13:00
Mike Dilger
4d9bd321ac FIX: was opening iterators on the wrong databases! 2024-03-02 13:04:53 +13:00
Mike Dilger
acbe1132c7 impl Copy for Event (it is a slice, just a ptr and len) 2024-03-02 11:40:50 +13:00
Mike Dilger
8828074e7c impl Ord for Event 2024-03-02 11:04:45 +13:00
Mike Dilger
3a6f89649e Fix LIMIT bug 2024-02-29 17:50:28 +13:00
Michael Dilger
f7276d6ce8
Merge pull request #12 from pjv/pjv-patch-1
Update DEPLOYING.md
2024-02-24 08:22:36 +13:00
pjv
02d1fbd5d3
Update DEPLOYING.md
Add steps to update chorus.

Not sure if I missed anything here, but this is what I just did and it seemed to work ok.
2024-02-23 10:37:17 -06:00
Mike Dilger
c4720b6407 Allow scraper-like filters up to limit=100 or time ranges of 1 hour or less (not yet efficient) 2024-02-23 08:55:21 +13:00
Mike Dilger
814d95899b Don't penalize I/O errors 2024-02-22 12:05:38 +13:00
Mike Dilger
974beabcee Be a bit less harsh about errors 2024-02-22 11:59:04 +13:00
Mike Dilger
59643c1b06 IpData rework (persists a restart) 2024-02-22 11:54:16 +13:00
Mike Dilger
72a406cea7 depend on speedy 2024-02-22 11:17:07 +13:00
Mike Dilger
1e2187b86c Protected Event: NIP-70 support 2024-02-21 18:51:13 +13:00
Mike Dilger
7eea4dca7d Use mmap-append 0.2 (just released) 2024-02-21 14:53:12 +13:00
Mike Dilger
5ab2098244 Log level filter work 2024-02-21 14:31:26 +13:00
Mike Dilger
343e352f44 Trim dependencies 2024-02-21 13:19:14 +13:00
Mike Dilger
ec315d9841 Version 1.1.0
Breaking change in config format which is now TOML
v1.1.0
2024-02-21 12:49:39 +13:00
Mike Dilger
be259c9f93 Update DEPLOYING to install the dump tool 2024-02-21 12:46:45 +13:00
Mike Dilger
4ebe2545ac Version 1.0.7 v1.0.7 2024-02-21 12:38:40 +13:00
Mike Dilger
c098195a1c [BREAKING] Switch to TOML config format 2024-02-21 12:35:02 +13:00
Mike Dilger
a26e69248c dump binary, dumps all events as JSON, one per line 2024-02-21 12:23:12 +13:00
Mike Dilger
d7f8ed3f60 Split into bin and lib, so we can have extra binaries that use the lib 2024-02-21 12:10:10 +13:00
Mike Dilger
1674b2f646 docs: uninstall 2024-02-21 11:56:07 +13:00
Mike Dilger
7f45c3e339 doc: Note about deploying on linux 2024-02-21 11:52:35 +13:00
Mike Dilger
9d90f9fc57 Revert "For the moment, log REQ subids, to help us determine if we have problems"
This reverts commit 622d63564591c192af122f13da243225c2219934.
2024-02-21 11:42:27 +13:00
Mike Dilger
622d635645 For the moment, log REQ subids, to help us determine if we have problems 2024-02-21 11:19:06 +13:00
Mike Dilger
3321652481 Rank errors, require punishment of 1.0 before closing connection 2024-02-21 11:08:49 +13:00
Mike Dilger
798079a3f2 Restructure to propogate errors up further for counting and logging, while not over-replying 2024-02-21 10:55:36 +13:00