222 Commits

Author SHA1 Message Date
Mike Dilger
32699d9b2a Use tc_index and ac_index 2024-03-05 10:57:19 +13:00
Mike Dilger
6d9868d745 Change definition of scraper in documentation 2024-03-05 10:57:19 +13:00
Mike Dilger
5a7f9fee7a Log index counts and sizes 2024-03-05 10:57:16 +13:00
Mike Dilger
6ef2ebc871 Add tc_index and ac_index (not utilized yet) 2024-03-05 10:00:40 +13:00
Mike Dilger
e19174f124 Fix loop continue/break (affects performance only) 2024-03-05 10:00:40 +13:00
Mike Dilger
37d97b5abc consistent renaming, remove a slightly wrong comment 2024-03-05 08:44:54 +13:00
Mike Dilger
437782e770 Two new config variables for allowing short scrapes 2024-03-05 08:27:42 +13:00
Mike Dilger
3ee285b7b7 store: Rename indexes; Improve scraping (use since and until on ci_index) 2024-03-05 08:13:57 +13:00
Mike Dilger
fda607a6a6 Version 1.1.1 v1.1.1 2024-03-02 13:12:26 +13:00
Mike Dilger
42be3c6243 sample.config.toml change 2024-03-02 13:10:47 +13:00
Mike Dilger
014a0ff7fe cargo clippy 2024-03-02 13:10:41 +13:00
Mike Dilger
c86ab862ef Fix issues around limit in multiple-group scans 2024-03-02 13:10:36 +13:00
Mike Dilger
4d9bd321ac FIX: was opening iterators on the wrong databases! 2024-03-02 13:04:53 +13:00
Mike Dilger
acbe1132c7 impl Copy for Event (it is a slice, just a ptr and len) 2024-03-02 11:40:50 +13:00
Mike Dilger
8828074e7c impl Ord for Event 2024-03-02 11:04:45 +13:00
Mike Dilger
3a6f89649e Fix LIMIT bug 2024-02-29 17:50:28 +13:00
Michael Dilger
f7276d6ce8
Merge pull request #12 from pjv/pjv-patch-1
Update DEPLOYING.md
2024-02-24 08:22:36 +13:00
pjv
02d1fbd5d3
Update DEPLOYING.md
Add steps to update chorus.

Not sure if I missed anything here, but this is what I just did and it seemed to work ok.
2024-02-23 10:37:17 -06:00
Mike Dilger
c4720b6407 Allow scraper-like filters up to limit=100 or time ranges of 1 hour or less (not yet efficient) 2024-02-23 08:55:21 +13:00
Mike Dilger
814d95899b Don't penalize I/O errors 2024-02-22 12:05:38 +13:00
Mike Dilger
974beabcee Be a bit less harsh about errors 2024-02-22 11:59:04 +13:00
Mike Dilger
59643c1b06 IpData rework (persists a restart) 2024-02-22 11:54:16 +13:00
Mike Dilger
72a406cea7 depend on speedy 2024-02-22 11:17:07 +13:00
Mike Dilger
1e2187b86c Protected Event: NIP-70 support 2024-02-21 18:51:13 +13:00
Mike Dilger
7eea4dca7d Use mmap-append 0.2 (just released) 2024-02-21 14:53:12 +13:00
Mike Dilger
5ab2098244 Log level filter work 2024-02-21 14:31:26 +13:00
Mike Dilger
343e352f44 Trim dependencies 2024-02-21 13:19:14 +13:00
Mike Dilger
ec315d9841 Version 1.1.0
Breaking change in config format which is now TOML
v1.1.0
2024-02-21 12:49:39 +13:00
Mike Dilger
be259c9f93 Update DEPLOYING to install the dump tool 2024-02-21 12:46:45 +13:00
Mike Dilger
4ebe2545ac Version 1.0.7 v1.0.7 2024-02-21 12:38:40 +13:00
Mike Dilger
c098195a1c [BREAKING] Switch to TOML config format 2024-02-21 12:35:02 +13:00
Mike Dilger
a26e69248c dump binary, dumps all events as JSON, one per line 2024-02-21 12:23:12 +13:00
Mike Dilger
d7f8ed3f60 Split into bin and lib, so we can have extra binaries that use the lib 2024-02-21 12:10:10 +13:00
Mike Dilger
1674b2f646 docs: uninstall 2024-02-21 11:56:07 +13:00
Mike Dilger
7f45c3e339 doc: Note about deploying on linux 2024-02-21 11:52:35 +13:00
Mike Dilger
9d90f9fc57 Revert "For the moment, log REQ subids, to help us determine if we have problems"
This reverts commit 622d63564591c192af122f13da243225c2219934.
2024-02-21 11:42:27 +13:00
Mike Dilger
622d635645 For the moment, log REQ subids, to help us determine if we have problems 2024-02-21 11:19:06 +13:00
Mike Dilger
3321652481 Rank errors, require punishment of 1.0 before closing connection 2024-02-21 11:08:49 +13:00
Mike Dilger
798079a3f2 Restructure to propogate errors up further for counting and logging, while not over-replying 2024-02-21 10:55:36 +13:00
Mike Dilger
4d875aa87f Logs: more precise time; remove target (module path) 2024-02-21 10:09:57 +13:00
Mike Dilger
50995a7590 Version 1.0.6 v1.0.6 2024-02-21 09:58:08 +13:00
Mike Dilger
5767acd347 better logging 2024-02-21 09:54:43 +13:00
Mike Dilger
95614fad55 Bring back logging of the errors that cause CLOSED 2024-02-21 09:48:19 +13:00
Mike Dilger
9b2d6365f0 Respond to REQ errors properly with CLOSED 2024-02-21 09:30:10 +13:00
Mike Dilger
3abe43a771 impl Default for IpData 2024-02-21 09:05:09 +13:00
Mike Dilger
f98e9a0832 Behind a proxy, set X-Real-Ip and use that in the log files 2024-02-21 09:04:22 +13:00
Mike Dilger
a09aa5a002 Config settings for serve_ephemeral and serve_relay_lists 2024-02-21 08:40:44 +13:00
Mike Dilger
86c74f9e40 Workaround for apparent Entry problems in DashMap 2024-02-20 22:32:25 +13:00
Mike Dilger
3ef2c4ae71 Display ban seconds in log 2024-02-20 22:08:17 +13:00
Mike Dilger
be494421b6 Improve banning 2024-02-20 21:54:51 +13:00