diff options
author | Rasmus Dahlberg <rasmus@rgdd.se> | 2023-03-26 18:31:10 +0200 |
---|---|---|
committer | Rasmus Dahlberg <rasmus@rgdd.se> | 2023-03-26 18:31:10 +0200 |
commit | f14b185dfe1fed4fdc951b91f3338359538c4832 (patch) | |
tree | 07af788813c2a18ea07a477583fd23e9a8a63ffc /README.md | |
parent | ba6dd77c216149d663ea095ba4e5d77fcf78501e (diff) |
Add option to specify [START,END) lines
Diffstat (limited to 'README.md')
-rw-r--r-- | README.md | 2 |
1 files changed, 2 insertions, 0 deletions
@@ -135,6 +135,8 @@ More debug notes: - My system is not fully utilized wrt. CPU/MEM/BW; an odd thing is that it seems to work fine to run multiple onion-grab instances as separate commands, e.g., 3x `-w 280` to get up to ~225 Mbps utilization (max). + Added options `-s START` and `-e END` to specify that only lines `[START, + END)` should be processed in the input file to make this less clunky. - Tinkering with with options in http.Transport doesn't seem help. - Using multiple http.Client doesn't help (e.g., one per worker) - An odd thing is that after errors, it appears that only DNS is dead. E.g., |