3b938a909f
add hardened-extended preset
2021-04-02 10:59:09 +00:00
3cce822c64
run-tests: add 'vm' command
2021-03-26 23:23:22 +01:00
6ba5880b2c
test.py: improve composability of test 'banlist-and-restart'
...
The test now works if not all services previously used in the
`systemctl restart` command are available.
2021-03-22 14:39:31 +01:00
44439e2a81
tests: optimize building multiple tests at once
...
The result of `import tests.nix {}` is now an attrset of tests.
This makes it easier and more efficient to evaluate or build multiple
tests in one call to `nix build`.
Simplify tests.nix by removing the large module args scope in favor of
self-contained scenario module definitions.
Add CPU core and memory size defaults to the test configuration to
enable building tests without `run-tests.sh`.
Add the following top-level args to tests.nix:
- `extraScenarios` to provide a nix-level way to define extra scenarios.
- `pkgs` to allow building tests with custom pkgs or systems.
2021-03-22 14:35:29 +01:00
9ca52af523
tests: improve make-test-vm.nix
...
1. fixedTest: Remove some unneeded layers of function calls.
2. Don't add a modified version of `black` to the global pkgs set.
Tests should not affect the pkgs of the tested system modules.
Fix the driver build script instead by adding an extra arg to the
call to `black`.
2021-03-22 14:35:29 +01:00
e8b47f099c
examples: add deploy-krops.sh
2021-03-15 19:02:58 +01:00
03db1a61b1
lnd, joinmarket: don't write to secrets dir
...
Keeping the secrets dir read-only is more simple and robust.
- lnd seed mnemonic creation and joinmarket wallet creation can be
run as the regular service user instead of root.
- It is easier to switch to a third-party secrets deployment
method in the future.
Don't create a seed mnemonic for lnd when a wallet exists.
This avoids creating unused mnemonics and helps simplifying
the migration command in `versioning.nix`.
2021-03-15 18:50:15 +01:00
b701cb5603
secrets: add option 'generateSecrets'
...
Move this feature from a module preset to a regular option, so that it's
easily discoverable and accessible.
Simplify the implementation of `generateSecrets` by adding it to the
existing `setup-secrets` service script.
Also rename option setup-secrets -> setupSecrets.
2021-03-15 12:42:52 +00:00
eb21012745
pool: add pkg, module & tests
2021-03-01 10:59:35 +01:00
19e401b028
bitcoind: enable cookie-based authentication
2021-02-18 10:40:09 +00:00
eddc48ee62
Merge #322 : run-tests: Fix interrupt handling for --copy-src
...
8e3feece678e3feece67
2021-02-14 19:48:09 +00:00
42f7e9f874
joinmarket: 0.8.0-a5e8879 -> 0.8.1
...
- Update joinmarket package
- Revert unofficial release settings
- Move Yield Generator config to configFile
- Add new config option max_sweep_fee_change
2021-02-14 16:23:53 +00:00
8e3feece67
run-tests: fix interrupt handling for --copy-src
...
Previously, `run-tests.sh --copy-src ...` exited with status 0 (success) when interrupted (SIGINT).
It now exits with an error status.
2021-02-12 21:39:46 +01:00
ce2b445777
treewide: use runuser for dropping privileges
...
When running as root, use runuser instead of sudo.
As opposed to sudo or doas, runuser is a standalone
binary that needs no external configuration.
Also, it's a bit faster.
2021-02-09 12:44:01 +00:00
f9683889d9
Merge #312 : Refactorings, cleanups
...
0a2c8e4864803584a288c29d44b49a6a328124126982699613a43534dda018f2002cf09d0b8c8f6fe9c98f415cd9c87b6a8f74583501089cf038939c7a97304f13a942177ecf4f6ff408efe6a6c721c1e774c045de0b5b29a2a3a587a2b02abb3a69797e13fc9dfabfaf2040f4c4c246bbb36e7533f12ef141fe9b0c1df0850d3f23d1c0ea9f850a2c8e4864
2021-02-08 20:32:03 +00:00
0a2c8e4864
run-tests: add option --copy-src
2021-02-08 12:20:20 +01:00
2ebd1129a5
Merge #317 : Pkg updates
...
a0f48c9de9a2f265cd35d41a843167c22adb03afa0f48c9de9a0f48c9de9
2021-02-07 21:44:10 +00:00
7533f12ef1
bitcoind, clightning, run-tests: minor refactoring
...
bitcoind: use builtins.toFile
clightning: use boolToString
run-tests: remove leftover var
2021-02-07 22:39:05 +01:00
c22adb03af
extra-container: 0.5 -> 0.6
2021-02-06 11:43:36 +01:00
ebd478fd0d
lnd: add option 'restOnionService'
2021-02-05 09:17:14 +01:00
8f9ea61d6e
update nixpkgs-unstable
...
- bitcoind 0.20.1 -> 0.21.0
Manually create a wallet in the backup test because bitcoind
does not create a default wallet anymore
- disable the failing elementsd build on unstable
2021-01-31 22:26:30 +01:00
44546561fc
run-tests: allow defining scenarios via cmdline args
...
This simplifies running self-contained scenarios for testing and debugging.
2021-01-30 11:38:47 +01:00
fc40776689
improve backup test
...
Only check enabled services. This allows running the backup test with a custom subset of other
tests.
Also, show a meaningful error on test failure.
Previously, just an AssertionError without a message was shown.
Because the test code is evaluated from a string and not a file, there
was also no backtrace to the tests file.
2021-01-30 11:38:47 +01:00
8c125ec48c
joinmarket-obwatcher: add pkg & module
2021-01-17 17:40:12 +00:00
323a431aba
improve nodeinfo
...
- enable usage outside of secure-node.nix
- use json as the output format
- show ports
- also show local addresses, which is particularly useful when
netns-isolation is enabled
- only show enabled services
2021-01-14 13:25:10 +01:00
f6b883a9ac
remove webindex
...
This module is outdated and incomplete. We can readd an improved version in
the future.
Move nanopos nginx proxy tests to the nanopos test.
2021-01-14 13:25:10 +01:00
5c6977b006
rename onion-chef -> nix-bitcoin.onionAddresses
...
This clarifies its function.
2021-01-14 13:25:05 +01:00
b41a720c28
lnd: add consistent address options
...
Also fix btcpayserver by connecting to the lnd restAddress instead of the p2p address.
2021-01-14 13:25:03 +01:00
79f4723cda
lightning-charge: remove package and module
2021-01-01 19:16:46 +00:00
58de79d401
nanopos: remove package and module
2021-01-01 17:37:30 +00:00
bcedf69549
readme: update and split into various parts
2020-12-30 15:59:22 +00:00
196e3c9dbb
clboss: add test todo
2020-12-22 09:54:11 +00:00
2bfb4efbd8
make-container: fix usage comment
2020-12-19 13:18:50 +01:00
3403795c86
tests: add example scripts
2020-12-18 19:56:56 +01:00
ff94985b8b
tests: add test 'hardened'
2020-12-18 19:56:56 +01:00
a5a2fc7274
make-container: fix renamed variable
...
The variable was only renamed in run-tests.sh, which broke containers.
2020-12-16 01:29:12 +01:00
9977fa69af
ci: use run-tests.sh
2020-12-11 13:27:06 +01:00
a82f0f5f48
add test 'pkgsUnstable'
...
Included in 'basic' tests.
Function 'doBuild' is needed by the following commit.
2020-12-11 13:27:05 +01:00
95bc1237e2
run-tests: rename testDir -> scriptDir
2020-12-11 13:27:05 +01:00
a70c3bf210
make-test-vm: remove unneeded leftover arg attrs
2020-12-11 13:27:05 +01:00
ed65e78a2b
make-test: expose test config
...
This is useful for programmatically exploring a test config or for building a test system
on a custom platform.
2020-12-11 13:27:04 +01:00
7265742655
run-tests: add 'instantiate' command
...
Useful for diffing test derivations.
2020-12-11 13:27:04 +01:00
8cbdef8bf6
run-tests: fix CLI
...
Restore the original behavior that was accidentally changed:
When no args are given, run the basic test suite.
Otherwise, run the given command with default scenario 'default'.
Previously, `run-tests.sh build` ran the basic test suite instead of
building the default scenario.
2020-12-11 13:27:04 +01:00
1c0233c0a8
use Cirrus CI
...
- Make more economic use of the free CI resources by removing redundant build tasks:
- Build unstable pkgs in a single separate task ("pkgs_unstable").
- All stable pkgs are implicitly built by the modules tests.
- The build script (ci/build.sh) can now be executed locally for easier
debugging.
- Use an explicit 'cachix push' command instead of helper/wait-for-network-idle.rb.
This is simpler and more reliable.
2020-12-06 19:07:54 +01:00
1d44b99340
add curated clightning plugins
2020-11-18 20:21:34 -06:00
4640821f96
make-test.nix: use writeText
...
Needed for the following commit which adds derivation outputs to `dataFile`.
2020-11-18 20:21:34 -06:00
7e3d2965a5
testing framework: re-add features removed in nixpkgs 20.09
...
Since nixpks 20.09, the test output is just an empty directory.
Restore saving the log output and linking to the driver.
Without linking to the driver, the driver is eligible for
garbage collection after running a test via `run-tests.sh --out-link-prefix`,
which implies lengthy driver rebuilds.
2020-11-11 22:27:46 +01:00
f2faf708fb
test: update joinmarket query strings
...
JoinMarket changed message strings in
a2aafd254d
2020-11-06 08:51:27 +00:00
4ff88efc50
netns: add address binding test
...
Proposed by Jonas Nick.
2020-10-29 21:21:30 +01:00
9ddf7864a4
lightning-loop regtest: fix incorrectly succeeding test
...
When 'loop getparams' fails, jq gets no stdin and exits with code 0.
Because -o pipefail is not enabled in the testing shell, the whole test
command succeeds, although it should fail.
Just test "loop getparams" instead and ignore its output.
2020-10-29 21:21:29 +01:00
58d24e735d
netns-bitcoind: allow RPC access from main netns
2020-10-29 21:21:27 +01:00
0e2ff948d3
test: add scenario 'netnsRegtest'
...
The 'basic' test command now cover regtest mode and using nix-bitcoin without
the secure-node preset.
2020-10-29 21:21:27 +01:00
9a931483b9
netns test: remove strict dependency on clightning, electrs
...
This allows the netns test to be run with a reduced service set for debugging.
2020-10-29 21:21:26 +01:00
bae1b7f413
netns test: improve ping test
...
- Use fping for pinging multiple hosts in parallel.
Significantly improves test runtime:
>13 s -> ~200 ms for the negative ping tests.
- Only test network namespaces that are enabled.
This allows running the netns test with a reduced service set for debugging.
- Remove deprecated services, instead add btcpayserver, spark-wallet
2020-10-29 21:21:26 +01:00
e61d7b1d46
test: improve lightning-loop regtest
2020-10-19 08:59:26 +00:00
9951f10e74
test: add scenario 'regtest'
2020-10-16 23:55:13 +02:00
1f96ca67c5
electrs test: make service shutdown optional
...
Needed for regtest scenario.
2020-10-16 18:01:52 +02:00
eb42fc8e06
test: extract test 'joinmarket-yieldgenerator'
...
Needed for regtest scenario.
2020-10-16 18:01:52 +02:00
bfed10b2fa
run-tests: add command 'all'
...
'all' includes test 'full', which now succeeds.
2020-10-16 16:46:56 +02:00
0a6b9beda5
run-tests: simplify setting default scenario
2020-10-16 16:46:56 +02:00
1a32292e07
test: speed up clightning startup when offline
2020-10-16 16:46:56 +02:00
c07e767889
test: add python test requirements
...
This allows running the Python tests without importing secure-node.
2020-10-16 16:46:55 +02:00
04075b108c
test: use QEMU from stable nixpkgs
2020-10-16 15:53:34 +02:00
03f8dbba47
test: add non-secure-node eval test
...
This tests that the modules work without the secure-node template.
The test currently fails at runtime, but evaluating already helps
catching module-related errors.
2020-10-16 15:53:34 +02:00
bb763d6a26
run-tests: add 'eval' command
2020-10-16 15:53:34 +02:00
c9251e72a1
README: add run-tests.sh to examples
2020-10-16 15:53:33 +02:00
5a565dff66
netns test: use netns ips from config
2020-10-16 15:53:33 +02:00
ac95fe7c82
netns test: don't test recurring-donations
...
This service is not enabled and its netns doesn't exist.
2020-10-16 15:53:33 +02:00
84744f38d7
netns test: disable backup test
2020-10-16 15:53:33 +02:00
fcc67da9f4
test: add container support
2020-10-16 15:53:33 +02:00
e99b7edb8e
run-tests: pass script args verbatim to command without word splitting
...
Needed for the upcoming 'container' command
2020-10-16 15:53:33 +02:00
e7c397a485
run-tests: rename scriptDir -> testDir
...
Needed for container support.
2020-10-16 15:53:32 +02:00
b552d17d55
run-tests: fix arg error messages
...
$1 was not substituted due to single quotes.
2020-10-16 15:53:32 +02:00
be2127ae5b
test: fix noConnections configs
...
- bitcoind: remove mkForce because otherwise the whole extraConfig is replaced
by the value of mkForce.
- liquidd: don't disable 'listen' because it is entirely benign in offline
mode, we also allow it for bitcoind.
2020-10-11 19:40:08 +02:00
1e18d3ea3b
test: improve modularization
...
This improves debugging and experimenting by making it easy to compose fine-grained
scenarios that have specific tests and features enabled.
The VM test output now includes the subtest name and duration.
Remove the 'raise Exception()' hack for interactive mode.
Run 'banlist-and-restart' test before 'backups'. This speeds up the test
by avoiding an extra shutdown of all bitcoin-related services.
2020-10-11 19:40:08 +02:00
14d2d97ba6
test: rename scenario withnetns -> netns
...
This makes the naming consistent with scenarios added in later
commits.
2020-09-30 11:26:41 +02:00
9bf77ee3e8
backups test: simplify and speed up
2020-09-30 11:26:41 +02:00
fcda69e8b6
netns test: connect from main netns
...
All services are reachable from the main netns, no need to enter
service network namespaces.
This allows us to remove extra_tests.
2020-09-30 11:26:41 +02:00
24069aa2c6
electrs: add option 'monitoringPort'
2020-09-30 11:26:41 +02:00
45bcbf683d
test: rename test.nix -> tests.nix
...
The plural is consistent with tests.py and run-tests.sh
2020-09-30 11:26:40 +02:00
c92e85f707
test: rename base.py -> tests.py
2020-09-30 11:26:40 +02:00
c051544d46
Merge #234 : loop: v0.8.1 -> v0.9.0
...
a89a3e934f24b506ff8ae7c5f956ea4a503f57bda89a3e934f24b506ff8aa89a3e934fa89a3e934f
2020-09-29 17:53:09 +00:00
73f4275d2a
backups: add btcpayserver database
2020-09-24 17:12:08 +00:00
a89a3e934f
test: increase diskSize
2020-09-24 16:54:54 +00:00
24b506ff8a
tests: simplify lightning-loop test
2020-09-24 16:40:50 +00:00
d0701f518c
joinmarket: automatically generate wallet
2020-09-22 13:50:49 +00:00
d6d3e8ff62
joinmarket: add tests
2020-09-22 13:50:45 +00:00
c9c844de80
btcpayserver: add tests
2020-09-15 12:09:35 +00:00
fc15d507ff
loop: adjust test to new message
2020-08-30 08:07:02 +00:00
4d6127bb76
bitcoind: clarify RPC whitelist test
...
- Remove redundant comment
- Test with obviously unsafe RPC call 'stop'
- No need to test privileged user who has no whitelist
2020-08-27 12:19:49 +02:00
9d610991be
bitcoind: remove custom rpc user names
...
Simpler.
We've just removed option 'bitcoind.rpcuser', so we can also remove the
old name 'bitcoinrpc'.
2020-08-27 11:39:26 +02:00
e5fb3f6a7f
run-tests: document how to pass extra build args
2020-08-25 14:58:04 +02:00
df790f6766
run-tests: allow linking test build results for all scenarios
2020-08-25 14:58:04 +02:00
91697b1427
test: allow for testing all scenarios
...
Test all scenarios by default when running 'build' (which happens
when the script is called without arguments).
Default to scenario 'default' in other test commands like 'debug'.
2020-08-25 14:53:13 +02:00
28236691aa
test: rename scenarios/lib.py -> base.py
...
This file isn't a scenario, it's also not a lib because it contains
the main share of actual tests.
2020-08-25 14:53:13 +02:00
80da0a41bc
test: load complete test environment in debug mode
...
Stop just before executing actual tests.
This makes all test functions accessible in debug mode.
2020-08-25 14:53:12 +02:00
9b4cd7bd1c
test: simplify scenario handling
...
We can switch to a more sophisticated scheme later when adding more scenarios
2020-08-25 14:53:12 +02:00
0f56ea6ad1
test: include scenario in test name
2020-08-25 14:53:12 +02:00
9237e5dc3d
test: use pydoc docstring
2020-08-25 14:53:12 +02:00
a36789b468
test: move security tests to separate function
2020-08-20 13:12:06 +02:00
588a0b2405
security: enable full systemd-status for group 'proc'
...
Previously, systemd-status was broken for all users except root.
Use a 'default' deny policy, which is overridden for group 'proc'.
Add operator to group 'proc'.
Also, remove redundant XML boilerplate.
2020-08-20 13:12:06 +02:00
7367446761
test: rename assert_matches_exactly -> assert_full_match
...
More precise, needed in a later commit.
2020-08-20 13:12:05 +02:00
22c3fd52e1
backups: add feature test
2020-08-04 15:25:39 +00:00
62f83a71b8
Merge #218 : Fix typos
...
df89ceed39df89ceed39
2020-08-04 15:13:09 +00:00
46e15ee9cc
tests: make lnd & clightning tests run concurrently
2020-08-04 14:07:12 +00:00
df89ceed39
Fix typos
2020-08-04 13:32:06 +00:00
4ece2da8db
tests: move nginx check in scenarios lib
2020-08-04 12:17:47 +00:00
5c0170c6b8
tests: add post-clightning extra tests to scenarios
2020-08-04 12:17:47 +00:00
5fa0602a18
tests: add extra_tests argument to scenario lib run_tests()
2020-08-04 12:17:47 +00:00
6f9349b0a4
tests: create run_tests() function in the scenario lib
2020-08-02 21:20:51 +00:00
3d2b366156
tests: move common code in tests to lib
2020-08-02 21:12:45 +00:00
e13c532dbf
tests: move common code of scenarios python scripts to the top
2020-08-02 20:59:11 +00:00
0baeb2acce
Merge #209 : Lightning loop
...
e9204946d4491d83a6588f3588b13f1bb801ad7be9204946d4
2020-07-28 20:02:12 +00:00
e9204946d4
lightning-loop: add tests
2020-07-28 15:55:54 +00:00
21c0fb440d
rpcwhitelist: add feature test
2020-07-28 14:32:52 +00:00
6a8e29e016
tests: add dbus-hardening and hideProcessInformation
2020-07-28 11:37:16 +00:00
6365412312
test-script: remove nginx tls proxy test
2020-07-21 13:58:32 +00:00
43ce847e2b
tests: allow running integration tests with different configurations
2020-07-21 09:38:59 +00:00
8783f38fba
tests: add netns to testing framework
2020-07-21 09:38:57 +00:00
b9f07bf706
test: use older qemu version for travis compatibility
2020-05-04 11:34:22 +00:00
026a22fcee
use python testing from stable nixpkgs
2020-05-04 11:34:05 +00:00
1a63f0ca6a
remove option 'services.nix-bitcoin.enable'
...
Users can enable the node config just by importing secure-node.nix
2020-04-08 17:35:12 +02:00
28792f79dc
rename nix-bitcoin.nix -> presets/secure-node.nix
2020-04-08 17:35:12 +02:00
e398674964
run-tests.sh: fix leaking tmp files outside TMPDIR
...
- Move vm image (NIX_DISK_IMAGE) from $TMP to $TMPDIR
- Set $PWD
Also:
- Simplify mktemp command
- USE_TMPDIR=1: Don't create extra dir inside $TMPDIR
2020-03-29 18:51:35 +02:00
1e62456ed1
electrs: test RPC connection to bitcoind
2020-03-04 18:09:52 +01:00
4d8590f8ed
fix qemu error on travis
2020-02-27 01:28:20 +01:00
a26a82ab90
Merge #138 : Update nixpkgs (lnd 0.8.1 -> lnd 0.9.0, clightning 0.8.0 -> 0.8.1)
...
b6d7e81c31b6d7e81c31
2020-02-26 21:36:30 +00:00
87129b10c1
Merge #140 : CI build: print number of VM CPUs
...
31ad56950f31ad56950f
2020-02-25 22:53:37 +00:00
31ad56950f
CI build: print number of VM CPUs
2020-02-25 22:51:57 +01:00
b6d7e81c31
Update nixpkgs (lnd 0.8.1 -> lnd 0.9.0, clightning 0.8.0 -> 0.8.1)
2020-02-23 18:30:39 +00:00
83863c03e5
use pinned nixpkgs-unstable for the test driver
2020-01-15 23:14:04 +00:00
187ff884db
add modules test
...
The build of package 'nodeinfo' is implicitly tested by the modules test.
2020-01-13 00:25:12 +01:00
nixbitcoin
Erik Arvstedt
kon
Jonas Nick
Ian Shipman
practicalswift