127 Commits

Author SHA1 Message Date
James Valleroy
44b25ea617
functional_tests: Install python3-pytest-django
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2019-04-03 22:03:52 -04:00
LoveIsGrief
35c9e591c9
functional tests: Fix wheel errors when provisioning VM
> error: invalid command 'bdist_wheel'

Kept popping up in the logs. It seems like `wheel` isn't in the deps of
the installed python packages. Therefore we now install it ourselves.

freedombox/plinth#1521 - Provision VM to run function functional tests

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-04-03 22:03:49 -04:00
LoveIsGrief
d31b0ee3c7
functional_tests: Allow provisioning VM for functional tests
It's now possible to run the tests in the VM more easily
without copy-pasting too much from HACKING.md.
`vagrant provision --provisiion-with tests` will take care of the dependencies.

freedombox/plinth#1521 - Provision VM to run function functional tests

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-04-03 22:03:44 -04:00
LoveIsGrief
d551d52537
i2p: Add functional tests
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-04-01 17:33:26 -07:00
Sunil Mohan Adapa
fd9b6770be
tests: Use pytest for running all tests
- Create option --include-functional to run functional tests. Otherwise, they
  are disabled by default. If pytest-bdd is not installed, functional tests are
  not discovered at all.

- Make pytest-django discover the setting files by creating dummy manage.py in
  top level directory.

- Make pytest run as './setup.py pytest'. Add alias from './setup.py test'. This
  requires pytest-runner package.

- Merge .gitignore files from functional_tests/

- Update gitlab-ci.yml to run tests with coverage using pytest.

- Update HACKING.md to suggest using py.test-3 instead of old way of running.
  Merge functional tests README.md into HACKING.md.

- Remove execution wrapper runtests.py as pytest-django is able to configure
  Django settings before execution of tests. Update tests to explicitly ask for
  Django database as database access is denied by default.

- Replace usage of python3-coverage with python3-pytest-coverage. Execution
  wrappers are not required.

- Add build dependencies on pytest modules.

- Let all warnings be shown after running tests.

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-10 09:54:23 -04:00
Sunil Mohan Adapa
e7181bb18a
mediawiki: Fix tests to allow running from any directory
Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-10 09:54:21 -04:00
Sunil Mohan Adapa
cb15d34482
functional_tests: Update todo list by removing implemented tests
Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-10 09:54:18 -04:00
Sunil Mohan Adapa
0e2315486d
tests: Read functional tests conf file without assuming CWD
Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-10 09:54:07 -04:00
Sunil Mohan Adapa
b66b15591e
tests: Mark functional tests with functional mark
Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-10 09:54:04 -04:00
Sunil Mohan Adapa
895b5f1fa8
functional_tests: Reorder tests to disable apps after tests
To reduce memory/CPU requirement on the VM running the services for functional
tests. The following items are kept enabled as these are enabled by default in
FreedomBox.:

- NTP daemon

- Restricted console login

- Unattended upgrades

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-03-09 21:20:42 -05:00
Joseph Nuthalapati
a4e01eb629
pagekite: Bring subsubmenu below description. Remove About section.
- Fixed broken functional tests
- Pagekite index page directly takes to configuration

Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-03-08 14:25:26 -08:00
Joseph Nuthalapati
b18ac14377
snapshot: Fix failing functional test
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-03-02 10:11:33 -08:00
Joseph Nuthalapati
241d3a98d5
Disable Coquelicot for Buster release
As confirmed by multiple users, Coquelicot is no longer useful for uploading
files, which makes it useless as a file sharing application.

We might enable it in the future if it's actively maintained once again, or find
an alternative.

- Skip functional tests

- Disable modules-enabled file

Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-02-28 18:34:14 -05:00
Sunil Mohan Adapa
ee87c00578
ttrss: Make functional test definitions specific to ttrss
- So as not to clash with future apps that may have feed add/remove capability.

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-02-26 15:24:09 -08:00
James Valleroy
1eed7d581d
ttrss: Add backup support
- Use backup hooks to dump and restore database.
- Add functional test for backup and restore.

Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-02-26 15:23:47 -08:00
Joseph Nuthalapati
8bc34f84c3
config: Rename Default App to Webserver Home Page
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-02-23 10:30:59 -05:00
James Valleroy
e385e7a87a
monkeysphere: Re-enable functional tests
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2019-02-05 21:51:44 -05:00
James Valleroy
a3dbe56a4e
repro: Also disable functional tests
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2019-02-05 21:51:18 -05:00
James Valleroy
c5ee844cb1
shadowsocks: Use resolvable domains in functional tests
Shadowsocks server will fail to start if the domain cannot be
resolved.

Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-02-03 17:43:25 -08:00
Sunil Mohan Adapa
22dd2d26f3
mldonkey: Add functional test for uploading
- Run yapf for automatic formatting.

- Move disable test to the end so that after all test are run, app is usually
  disabled.

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-28 10:54:53 -08:00
J. Carlos Romero
1c8c9d067a
mldonkey: Add backup/restore support
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-28 10:54:27 -08:00
James Valleroy
b8737ad663
help: Add functional test to check status logs page
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-28 09:57:02 -08:00
Sunil Mohan Adapa
c35cecb34a
openvpn: Add backup/restore support
- Add functional tests

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-01-27 08:16:24 -05:00
James Valleroy
af018e3018
radicale: Add functional tests for setting access rights
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-26 22:06:57 -08:00
Sunil Mohan Adapa
529c281734
syncthing: Add backup/restore support
Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2019-01-26 21:30:29 -05:00
Sunil Mohan Adapa
260dcd4d32
mldonkey: Update description and minor updates
- Update description to simply and talk about multiple protocols supported.

- Don't diagnose on IPv6 as mldonkey does not listen there.

- Run yapf and isort.

- Minor styling fixes.

- Update functional tests to check for service running.

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-25 14:39:31 -08:00
J. Carlos Romero
548c6b98f3
mldonkey: Add new module for the eDonkey network
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-25 14:39:10 -08:00
Sunil Mohan Adapa
1ec5b213ad
snapshot: Minor styling fixes
- Avoid use of _ in functional steps.

- flake8 fixes.

Signed-off-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-08 14:00:26 -08:00
Joseph Nuthalapati
0b9922434c
snapshot: Fix failing tests
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Reviewed-by: Sunil Mohan Adapa <sunil@medhas.org>
2019-01-08 14:00:11 -08:00
James Valleroy
6adec225d3
radicale: Add tests for well-known URLs
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2019-01-06 17:57:43 -05:00
James Valleroy
a99c4e0901
functional_tests: Move backup test into backups feature
Remove @bind tag from backups feature.

Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-12-13 20:48:14 -05:00
Michael Pimmer
067fea7d17
Backups: functional tests update; restoring backup bugfix
- updated functional tests to work with changed UI
- fixed bug when restoring an uploaded file

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-12-13 18:28:31 -05:00
Michael Pimmer
6651c0468e
Backups: remove archive name when creating an archive
- use datetime as archive name w/o asking user
- updated functional tests

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-12-13 18:28:10 -05:00
Michael Pimmer
13e8ae1bb2
Backups, remote repository: adapt functional tests
- fix functional tests of backups
- rename export-and-download url to download

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-12-13 18:27:57 -05:00
Prachi Srivastava
0106877eff
Ignores warnings in pytest while running funtional test
Reviewed-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
2018-11-30 15:02:53 +05:30
James Valleroy
6dc3fbfb97
functional_tests: Confirm when deleting all snapshots
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-29 20:05:48 -05:00
Prachi Srivastava
09da8535a7
Changes functional test to select All and delete snapshots
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-29 20:05:44 -05:00
James Valleroy
be3e8b7939
functional_tests: Add sso tags
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-18 11:49:57 -05:00
Michael Pimmer
5632326802
Functional tests: assert that module installation succeeded
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 16:22:28 -05:00
Michael Pimmer
bcd84ab92f
Functional tests: fix waiting for redirects
wait_for_page_update has an 'expected_url' argument that you can use
to make the browser wait until it reaches an expected URL after a
redirect.

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 16:22:22 -05:00
Michael Pimmer
33dde221d1
Functional tests: check that browser waits for redirects to finish
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 16:22:17 -05:00
James Valleroy
006147b417
functional_tests: Remove remaining backup export steps
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 09:00:55 -05:00
Michael Pimmer
5fd8abcc1f
Backups: minor fixes of functional tests
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 09:00:51 -05:00
Michael Pimmer
c988d468f2
Backups: functional test to download and restore an archive
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 09:00:42 -05:00
James Valleroy
82a4a5fc5e
functional_tests: Remove backup export steps
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 09:00:09 -05:00
Michael Pimmer
f539a223f6
Functional tests: minor documentation changes
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-17 09:00:04 -05:00
Joseph Nuthalapati
68ff01c301
tahoe: Enable backup/restore
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-01 20:39:57 -04:00
Joseph Nuthalapati
78950b1ba3
tahoe: Add functional tests
Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-11-01 20:39:52 -04:00
James Valleroy
749ddca68e
functional_tests: Fix steps with domain parameter
Signed-off-by: James Valleroy <jvalleroy@mailbox.org>
2018-10-29 23:22:51 -04:00
Joseph Nuthalapati
874dcdf282
monkeysphere: Skip functional tests until bugs are resolved
Currently, monkeysphere does not get installed properly unless FreedomBox
security is disabled. Skip these tests until the monkeysphere is patched
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911907 .

Another way to enable these tests is to disable restricted logins (write steps
to do that) before running them.

Reviewed-by: James Valleroy <jvalleroy@mailbox.org>
2018-10-29 23:22:40 -04:00