54 Commits

Author SHA1 Message Date
Andrew Ruthven
e900dff28e If a URL test fails, display the Apache Request ID to aid debugging
This helps with #311.
2024-04-02 00:11:30 +13:00
Andrew Ruthven
0c9e0d6a87 Test more dates in the past and future
There is now a Perl script that'll generate tests and result files to a
wide variety of dates. From this we currently don't support < 1 AD or >
9999 AD.

run_regressions is modified to remove the UNTIL option as I want to use a
character after the test number to allow "subtests".
2024-03-03 21:30:22 +13:00
Andrew Ruthven
59e4f2c929 If a test fails, bail out, the state will be indeterminate 2024-02-29 00:43:49 +13:00
Andrew Ruthven
c2a054d28e Add initial tests for the web UI
Use Test::WWW::Mechanize to test the UI.

Closes #310
2024-02-29 00:43:47 +13:00
Andrew Ruthven
1ca8284bdc Add ROOM as a principal type
This hopefully resolves #282.
2024-01-21 19:12:42 +13:00
Andrew Ruthven
c9ac75173b Allow the tester to hit N or n to continue 2023-01-08 12:13:32 +13:00
Andrew Ruthven
7b2fa34f73 Reenable N being a default 2022-12-17 22:01:03 +13:00
Andrew Ruthven
45c74a628b Improvements to run_regressions.sh options
* Add q to quit
* Loop if an invalid command is entered, instead of continuing

As part of this I converted the large if/elif/elif/.../fi to a case
statement, a bit easier to read.
2022-12-17 15:40:06 +13:00
Andrew Ruthven
3c1d39ff85 Ensure the test suite exists before operating on it.
I kept on making typos, so ended up with random directories, this should
stop that from happening in future.
2022-12-14 23:58:49 +13:00
Andrew Ruthven
692c20eec6 Don't inherit DB from previous test set 2022-12-14 08:53:32 +13:00
Andrew Ruthven
d5cb124184 Report about dumping the database 2022-06-28 23:56:57 +12:00
Andrew Ruthven
65c0882672 Add help option for regression tests 2021-01-24 18:56:43 +13:00
Jamie McClymont
a4c9718bb2 Add Gitlab CI
Signed-off-by: Jamie McClymont <jamiemcclymont@catalyst.net.nz>
2018-11-30 15:59:04 +13:00
Andrew Ruthven
872f4fc6ad Allow over riding the value of ALLSUITES 2018-11-12 18:33:01 +13:00
Andrew Ruthven
95ad5ec373 Allow database dumps to be restored in test suite.
Primary fix is the search_path to ensure that the collection table
is in the search path so that the copy into dav_binding (and
possibly others) will work.

I also suppressed the warning about plpgsql.
2018-11-12 18:00:30 +13:00
Andrew Ruthven
b0a1c9212d Ignore the PostgreSQL version for tests
This just creates bogus test result diffs.
2018-11-12 17:59:51 +13:00
Florian Schlichting
10ed3ffc84 misc changes to get more tests to pass
Status: binding almost passes, carddav and scheduling have some issues,
timezone seems hopeless (dependency on remote URL that is 404)
2017-01-01 20:46:36 +01:00
Florian Schlichting
b1ae485973 document the setup that will get regression-suite to pass
The other suites don't pass for me at the moment.
2016-12-01 20:29:28 +01:00
Andrew McMillan
9580da622a Support regression testing with postgres on non-default port
[from github handle-remote-attendees branch]
2015-12-27 13:02:38 +01:00
Andrew McMillan
413c26dd71 More aggressively set timezone for regression testing. 2013-09-26 16:25:01 +02:00
Andrew McMillan
50c25cc740 Add options to do colourized, side-by-side & meld reviewing of results. 2013-09-24 11:46:37 +02:00
Andrew McMillan
11892c4e97 Release 0.9.9.6 2011-09-27 13:27:56 +13:00
Andrew McMillan
970eddb8b7 Add timezone and scheduling to the default regression set. 2011-09-20 11:44:48 +12:00
Andrew McMillan
f9ad324ba1 Adjustments to timezones representation in the database to support timezone protocol. 2011-09-17 23:40:04 +12:00
Andrew McMillan
6f87c13cf2 Make list of test suites overridable in configuration. 2010-11-21 00:52:11 +13:00
Andrew McMillan
6533a89b7e Change regression runner to look for sample data with tests. 2010-11-06 18:05:04 +13:00
Andrew McMillan
296379c734 Add an 'all' regression set which creates the initial DB for the others.
As a result we don't need to keep the initial databases in Git, or
in the release, and we have a way of running all regression tests
as well as just running small subsets when we need to.
2010-09-25 22:29:54 +12:00
Andrew McMillan
ed9b3ae693 Tweaking OPTIONS output. 2010-09-12 16:22:58 +12:00
Andrew McMillan
0d9edf6632 Making regression tests work on Lenny. 2010-09-12 14:47:26 +12:00
Andrew McMillan
8afb4676fa [regression tests] Use tar mode for dumps rather than -Fc
The tar mode will be more reliable for restore on older systems
I hope.
2010-09-12 11:54:32 +12:00
Andrew McMillan
8fd7253e8b Use dbdump rather than pgdump to get around .gitignore. 2010-05-19 23:57:22 +12:00
Andrew McMillan
17940a11a8 Add ability to start a regression suite from a DB dump. 2010-05-19 23:50:24 +12:00
Andrew McMillan
4b7ba370ad Set PGTZ variable so tests default to Pacific/Auckland. 2010-03-22 03:16:54 -07:00
Andrew McMillan
1c58ac1478 We don't actually Accept-encoding: gzip in regression tests :-) 2010-03-22 02:56:28 -07:00
Andrew McMillan
5b0cf8b462 Test cases just prior to switch to new PROPFIND implementation. 2009-11-12 00:41:54 +13:00
Andrew McMillan
b30d898c51 Beginning to think about splitting regression tests into sets. 2009-11-02 12:43:12 +13:00
Andrew McMillan
3a83eb06fb This script uses some bashism. 2009-10-06 13:53:47 +13:00
Andrew McMillan
1babe3727d Move Upgrade-Database test to get rid of space in filename. 2009-06-22 14:44:21 +12:00
Andrew McMillan
18458fb795 Source primary/alternate hosts from the regression configuration file. 2008-11-18 18:15:20 +13:00
Andrew McMillan
1d62197986 Allow for editing the tests during the test run, or rerunning failures. 2008-10-25 21:43:08 +13:00
Andrew McMillan
761efa42ca Allow exit from regression tests displaying the test just run. 2008-10-21 23:05:25 +13:00
Andrew McMillan
2c4a8e623f Changes to regression run to ensure update database is run. 2008-06-19 22:51:00 +12:00
Andrew McMillan
9f03661001 Refer to file explicitly in current directory. 2008-05-28 22:37:02 +12:00
Andrew McMillan
bf73dc26e7 Display the number of tests also at the end of the regression run. 2008-01-26 00:17:07 +13:00
Andrew McMillan
1ff7c77a6e Remove temporary DB patch which accidentally was committed. 2008-01-24 22:40:56 +13:00
Andrew McMillan
4cf4e841b6 Show the duration of the regression test run. 2008-01-24 09:07:16 +13:00
Andrew McMillan
9fa7ef661a Sprinkle a little more configurability in there. 2007-11-02 22:13:51 +13:00
Andrew McMillan
25fd0ebfa0 Some minor changes. One day this might work elsewhere. 2007-09-18 23:24:12 +12:00
Andrew McMillan
df692d2535 Regression testing framework now with SQL query support. 2006-12-06 14:01:03 +13:00
Andrew McMillan
0b77ca002f Allow a forced 'yes' to all. 2006-12-02 11:33:03 +13:00