summaryrefslogtreecommitdiff
path: root/source4/torture/smbtorture.c
AgeCommit message (Collapse)AuthorFilesLines
2007-10-10r21707: Finally merge my (long-living) perlselftest branch.Jelmer Vernooij1-1/+14
This changes the main selftest code to be in perl rather than in shell script. The selftest script is now no longer a black box but a regular executable that takes --help. This adds the following features: * "make test TESTS=foo" will run only the tests that match the regex "foo" * ability to deal with expected failures. the suite will not warn about tests that fail and are known to fail, but will warn about other failing tests and tests that are succeeding tests but incorrectly marked as failing. * ability to print a summary with all failures at the end of the run It also opens up the way to the following features, which I hope to implement later: * "environments", for example having a complete domains with DCs and domain members in a testenvironment * only set up smbd if necessary (not when running LOCAL tests, for example) * different mktestsetup scripts per target. except for the mktestsetup script, we can use the same infrastructure for samba 3 or windows. (This used to be commit 38f867880beb40c691e9713f854426031310629c)
2007-10-10r21222: Merge a couple of pidl fixes:Jelmer Vernooij1-4/+1
* Pidl will now warn when trying to use pointers as integers in expressions. * "subcontext()" is now marked as deprecated. The alternatives, transmit_as() / represent_as() should be available soon. * More tests. * Remove some unused code in smbtorture. (This used to be commit 37c0da541e3962164d5af3e3c9560803a733f3b7)
2007-10-10r21055: Fix executable bit.Jelmer Vernooij1-44/+1
(This used to be commit 7512270ffae4e72d70f6ca347f09708f1bf915ad)
2007-10-10r21040: Remove subunit runner (now written in perl in my perlselftest branch)Jelmer Vernooij1-10/+1
(This used to be commit afe0d170b08deb712b91ee73cc00a444e989b480)
2007-10-10r21028: Generate list of tests rather than maintaining it manually.Jelmer Vernooij1-1/+25
(This used to be commit 7de4727ceb5935dd5fca49db0331c4509f735362)
2007-10-10r20757: Strip recipe functionality (should be one layer up)Jelmer Vernooij1-30/+1
(This used to be commit a3f7b184735fb6467bec03eeff53a72003a78097)
2007-10-10r19878: Announce testsuites when using subunit.Jelmer Vernooij1-1/+7
(This used to be commit daaa0216456bf76116985451c87e5252c70f0dec)
2007-10-10r19875: set torture:host and torture:share also when we are given a binding ↵Stefan Metzmacher1-13/+6
string metze (This used to be commit 8202f98123a13727b5cda3b4ca6f1040a41908ca)
2007-10-10r19680: Allow specifying basedir for test data.Jelmer Vernooij1-1/+5
Create temporary directories in base directory. (This used to be commit f111feb1d2b82a9ec3a8b6fbcdbe297bf11edc42)
2007-10-10r19565: the scripts do work :)Andrew Tridgell1-2/+0
(This used to be commit 59c30478a19ba466d16de21062bed5a4f525f344)
2007-10-10r19564: testing build farm scripts, apologies for the noiseAndrew Tridgell1-0/+2
(jelmer didn't see some breakage emails lately, I want to ensure its working) (This used to be commit a675118a66993ff4868f2fad0c8f887feb93581b)
2007-10-10r19563: - make --num-progs a valid smbtorture option again. It's commonlyAndrew Tridgell1-2/+6
used. - mark -t as an integer option (This used to be commit 6602b605f6565c592500900e0f797f216f9910ff)
2007-10-10r19556: Remove unused option.Jelmer Vernooij1-1/+0
(This used to be commit 827af8654940243c21eb12e9f1934a13272a6b00)
2007-10-10r19554: Remove short option for --shell, as it overlaps with the option used forJelmer Vernooij1-1/+1
configuration files. (This used to be commit c2e58aa3e67ad6a03464ada5ae0e1437f3863b64)
2007-10-10r19548: this talloc_free() is definately wrong.Andrew Tridgell1-1/+0
(This used to be commit b412a8390588fcbb655252fcc4cccbf3b3b84b5c)
2007-10-10r19537: Report correct test names when tests failed.Jelmer Vernooij1-0/+5
(This used to be commit 7b93b3c8be3d2a253b0737be893e7eb1b7c94dba)
2007-10-10r19535: Fix warnings.Jelmer Vernooij1-2/+2
(This used to be commit 7443f4847df6614797c937dd8d45bf7b37464a20)
2007-10-10r19513: Add support for recipes (using '@')Jelmer Vernooij1-2/+31
(This used to be commit dbe5e8dd8c0986e5ab55a072957048f633838157)
2007-10-10r19512: Add --shell option to smbtorture (first work towards support for ↵Jelmer Vernooij1-9/+52
'recipes') (This used to be commit 087a8e80a9e912b330178b8c647b83381635f8e9)
2007-10-10r19510: Make smbtorture's `nprocs' parameter a parametric option.Jelmer Vernooij1-1/+0
(This used to be commit f5d6b3ca29788d171d53822a26295ae895a5ed8f)
2007-10-10r19392: Use torture_setting_* rather than lp_parm_* where possible.Jelmer Vernooij1-2/+2
(This used to be commit b28860978fe29c5b10abfb8c59d7182864e21dd6)
2007-10-10r19387: Exit with 0 if failures were expectedJelmer Vernooij1-5/+5
(This used to be commit b4fc06aeafa3ed8460759409a72b4de43a534d62)
2007-10-10r19381: Print out the specific tests that failed after a smbtorture run.Jelmer Vernooij1-12/+46
Support listing known failures as a list of wildcards in the file `KNOWN_FAILURES'. (This used to be commit 23f66efd564d1ad549fc0cd60348f54808f5cafa)
2007-10-10r19378: Add another type of test result 'error'Jelmer Vernooij1-1/+8
(This used to be commit 77d13056bf437de77bfc94e21e9c945928e7f521)
2007-10-10r19377: Simplify report functions.Jelmer Vernooij1-12/+2
(This used to be commit 0061f3c47e95f07461837c4051cf129b18961b56)
2007-10-10r19369: - we need to set the target:samba3 before calling torture_init()Stefan Metzmacher1-10/+7
otherwise BASE-DELETE will run all tests - call ldb_global_init() directly after torture_init() this isn't strictly needed but looks better metze (This used to be commit 0c26c2aefdb603c5ffc87e9c0db0e9b2b34ec0ab)
2007-10-10r19350: Properly list LOCAL-TALLOC under the "LOCAL" header.Jelmer Vernooij1-19/+19
Support directories for subcategories in tests. Several small other fixes. (This used to be commit bde00d97068d559b025ab131ff698a82430d14b3)
2007-10-10r19343: Add support for external scripts/binaries that write results using theJelmer Vernooij1-6/+21
'subunit' protocol. This allows us to easily plug EJS scripts or binaries that can't depend on -ltorture into smbtorture. The protocol is very simple: - write "comments" to stderr Example output on stdout: test: foo success: foo test: bar success: bar test: blah failure: blah [ dummy.c:30: Expression 1 != 2 failed! ] test: blie skip: blie [ Iconv support not built in ] I've already converted the talloc testsuite. (This used to be commit e1742c14a247fabba969f8698108e73997d3f420)
2007-10-10r19339: Merge my 4.0-unittest branch. This adds an API for more fine-grainedJelmer Vernooij1-43/+106
output in the testsuite rather than just True or False for a set of tests. The aim is to use this for: * known failure lists (run all tests and detect tests that started working or started failing). This would allow us to get rid of the RPC-SAMBA3-* tests * nicer torture output * simplification of the testsuite system * compatibility with other unit testing systems * easier usage of smbtorture (being able to run one test and automatically set up the environment for that) This is still a work-in-progress; expect more updates over the next couple of days. (This used to be commit 0eb6097305776325c75081356309115f445a7218)
2007-10-10r18421: support --target=samba3, I thought that was already supportedStefan Metzmacher1-2/+4
metze (This used to be commit 47ccea11f31be878c5bdff4f6f4e5b7685a1c796)
2007-10-10r18343: fixed setlinebuf() prototype, added test for it, and use it in twoAndrew Tridgell1-3/+1
places to avoid a #ifdef (This used to be commit 095b8057740a4bb207e24e4c63a2dcb53521a72f)
2007-10-10r18168: Use {NULL} rather than POPT_TABLEEND, which is not always available.Jelmer Vernooij1-1/+1
(This used to be commit 8b622c5ded0732df0eaf9f6226f52a27b6eacd73)
2007-10-10r17958: as talloc_init() enabled null tracking, we should avoid to use itStefan Metzmacher1-1/+1
in smbtorture, and in the LOCAL-TALLOC we should reset the null tracking also make bin/smbtorture //url/foo LOCAL-TALLOC LOCAL-TALLOC possible metze (This used to be commit d1dd3df5e4fd21f5cbd00e472438fe3eadb266e5)
2007-10-10r17930: Merge noinclude branch:Jelmer Vernooij1-1/+1
* Move dlinklist.h, smb.h to subsystem-specific directories * Clean up ads.h and move what is left of it to dsdb/ (only place where it's used) (This used to be commit f7afa1cb77f3cfa7020b57de12e6003db7cfcc42)
2007-10-10r16527: Add target argument for smbtorture.Jelmer Vernooij1-4/+4
Remove duplicate unc path separator conversion. Add prefix for tempdirs. (This used to be commit 3763ed3092fa89558390a9721be8437a7c380790)
2007-10-10r16330: Show number of succeeded, failed and skipped tests and success rate ↵Jelmer Vernooij1-0/+8
at the end of a smbtorture run. (This used to be commit 745f3d544bb1158c7c0001d36181916cd932bc08)
2007-10-10r16328: Wrap all existing tests in simple single-function testsuites.Jelmer Vernooij1-51/+51
(This used to be commit 7e811adf59841936b7e634fca4e95630f890c5af)
2007-10-10r16321: Add suite_start/suite_finish hooks, support --format=quietJelmer Vernooij1-4/+17
(This used to be commit 6da39533d77f686b26787bebfe9e3db4bb8c740d)
2007-10-10r16304: Improve testing UI API. This now allows registering the fullJelmer Vernooij1-22/+39
test suite tree, looks a bit more like other unit testing API's, fixes some memory responsibility issues, introduces testcases, and removes the need for tests to call torture_ok(). (This used to be commit 0445b1a56a02552f895f400960b9ced39244a144)
2007-10-10r16174: Couple of fixes to the UI code - make 'torture_ok()' optional, be ↵Jelmer Vernooij1-1/+16
more verbose by default. (This used to be commit 8ef13a50b9e80811342058cdf15cf84a8ed7532e)
2007-10-10r16160: Fix double semicolon in ui.hJelmer Vernooij1-2/+37
Support output in perl's Test::Harness format (smbtorture output can now be parsed by the 'prove' utility which generates statistics about how much tests failed, succeeded, skipped, etc) (This used to be commit 18fab7a22c85e360d5e4fbb0b2f97504b9a6cfc9)
2007-10-10r16152: Support multiple output formats for those tests using the ui and add ↵Jelmer Vernooij1-1/+45
support for subunit output. (This used to be commit 4e720b01916e226071fce124363da7d68f04a511)
2007-10-10r15908: Mention ncalrpc in smbtorture help outputJelmer Vernooij1-1/+4
Update smbtorture manpage with binding string format explanation (This used to be commit 37f6dc130e697c840676c96aadc295bcde6a0bca)
2007-10-10r15819: Use updated API in smbtorture, use UI tools in registry tests.Jelmer Vernooij1-2/+2
(This used to be commit 4c452090fbcf9b17acd8473cf018b09f445009b2)
2007-10-10r15456: Inspired by a short discussion with abartlet on IRC.Rafal Szczesniak1-2/+10
- create "async" parameter for smbtorture to categorise async tests potentially hard for windows servers - create "num-async" parameter to specify the number of simultaneous async requests to be made - move RPC-ASYNCBIND test from "dangerous" to "async" (I should probably do the same for many others async tests...) It's an interesting way to determine resources availability on windows servers... rafal (This used to be commit 0d008fbea0aec279d389cff676a4319262475d17)
2007-10-10r15131: Tidy help output. When printing the list of tests, group them by prefixJames Peach1-6/+20
to make it easier to see what tests are available. (This used to be commit f15010ccb37f75a4bb86306cec223093b000058e)
2007-10-10r14967: load shared module torture test after we know where to search...Stefan Metzmacher1-2/+2
metze (This used to be commit b2f45531544f52b63f61fc8224477e89eb3dca83)
2007-10-10r14818: give an error on an unknown testStefan Metzmacher1-0/+1
so we catch typos in the make test scripts metze (This used to be commit fa73030debe1c216d86622a5380dbe2945f5d1d3)
2007-10-10r14725: Reduce amount of headers, add simple ui implementation (not used yet ↵Jelmer Vernooij1-10/+32
though) (This used to be commit 141830116b059f032696c956832451a7b0f7c6cb)
2007-10-10r14720: Add torture_context argument to all torture testsJelmer Vernooij1-1/+1
(This used to be commit 3c7a5ce29108dd82210dc3e1f00414f545949e1d)