Bug 7847 - RPC-COUNTCALLS should be moved into a separate group of 'investigational' test suites
Summary: RPC-COUNTCALLS should be moved into a separate group of 'investigational' tes...
Status: NEW
Alias: None
Product: Samba 4.0
Classification: Unclassified
Component: smbtorture (show other bugs)
Version: unspecified
Hardware: All Windows 2008 R2
: P3 enhancement (vote)
Target Milestone: ---
Assignee: Andrew Bartlett
QA Contact: samba4-qa@samba.org
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-12-06 17:05 UTC by Matt Ficken (mail bounces back)
Modified: 2010-12-06 17:05 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Matt Ficken (mail bounces back) 2010-12-06 17:05:57 UTC
I think the RPC-COUNTCALLS test suite should be removed from the normal list of smbtorture tests (defined in 'tests' file) and added to a new set of 'investigational' tests, so that RPC-COUNTCALLS is not normally run as part of smbtorture (for buildfarm, regression testing, etc...)

Other test suites test particular functions of a Windows or Samba server. Its clear if they fail or not and that pass or fail has a useful purpose (indicates something is broken or not).

RPC-COUNTCALLS makes a call request for all opnums 0-500 for all rpc interfaces that are registered with Samba, and then reading the error code that the server returns. Its hard to define a meaningful 'pass' or 'failure' condition.

Consequently, its hard to make sure that a Samba or Windows release will pass this suite. And its hard to see how this is useful for normal testing, so its hard to see the value in spending time making sure Windows and Samba pass and especially continue to pass this suite.

It is clear how this suite is useful for investigating a server and its functions. It looks like thats what RPC-COUNTCALLS was originally built for, afterall, many of the pipes it tries to connect to are named from DCOM interfaces(ex: \pipe\IDispatch), so it may also have been a way to investigate DCOM in addition to investigating RPC. 

Either way, its a good investigational tool, but I don't think is appropriate for regular testing of Samba or Windows. 

Moving it out of the regular set of 'tests' run and into an 'investigational' set, will save developer time.