I have a share where different users may write to it and create directories and files.. the thing is, I want newly created directories to to have the stickybit - like 1770, but now when I add the "directory mask" under "security options" and commit, then swat prefixes a zero to the mode - 01770.. and when I change the first zero to a one, then again a zero is prefixed, so a mode of 011770 is created... and so on... nothing happens, the directories created still have the same permissions as before and no stickybit is set... also samba seems to ignore the "1770" modes in its own config. no directory is ever created with that mode... looks like a bug to me.
As a workaround please use 'inherit permissions = Yes'. But it might even better to use filesystem ACLs and 'inherit acls = Yes'. I move it to 3.0.11 as it's still valid there.
Please try to set 'force directory mode = 01770' in addition to 'directory mask = 01770'. It works for me. The leading '0' does not derange.
Closing the bug report. Please reopen if it is still an issue for you.