Bug 11146 - samba PANIC while copying large file to a ZFS volume with compression = ON from PC
Summary: samba PANIC while copying large file to a ZFS volume with compression = ON fr...
Status: NEW
Alias: None
Product: Samba 4.1 and newer
Classification: Unclassified
Component: File services (show other bugs)
Version: 4.1.6
Hardware: x64 Linux
: P5 critical (vote)
Target Milestone: ---
Assignee: Samba QA Contact
QA Contact: Samba QA Contact
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-03-10 01:47 UTC by Samson Luk
Modified: 2015-03-11 05:13 UTC (History)
1 user (show)

See Also:


Attachments
dumping core in /var/log/samba/cores/smbd (2.60 MB, application/x-core)
2015-03-10 01:47 UTC, Samson Luk
no flags Details
[2015/03/11 12:40:49.819272, 0] ../source3/lib/dumpcore.c:317(dump_core) (2.93 MB, application/x-core)
2015-03-11 05:13 UTC, Samson Luk
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Samson Luk 2015-03-10 01:47:11 UTC
Created attachment 10835 [details]
dumping core in /var/log/samba/cores/smbd

Samba version 4.1.6-Ubuntu

Copy process failed in the middle, file being copy is around 3.5GB, complaint cannot connect to network on PC side and process aborted. On Linux side:

[2015/03/10 00:08:27.248341,  0] ../source3/smbd/open.c:1582(defer_open_done)
  PANIC: assert failed at ../source3/smbd/open.c(1582): ret
[2015/03/10 00:08:27.248505,  0] ../source3/lib/util.c:785(smb_panic_s3)
  PANIC (pid 5707): assert failed: ret
[2015/03/10 00:08:27.250842,  0] ../source3/lib/util.c:896(log_stack_trace)
  BACKTRACE: 17 stack frames:
   #0 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(log_stack_trace+0x1a) [0x7f206f928f3a]
   #1 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(smb_panic_s3+0x20) [0x7f206f929010]
   #2 /usr/lib/x86_64-linux-gnu/libsamba-util.so.0(smb_panic+0x2f) [0x7f2070e51c6f]
   #3 /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0(+0xf327d) [0x7f2070a1f27d]
   #4 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x2c848) [0x7f206f934848]
   #5 /usr/lib/x86_64-linux-gnu/libtevent.so.0(tevent_common_loop_immediate+0xd4) [0x7f206e317e14]
   #6 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x3c) [0x7f206f93ef7c]
   #7 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x37264) [0x7f206f93f264]
   #8 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f206e3175ed]
   #9 /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0(smbd_process+0x9ca) [0x7f2070a4159a]
   #10 smbd(+0x9fa4) [0x7f20714b5fa4]
   #11 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x16c) [0x7f206f93f0ac]
   #12 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x37300) [0x7f206f93f300]
   #13 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f206e3175ed]
   #14 smbd(main+0x13eb) [0x7f20714b2b8b]
   #15 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f206df6fec5]
   #16 smbd(+0x6f1d) [0x7f20714b2f1d]
[2015/03/10 00:08:27.251381,  0] ../source3/lib/util.c:797(smb_panic_s3)
  smb_panic(): calling panic action [/usr/share/samba/panic-action 5707]
[2015/03/10 00:08:27.277527,  0] ../source3/lib/util.c:805(smb_panic_s3)
  smb_panic(): action returned status 0
[2015/03/10 00:08:27.277687,  0] ../source3/lib/dumpcore.c:317(dump_core)
  dumping core in /var/log/samba/cores/smbd

Attached with the core dump file. Copying smaller file size to the ZFS volume no problem.  Copying same file to a ext4 share no problem.
Comment 1 Volker Lendecke 2015-03-10 07:16:20 UTC
The core file as such is not very useful without your exact environment. Can you get us a backtrace from the corefile?

gdb /usr/sbin/smbd path/to/corefile

and at the prompt do a "bt full"

Thanks
Comment 2 Samson Luk 2015-03-10 10:09:16 UTC
Let me know if additional information needed, thanks:

gdb /usr/sbin/smbd /var/log/samba/cores/smbd/core
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/smbd...(no debugging symbols found)...done.
[New LWP 5707]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `smbd -F'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f206df84cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) bt full
#0  0x00007f206df84cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
No symbol table info available.
#1  0x00007f206df880d8 in abort () from /lib/x86_64-linux-gnu/libc.so.6
No symbol table info available.
#2  0x00007f206f936e9b in dump_core () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#3  0x00007f206f929077 in smb_panic_s3 () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#4  0x00007f2070e51c6f in smb_panic () from /usr/lib/x86_64-linux-gnu/libsamba-util.so.0
No symbol table info available.
#5  0x00007f2070a1f27d in ?? () from /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0
No symbol table info available.
#6  0x00007f206f934848 in ?? () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#7  0x00007f206e317e14 in tevent_common_loop_immediate () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#8  0x00007f206f93ef7c in run_events_poll () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#9  0x00007f206f93f264 in ?? () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#10 0x00007f206e3175ed in _tevent_loop_once () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#11 0x00007f2070a4159a in smbd_process () from /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#12 0x00007f20714b5fa4 in ?? ()
No symbol table info available.
#13 0x00007f206f93f0ac in run_events_poll () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#14 0x00007f206f93f300 in ?? () from /usr/lib/x86_64-linux-gnu/libsmbconf.so.0
No symbol table info available.
#15 0x00007f206e3175ed in _tevent_loop_once () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#16 0x00007f20714b2b8b in main ()
No symbol table info available.
(gdb) quit
Comment 3 Volker Lendecke 2015-03-10 10:59:56 UTC
Can you recompile Samba with CFLAGS=-g?
Comment 4 Samson Luk 2015-03-10 11:04:13 UTC
Ok, get back to you later...
Comment 5 Samson Luk 2015-03-10 11:48:01 UTC
Any idea how to overcome this error:

...
...
symlink: samba-tool -> ./samba-tool
symlink: samba_dnsupdate -> ./samba_dnsupdate
symlink: samba_spnupdate -> ./samba_spnupdate
symlink: samba_kcc -> ./samba_kcc
symlink: samba_upgradeprovision -> ./samba_upgradeprovision
symlink: samba_upgradedns -> ./samba_upgradedns
Checking project rules ...
Project rules pass
Waf: Leaving directory `/root/src/samba/samba-4.1.6+dfsg/bin'
input file '../heimdal/lib/wind/rfc3454.txt' could not be found ('/root/src/samba/samba-4.1.6+dfsg/source4/heimdal_build')
make: *** [all] Error 1
Comment 6 Samson Luk 2015-03-11 05:13:06 UTC
Created attachment 10852 [details]
[2015/03/11 12:40:49.819272,  0] ../source3/lib/dumpcore.c:317(dump_core)

Attached with the new core dump together with the debug info...

On Windows side screen capture:

http://imagizer.imageshack.com/img537/2190/F6DUvS.png

Looks too me the disconnection / crash of smbd is due to waiting too long for ZFS compression operation because Ubuntu side is run on a HP Microserver N54L, cpu is a bit slow, it pause 5 - 10 sec once buffer full before it can resume to receive data form the PC side...  Copying to non-compressed volume is no problem and copying from compress/non-compress volume from Ubuntu to PC is no problem. 

On Ubuntu side:

# cat log.ga*
[2015/03/11 12:40:49.779446,  0] ../source3/smbd/open.c:1582(defer_open_done)
  PANIC: assert failed at ../source3/smbd/open.c(1582): ret
[2015/03/11 12:40:49.779664,  0] ../source3/lib/util.c:785(smb_panic_s3)
  PANIC (pid 4000): assert failed: ret
[2015/03/11 12:40:49.790328,  0] ../source3/lib/util.c:896(log_stack_trace)
  BACKTRACE: 17 stack frames:
   #0 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(log_stack_trace+0x1a) [0x7f6e5ed09f3a]
   #1 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(smb_panic_s3+0x20) [0x7f6e5ed0a010]
   #2 /usr/lib/x86_64-linux-gnu/libsamba-util.so.0(smb_panic+0x2f) [0x7f6e60232c6f]
   #3 /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0(+0xf32ad) [0x7f6e5fe002ad]
   #4 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x2c848) [0x7f6e5ed15848]
   #5 /usr/lib/x86_64-linux-gnu/libtevent.so.0(tevent_common_loop_immediate+0xd4) [0x7f6e5d6f8e14]
   #6 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x3c) [0x7f6e5ed1ff7c]
   #7 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x37264) [0x7f6e5ed20264]
   #8 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f6e5d6f85ed]
   #9 /usr/lib/x86_64-linux-gnu/samba/libsmbd_base.so.0(smbd_process+0x9ca) [0x7f6e5fe225ca]
   #10 smbd(+0x9fa4) [0x7f6e60896fa4]
   #11 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x16c) [0x7f6e5ed200ac]
   #12 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x37300) [0x7f6e5ed20300]
   #13 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f6e5d6f85ed]
   #14 smbd(main+0x13eb) [0x7f6e60893b8b]
   #15 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f6e5d350ec5]
   #16 smbd(+0x6f1d) [0x7f6e60893f1d]
[2015/03/11 12:40:49.790575,  0] ../source3/lib/util.c:797(smb_panic_s3)
  smb_panic(): calling panic action [/usr/share/samba/panic-action 4000]
[2015/03/11 12:40:49.819022,  0] ../source3/lib/util.c:805(smb_panic_s3)
  smb_panic(): action returned status 0
[2015/03/11 12:40:49.819272,  0] ../source3/lib/dumpcore.c:317(dump_core)
  dumping core in /var/log/samba/cores/smbd
send-mail: Cannot open mailhub:25
root@hpn54l:/var/log/samba#
root@hpn54l:/var/log/samba#
root@hpn54l:/var/log/samba# gdb /usr/sbin/smbd /var/log/samba/cores/smbd/core
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/smbd...Reading symbols from /usr/lib/debug/.build-id/79/8c9c4b69eb1e4e9737633330f1862939c5f1f1.debug...done.
done.
[New LWP 4000]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `smbd -F'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6e5d365cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) quit
root@hpn54l:/var/log/samba# gdb /usr/sbin/smbd /var/log/samba/cores/smbd/core
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/smbd...Reading symbols from /usr/lib/debug/.build-id/79/8c9c4b69eb1e4e9737633330f1862939c5f1f1.debug...done.
done.
[New LWP 4000]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `smbd -F'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6e5d365cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) bt full
#0  0x00007f6e5d365cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
No symbol table info available.
#1  0x00007f6e5d3690d8 in abort () from /lib/x86_64-linux-gnu/libc.so.6
No symbol table info available.
#2  0x00007f6e5ed17e9b in dump_core () at ../source3/lib/dumpcore.c:336
        called = true
        __FUNCTION__ = "dump_core"
#3  0x00007f6e5ed0a077 in smb_panic_s3 (why=<optimized out>) at ../source3/lib/util.c:808
        cmd = <optimized out>
        result = <optimized out>
        __FUNCTION__ = "smb_panic_s3"
#4  0x00007f6e60232c6f in smb_panic (why=why@entry=0x7f6e5ff3ddda "assert failed: ret") at ../lib/util/fault.c:159
No locals.
#5  0x00007f6e5fe002ad in defer_open_done (req=0x0) at ../source3/smbd/open.c:1582
        state = 0x7f6e614bd190
        status = {v = 0}
        ret = <optimized out>
        __FUNCTION__ = "defer_open_done"
#6  0x00007f6e5ed15848 in dbwrap_record_watch_done (subreq=0x0) at ../source3/lib/dbwrap/dbwrap_watch.c:378
        req = 0x7f6e614bd6a0
        state = 0x7f6e614bd840
        rec = 0x7f6e614e2240
        ret = 0
---Type <return> to continue, or q <return> to quit---
#7  0x00007f6e5d6f8e14 in tevent_common_loop_immediate () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#8  0x00007f6e5ed1ff7c in run_events_poll (ev=0x7f6e6149dd90, pollrtn=0, pfds=0x0, num_pfds=0) at ../source3/lib/events.c:192
No locals.
#9  0x00007f6e5ed20264 in s3_event_loop_once (ev=0x7f6e6149dd90, location=<optimized out>) at ../source3/lib/events.c:303
        state = 0x7f6e6149ca80
        timeout = 2147483647
        num_pfds = 0
        poll_errno = <optimized out>
#10 0x00007f6e5d6f85ed in _tevent_loop_once () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#11 0x00007f6e5fe225ca in smbd_process (ev_ctx=0x7f6e6149dd90, msg_ctx=<optimized out>, sock_fd=<optimized out>,
    interactive=<optimized out>) at ../source3/smbd/process.c:3626
        frame = 0x7f6e614b65f0
        conn = <optimized out>
        sconn = <optimized out>
        ss = {ss_family = 2, __ss_align = 0,
          __ss_padding = "\000\000\000\000\000\000\000\000\200\336Ian\177\000\000\000\000\000\000\000\000\000\000\016\371^,\233\315\337\023\"\000\000\000\000\000\000\000Wug`n\177\000\000\001\000\000\000n\177\000\000\000\000\000\000\000\000\000\000\200\336Ian\177\000\000\b|\322_n\177\000\000\000\000\000\000\000\000\000\000\"\000\000\000\000\000\000\000\220\335Ian\177\000\000\025\345g`n\177\000"}
        sa = 0x7fff3ffe2ff0
        sa_socklen = 16
---Type <return> to continue, or q <return> to quit---
        local_address = 0x7f6e6149f640
        remote_address = 0x7f6e6149d5e0
        locaddr = <optimized out>
        remaddr = <optimized out>
        rhost = 0x0
        ret = <optimized out>
        __FUNCTION__ = "smbd_process"
#12 0x00007f6e60896fa4 in smbd_accept_connection (ev=0x7f6e6149dd90, fde=<optimized out>, flags=<optimized out>,
    private_data=<optimized out>) at ../source3/smbd/server.c:621
        status = <optimized out>
        s = 0x0
        msg_ctx = 0x7f6e6149de80
        addr = {ss_family = 2, __ss_align = 0,
          __ss_padding = '\000' <repeats 40 times>, "\220\335Ian\177\000\000(]Jan\177\000\000\340\027Jan\177\000\000\000\000\000\000\000\000\000\000\200\312Ian\177\000\000\005\000\000\000\000\000\000\000\"\000\000\000\000\000\000\000\005\000\000\000\000\000\000\000\260\313Jan\177\000"}
        in_addrlen = 16
        fd = 34
        pid = 0
        unique_id = 1432089272875153678
        __FUNCTION__ = "smbd_accept_connection"
#13 0x00007f6e5ed200ac in run_events_poll (ev=0x7f6e6149dd90, pollrtn=<optimized out>, pfds=0x7f6e614acbb0, num_pfds=5)
    at ../source3/lib/events.c:257
---Type <return> to continue, or q <return> to quit---
        pfd = <optimized out>
        flags = <optimized out>
        state = <optimized out>
        pollfd_idx = 0x7f6e6149dfb0
        fde = 0x7f6e614ae6a0
        pollrtn = <optimized out>
        num_pfds = 5
        pfds = 0x7f6e614acbb0
        ev = 0x7f6e6149dd90
#14 0x00007f6e5ed20300 in s3_event_loop_once (ev=0x7f6e6149dd90, location=<optimized out>) at ../source3/lib/events.c:326
        state = 0x7f6e6149ca80
        timeout = 59999
        num_pfds = 5
        poll_errno = 4
#15 0x00007f6e5d6f85ed in _tevent_loop_once () from /usr/lib/x86_64-linux-gnu/libtevent.so.0
No symbol table info available.
#16 0x00007f6e60893b8b in smbd_parent_loop (parent=<optimized out>, ev_ctx=0x7f6e6149dd90) at ../source3/smbd/server.c:943
        ret = <optimized out>
        frame = 0x7f6e6149f7b0
#17 main (argc=<optimized out>, argv=<optimized out>) at ../source3/smbd/server.c:1577
        is_daemon = <optimized out>
        interactive = <optimized out>
        Fork = false
---Type <return> to continue, or q <return> to quit---
        no_process_group = 240
        log_stdout = <optimized out>
        ports = 0x0
        profile_level = 0x0
        opt = <optimized out>
        pc = <optimized out>
        print_build_options = 128
        long_options = {{longName = 0x0, shortName = 0 '\000', argInfo = 4, arg = 0x7f6e5dd19340 <poptHelpOptions>, val = 0,
            descrip = 0x7f6e608990f2 "Help options:", argDescrip = 0x0}, {longName = 0x7f6e60899100 "daemon", shortName = 68 'D',
            argInfo = 0, arg = 0x0, val = 1000, descrip = 0x7f6e60899107 "Become a daemon (default)", argDescrip = 0x0}, {
            longName = 0x7f6e60899121 "interactive", shortName = 105 'i', argInfo = 0, arg = 0x0, val = 1001,
            descrip = 0x7f6e60899bf0 "Run interactive (not a daemon)", argDescrip = 0x0}, {longName = 0x7f6e6089912d "foreground",
            shortName = 70 'F', argInfo = 0, arg = 0x0, val = 1002,
            descrip = 0x7f6e60899c10 "Run daemon in foreground (for daemontools, etc.)", argDescrip = 0x0}, {
            longName = 0x7f6e60899138 "no-process-group", shortName = 0 '\000', argInfo = 0, arg = 0x0, val = 1003,
            descrip = 0x7f6e60899c48 "Don't create a new process group", argDescrip = 0x0}, {
            longName = 0x7f6e60899149 "log-stdout", shortName = 83 'S', argInfo = 0, arg = 0x0, val = 1004,
            descrip = 0x7f6e60899154 "Log to stdout", argDescrip = 0x0}, {longName = 0x7f6e60899162 "build-options",
            shortName = 98 'b', argInfo = 0, arg = 0x0, val = 98, descrip = 0x7f6e60899170 "Print build options",
            argDescrip = 0x0}, {longName = 0x7f6e60899184 "port", shortName = 112 'p', argInfo = 1, arg = 0x7fff3ffe32d0, val = 0,
            descrip = 0x7f6e60899189 "Listen on the specified ports", argDescrip = 0x0}, {
            longName = 0x7f6e608991a7 "profiling-level", shortName = 80 'P', argInfo = 1, arg = 0x7fff3ffe32d8, val = 0,
            descrip = 0x7f6e608991b7 "Set profiling level", argDescrip = 0x7f6e608991cb "PROFILE_LEVEL"}, {longName = 0x0,
---Type <return> to continue, or q <return> to quit---
            shortName = 0 '\000', argInfo = 4, arg = 0x7f6e5f38e6e0 <popt_common_samba>, val = 0,
            descrip = 0x7f6e608991d9 "Common samba options:", argDescrip = 0x0}, {longName = 0x0, shortName = 0 '\000',
            argInfo = 4, arg = 0x7f6e5f38daa0 <popt_common_dynconfig>, val = 0,
            descrip = 0x7f6e60899c70 "Build-time configuration overrides:", argDescrip = 0x0}, {longName = 0x0,
            shortName = 0 '\000', argInfo = 0, arg = 0x0, val = 0, descrip = 0x0, argDescrip = 0x0}}
        parent = 0x7f6e614a17e0
        frame = <optimized out>
        status = <optimized out>
        ev_ctx = 0x7f6e6149dd90
        msg_ctx = 0x7f6e6149de80
        server_id = {pid = 3902, task_id = 0, vnn = 4294967295, unique_id = 10783271978525084460}
        se = <optimized out>
        np_dir = <optimized out>
        smbd_shim_fns = {cancel_pending_lock_requests_by_fid = 0x7f6e5fe0c320 <smbd_cancel_pending_lock_requests_by_fid>,
          send_stat_cache_delete_message = 0x7f6e5fe11e20 <smbd_send_stat_cache_delete_message>,
          change_to_root_user = 0x7f6e5fdfb370 <smbd_change_to_root_user>,
          contend_level2_oplocks_begin = 0x7f6e5fe57970 <smbd_contend_level2_oplocks_begin>,
          contend_level2_oplocks_end = 0x7f6e5fe57ad0 <smbd_contend_level2_oplocks_end>,
          become_root = 0x7f6e5fdfb450 <smbd_become_root>, unbecome_root = 0x7f6e5fdfb480 <smbd_unbecome_root>,
          exit_server = 0x7f6e5fe50bd0 <smbd_exit_server>, exit_server_cleanly = 0x7f6e5fe50bf0 <smbd_exit_server_cleanly>}
        __FUNCTION__ = "main"
(gdb)
(gdb)
(gdb) quit