Bug 3641 - samba Process Not Getting Killed
samba Process Not Getting Killed
Status: NEW
Product: Samba 3.0
Classification: Unclassified
Component: File Services
3.0.21c
Other Linux
: P3 normal
: none
Assigned To: Samba Bugzilla Account
Samba QA Contact
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2006-03-29 06:12 UTC by M.R.Niranjan
Modified: 2011-05-15 13:15 UTC (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description M.R.Niranjan 2006-03-29 06:12:05 UTC
Hi all

We have Samba PDC with OpenLDAP (samba 3.0.21c openldap 2.3.19) . we have another linux system which is
acting as Domain member server( samba 3.0.21c) . On the domain member server we
have declared some  shares  which get mapped to my win2k clients as drives.
when client access the share declared in Domain Member Server, the samba creates smbd process by the user id
After client closes the shares and logs off , the smbd process created by that users still exists and never gets killed 
and about 100 smbd process are getting created there by samba getting hanged and unable to process the client requests.

The following is the ps -aux | grep smbd | grep testuser

output of smbd process by a user named "testuser"
###############################################################################################
testuser   12844  0.0  0.4 14804 4696 ?        S    13:33   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   12845  0.0  0.4 14760 4828 ?        S    13:34   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   12998  0.0  0.4 14808 4652 ?        R    13:42   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13009  0.0  0.4 14772 4452 ?        S    13:44   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13348  0.0  0.4 14784 4292 ?        S    14:55   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13392  0.0  0.4 14792 4604 ?        S    14:57   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13418  0.0  0.4 14792 4508 ?        S    14:59   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13454  0.0  0.4 14832 4428 ?        S    15:05   0:00 /usr/local/samba3c2/sbin/smbd -D
testuser   13854  0.0  0.4 14888 4492 ?        S    15:57   0:00 /usr/local/samba3c2/sbin/smbd -D
###############################################################################################

The above output is of the smbd process of the  user "testuser" which got created when the user first accessed the
shares . but when the user logged off and did not login in any system nor anybody has accessed the share.
but still the above process still remains and never gets killed.

The following is the output of the ps -aux | grep smbd
#############################################################################################
root      2324  0.0  0.3 14108 3656 ?        Ss   Mar25   0:00 /usr/local/samba3c2/sbin/smbd -D
root      2348  0.0  0.3 14476 4036 ?        S    Mar25   0:00 /usr/local/samba3c2/sbin/smbd -D
kk5535   11581  0.0  0.4 14576 4632 ?        S    09:04   0:00 /usr/local/samba3c2/sbin/smbd -D
mp1414   11604  0.0  0.4 14876 4944 ?        S    09:11   0:02 /usr/local/samba3c2/sbin/smbd -D
root     11616  0.0  0.4 14896 4880 ?        S    09:17   0:02 /usr/local/samba3c2/sbin/smbd -D
root     11657  0.0  0.4 14788 4660 ?        S    09:31   0:01 /usr/local/samba3c2/sbin/smbd -D
pk383    11835  0.0  0.4 14708 4612 ?        S    10:09   0:00 /usr/local/samba3c2/sbin/smbd -D
sv234    11847  0.0  0.4 14576 4492 ?        S    10:14   0:00 /usr/local/samba3c2/sbin/smbd -D
sv234    11978  0.0  0.4 14912 4808 ?        S    10:34   0:00 /usr/local/samba3c2/sbin/smbd -D
sv234    11981  0.0  0.4 14576 4360 ?        S    10:35   0:00 /usr/local/samba3c2/sbin/smbd -D
root     11987  0.0  0.4 14736 4544 ?        S    10:42   0:00 /usr/local/samba3c2/sbin/smbd -D
pk383    11989  0.0  0.4 14576 4412 ?        S    10:46   0:00 /usr/local/samba3c2/sbin/smbd -D
root     12008  0.0  0.4 14732 4896 ?        S    11:00   0:01 /usr/local/samba3c2/sbin/smbd -D
root     12061  0.0  0.4 14652 4492 ?        S    11:23   0:00 /usr/local/samba3c2/sbin/smbd -D
root     12065  0.0  0.4 14844 4880 ?        S    11:28   0:04 /usr/local/samba3c2/sbin/smbd -D
root     12548  0.0  0.4 14920 4680 ?        S    13:13   0:00 /usr/local/samba3c2/sbin/smbd -D
yc1426   12651  0.0  0.4 14776 4640 ?        S    13:20   0:00 /usr/local/samba3c2/sbin/smbd -D
root     12652  0.0  0.4 14996 4860 ?        S    13:20   0:01 /usr/local/samba3c2/sbin/smbd -D
kr1233   12844  0.0  0.4 14804 4696 ?        S    13:33   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   12845  0.0  0.4 14760 4828 ?        S    13:34   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   12998  0.0  0.4 14808 4652 ?        S    13:42   0:00 /usr/local/samba3c2/sbin/smbd -D
1144     13001  0.0  0.4 14788 4776 ?        S    13:43   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13009  0.0  0.4 14772 4452 ?        S    13:44   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13012  0.0  0.4 15012 4756 ?        S    13:45   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13015  0.0  0.4 14640 4412 ?        S    13:45   0:00 /usr/local/samba3c2/sbin/smbd -D
gr249    13059  0.0  0.4 14800 4624 ?        S    14:09   0:00 /usr/local/samba3c2/sbin/smbd -D
gr249    13066  0.0  0.4 14868 4628 ?        S    14:12   0:00 /usr/local/samba3c2/sbin/smbd -D
gr249    13069  0.0  0.4 14840 4568 ?        S    14:13   0:00 /usr/local/samba3c2/sbin/smbd -D
sf1537   13070  0.0  0.4 14748 4700 ?        S    14:13   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13076  0.0  0.4 14712 4372 ?        S    14:16   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13078  0.0  0.4 14692 4180 ?        S    14:19   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13082  0.0  0.3 14652 4072 ?        S    14:20   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13087  0.0  0.4 14908 4868 ?        S    14:21   0:01 /usr/local/samba3c2/sbin/smbd -D
ns1354   13098  0.1  0.4 14920 4468 ?        S    14:27   0:13 /usr/local/samba3c2/sbin/smbd -D
gr249    13102  0.0  0.4 14852 4660 ?        S    14:28   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13116  0.0  0.4 14888 4816 ?        S    14:30   0:01 /usr/local/samba3c2/sbin/smbd -D
ps1152   13166  0.0  0.4 14748 4592 ?        S    14:38   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13199  0.0  0.4 14736 4448 ?        S    14:44   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13199  0.0  0.4 14736 4448 ?        S    14:44   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13200  0.0  0.4 14760 4604 ?        S    14:45   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13209  0.0  0.4 14892 4736 ?        S    14:46   0:00 /usr/local/samba3c2/sbin/smbd -D
sf1537   13226  0.0  0.3 14696 4068 ?        S    14:48   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13228  0.0  0.4 15032 4860 ?        S    14:48   0:00 /usr/local/samba3c2/sbin/smbd -D
rr5534   13229  0.0  0.4 14956 4800 ?        S    14:48   0:01 /usr/local/samba3c2/sbin/smbd -D
sf1537   13246  0.0  0.4 14796 4636 ?        S    14:49   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13250  0.0  0.4 14896 4628 ?        S    14:50   0:01 /usr/local/samba3c2/sbin/smbd -D
ps1152   13257  0.0  0.3 14704 4080 ?        S    14:50   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   13264  0.0  0.4 14812 4680 ?        S    14:51   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13275  0.0  0.3 14712 4076 ?        S    14:52   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1152   13328  0.0  0.3 14712 4092 ?        S    14:53   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13348  0.0  0.4 14784 4292 ?        S    14:55   0:00 /usr/local/samba3c2/sbin/smbd -D
vs104    13385  0.0  0.4 14928 4744 ?        S    14:56   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13392  0.0  0.4 14792 4604 ?        S    14:57   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13418  0.0  0.4 14792 4508 ?        S    14:59   0:00 /usr/local/samba3c2/sbin/smbd -D
ns1354   13438  0.0  0.3 14744 4052 ?        S    15:01   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13443  0.0  0.4 14980 4436 ?        S    15:02   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13444  0.0  0.4 14856 4396 ?        S    15:03   0:00 /usr/local/samba3c2/sbin/smbd -D
vs104    13446  0.0  0.4 14808 4172 ?        S    15:04   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13454  0.0  0.4 14832 4428 ?        S    15:05   0:00 /usr/local/samba3c2/sbin/smbd -D
vs104    13457  0.0  0.4 14816 4444 ?        S    15:06   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13459  0.0  0.3 14752 4084 ?        S    15:08   0:00 /usr/local/samba3c2/sbin/smbd -D
vs104    13465  0.0  0.4 14816 4272 ?        S    15:08   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1482   13474  0.0  0.4 14816 4272 ?        S    15:08   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13477  0.0  0.3 14776 4092 ?        S    15:09   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13481  0.0  0.4 14840 4464 ?        S    15:10   0:00 /usr/local/samba3c2/sbin/smbd -D
ps1482   13493  0.0  0.3 14784 4044 ?        S    15:10   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13511  0.0  0.3 14784 4072 ?        S    15:11   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13533  0.0  0.3 14784 4076 ?        S    15:13   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13544  0.0  0.4 14864 4528 ?        S    15:15   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13545  0.0  0.3 14792 4092 ?        S    15:15   0:00 /usr/local/samba3c2/sbin/smbd -D
bc17     13546  0.0  0.3 14792 4104 ?        S    15:16   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13547  0.0  0.4 14888 4508 ?        S    15:16   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13559  0.0  0.4 14888 4536 ?        S    15:18   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13601  0.0  0.4 14900 4736 ?        S    15:25   0:00 /usr/local/samba3c2/sbin/smbd -D
dcadmin  13623  0.0  0.4 14888 4608 ?        S    15:31   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   13624  0.0  0.4 14888 4676 ?        S    15:31   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13811  0.0  0.4 14868 4348 ?        S    15:51   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13835  0.0  0.3 14804 4068 ?        S    15:53   0:00 /usr/local/samba3c2/sbin/smbd -D
kr1233   13854  0.0  0.4 14888 4492 ?        S    15:57   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13855  0.0  0.4 14888 4424 ?        S    15:57   0:00 /usr/local/samba3c2/sbin/smbd -D
mr3409   13920  0.0  0.3 14804 4064 ?        S    16:01   0:00 /usr/local/samba3c2/sbin/smbd -D
root     13932  0.0  0.4 14932 4572 ?        S    16:02   0:00 /usr/local/samba3c2/sbin/smbd -D
nv538    13959  0.0  0.4 15056 4708 ?        S    16:07   0:01 /usr/local/samba3c2/sbin/smbd -D
gr249    14257  0.0  0.4 15044 4848 ?        S    16:18   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14299  0.0  0.4 14912 4296 ?        S    16:25   0:00 /usr/local/samba3c2/sbin/smbd -D
locuz    14311  0.0  0.4 14888 4440 ?        R    16:27   0:00 /usr/local/samba3c2/sbin/smbd -D
locuz    14324  0.0  0.4 14888 4428 ?        S    16:29   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14671  0.0  0.3 14804 4100 ?        S    16:35   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14672  0.0  0.4 14868 4220 ?        S    16:35   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14673  0.0  0.4 14932 4584 ?        S    16:35   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14679  0.0  0.4 14904 4616 ?        S    16:36   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14686  0.0  0.4 14840 4196 ?        S    16:38   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14687  0.0  0.4 14916 4636 ?        S    16:38   0:00 /usr/local/samba3c2/sbin/smbd -D
rr5534   14696  0.0  0.3 14832 4136 ?        R    16:40   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   14697  0.0  0.4 14896 4524 ?        S    16:41   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14698  0.0  0.4 14912 4484 ?        S    16:41   0:00 /usr/local/samba3c2/sbin/smbd -D
rr5534   14699  0.0  0.4 14904 4472 ?        S    16:41   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14705  0.0  0.3 14812 4080 ?        S    16:42   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   14709  0.0  0.4 14856 4228 ?        S    16:44   0:00 /usr/local/samba3c2/sbin/smbd -D
rr5534   14712  0.0  0.4 14940 4624 ?        S    16:44   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14713  0.0  0.4 14900 4148 ?        S    16:44   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14714  0.0  0.3 14864 4052 ?        S    16:45   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   14715  0.0  0.4 14928 4480 ?        S    16:45   0:00 /usr/local/samba3c2/sbin/smbd -D
mt1532   14716  0.0  0.3 14864 4092 ?        S    16:45   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14747  0.0  0.4 14936 4344 ?        S    16:46   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14751  0.0  0.3 14852 4060 ?        S    16:47   0:00 /usr/local/samba3c2/sbin/smbd -D
sa8084   14881  0.0  0.4 14872 4264 ?        S    16:48   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14886  0.0  0.4 14956 4204 ?        S    16:49   0:00 /usr/local/samba3c2/sbin/smbd -D
root     14904  0.0  0.0  5352  688 tty1     S+   16:50   0:00 grep smbd
######################################################################################

the following is the smb.conf file of the domain member server
#####################################################################################
[global]

 unix charset = LOCALE
 workgroup = msdpl.com
 netbios name = prjsrv01
 server string = Project Server 1
 printcap name = /etc/printcap
 load printers = yes
 cups options = raw
 log level = 2
 log file = /usr/local/samba-3c/var/%U.%m.log
 syslog = 0
 max log size = 100
 smb ports = 139
 security = domain
 username map = /usr/local/samba-3c/lib/smbusers
 socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192
 name resolve order = wins bcasts hosts
 wins server = 192.168.129.20
 dns proxy = no
 ldap server = 192.168.129.20
 ldap suffix = dc=msdpl,dc=com
 ldap machine suffix = ou=Computers
 ldap user suffix = ou=People
 ldap group suffix = ou=Groups
 ldap idmap suffix = ou=Idmap
 ldap admin dn = cn=manager,dc=msdpl,dc=com
 ldap ssl = no
 ldap timeout = 50
 acl check permissions = Yes
 template shell = /bin/false
 winbind use default domain = no
 inherit permissions = yes
 inherit acls = yes
 nt acl support = yes
 hide dot files = yes
#######################################Share Definations########################################
 [homes]
   comment = Home Directories
   valid users = %S
   browseable = no
   writable = yes
   veto files = /.bash_history/.bash_logout/.bash_profile/.bashrc/.canna/.emacs/.gtkrc/.kde/.viminfo/.xemacs/.zshrc/
   hide dot files = yes

[printers]
   comment = All Printers
   path = /var/spool/samba
   browseable = no
   guest ok = no
   writable = no
   printable = yes

 [projects]
 comment = All Projects
 path = /projects
 browseable = no
 guest ok = no
 writeable = yes
 printable = no
 veto files = desktop.ini/lost+found/.Trash-root/*.sh/*.scr/.recycle/
 create mode = 2700
 force create mode = 0700
 force directory mode = 0700
 inherit permissions = yes
 inherit acls = yes
 vfs objects = recycle
######################################################################################

Please Guide me,

Regards
Niranjan
Comment 1 M.R.Niranjan 2006-03-31 22:29:06 UTC
The following is the backtrace when there are about 164 processes. 
##########################################################
(gdb) attach 2955
Attaching to process 2955
Reading symbols from /usr/local/samba3c3/sbin/smbd...done.
Using host libthread_db library "/lib/tls/libthread_db.so.1".
Loaded symbols for /usr/local/samba3c3/sbin/smbd
Reading symbols from /usr/lib/libldap-2.2.so.7...done.
Loaded symbols for /usr/lib/libldap-2.2.so.7
Reading symbols from /usr/lib/liblber-2.2.so.7...done.
Loaded symbols for /usr/lib/liblber-2.2.so.7
Reading symbols from /usr/lib/libgssapi_krb5.so.2...done.
Loaded symbols for /usr/lib/libgssapi_krb5.so.2
Reading symbols from /usr/lib/libkrb5.so.3...done.
Loaded symbols for /usr/lib/libkrb5.so.3
Reading symbols from /usr/lib/libk5crypto.so.3...done.
Loaded symbols for /usr/lib/libk5crypto.so.3
Reading symbols from /lib/libcom_err.so.2...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /lib/libresolv.so.2...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /usr/lib/libcups.so.2...done.
Loaded symbols for /usr/lib/libcups.so.2
Reading symbols from /lib/libssl.so.4...done.
Loaded symbols for /lib/libssl.so.4
Reading symbols from /lib/libcrypto.so.4...done.
Loaded symbols for /lib/libcrypto.so.4
Reading symbols from /lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libcrypt.so.1...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /lib/libpam.so.0...done.
Loaded symbols for /lib/libpam.so.0
Reading symbols from /lib/libattr.so.1...done.
Loaded symbols for /lib/libattr.so.1
Reading symbols from /lib/libacl.so.1...done.
Loaded symbols for /lib/libacl.so.1
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/tls/librt.so.1...done.
Loaded symbols for /lib/tls/librt.so.1
Reading symbols from /usr/lib/libpopt.so.0...done.
Loaded symbols for /usr/lib/libpopt.so.0
Reading symbols from /lib/tls/libc.so.6...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /usr/lib/libsasl2.so.2...done.
Loaded symbols for /usr/lib/libsasl2.so.2
Reading symbols from /usr/lib/libz.so.1...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/tls/libpthread.so.0...done.
[Thread debugging using libthread_db enabled]
[New Thread -1208101184 (LWP 2955)]
Loaded symbols for /lib/tls/libpthread.so.0
Reading symbols from /usr/lib/gconv/UTF-16.so...done.
Loaded symbols for /usr/lib/gconv/UTF-16.so
Reading symbols from /usr/lib/gconv/IBM850.so...done.
Loaded symbols for /usr/lib/gconv/IBM850.so
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libnss_ldap.so.2...done.
Loaded symbols for /lib/libnss_ldap.so.2
0x001117a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
(gdb) bt
#0  0x001117a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0025950d in ___newselect_nocancel () from /lib/tls/libc.so.6
#2  0x00d91b0d in sys_select (maxfd=23, readfds=0xbfec4040, writefds=0x0, errorfds=0x0, tval=0x0)
    at lib/select.c:93
#3  0x00e3184c in open_sockets_smbd (is_daemon=1, interactive=0, smb_ports=0x0)
    at smbd/server.c:350
#4  0x00e32bdd in main (argc=2, argv=0xbfec5414) at smbd/server.c:916
(gdb) quit
##########################################################
Comment 2 Gerald (Jerry) Carter 2006-04-10 07:12:33 UTC
Is this back trace for one of the processes running as root?  or 
as testuser?  The one we are niterested in is the non-root process.
Comment 3 M.R.Niranjan 2006-04-10 22:51:00 UTC
(In reply to comment #2)
> Is this back trace for one of the processes running as root?  or 
> as testuser?  The one we are niterested in is the non-root process.
> 

Hi

The back trace was of the parent process created by root

Regards
Niranjan
Comment 4 Gerald (Jerry) Carter 2006-04-20 08:03:41 UTC
severity should be determined by the developers and not the reporter.
Comment 5 Gerald (Jerry) Carter 2006-04-20 08:32:16 UTC
you need to see where the non-root process is stuck.
Comment 6 Mayuk De 2011-05-15 13:15:33 UTC
Do these lingering smbd processes respond to "smbcontrol ping"?