Question about osd directory
dheatt opened this issue · comments
i tried to run this command :
sudo ceph-volume lvm create --data /dev/vdb
here is the output :
[Running] command: /bin/ceph-authtool --gen-print-key Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new e20021e9-5656-41f9-8386-990620ad3f09 Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/vgcreate --force --yes ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 /dev/vdb stdout: Physical volume "/dev/vdb" successfully created. stdout: Volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" successfully created Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/lvcreate --yes -l 1279 -n osd-block-e20021e9-5656-41f9-8386-990620ad3f09 ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 stdout: Logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" created. Running command: /bin/ceph-authtool --gen-print-key Running command: /bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-2 Running command: /bin/chown -h ceph:ceph /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 Running command: /bin/chown -R ceph:ceph /dev/dm-0 Running command: /bin/ln -s /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 /var/lib/ceph/osd/ceph-2/block Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-2/activate.monmap stderr: got monmap epoch 3 --> Creating keyring file for osd.2 Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2/keyring Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2/ Running command: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 2 --monmap /var/lib/ceph/osd/ceph-2/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-2/ --osd-uuid e20021e9-5656-41f9-8386-990620ad3f09 --setuser ceph --setgroup ceph stderr: 2024-02-04T15:01:58.392+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/) _read_fsid unparsable uuid stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 bdev(0x55bb48825400 /var/lib/ceph/osd/ceph-2//block) open open got: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 OSD::mkfs: ObjectStore::mkfs failed with error (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-2/: (13) Permission denied --> Was unable to complete a new OSD, will rollback changes Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.2 --yes-i-really-mean-it stderr: purged osd.2 --> Zapping: /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 --> Unmounting /var/lib/ceph/osd/ceph-2 Running command: /bin/umount -v /var/lib/ceph/osd/ceph-2 stderr: umount: /var/lib/ceph/osd/ceph-2 unmounted Running command: /bin/dd if=/dev/zero of=/dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 bs=1M count=10 conv=fsync stderr: 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.0468115 s, 224 MB/s --> Only 1 LV left in VG, will proceed to destroy volume group ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/vgremove -v -f ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 stderr: Removing ceph--eb2f5ca0--e04f--4307--997d--5244f8583cf5-osd--block--e20021e9--5656--41f9--8386--990620ad3f09 (253:0) stderr: Archiving volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" metadata (seqno 5). Releasing logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" stderr: Creating volume group backup "/etc/lvm/backup/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" (seqno 6). stdout: Logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" successfully removed stderr: Removing physical volume "/dev/vdb" from volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" stdout: Volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" successfully removed Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/pvremove -v -f -f /dev/vdb stdout: Labels on physical volume "/dev/vdb" successfully wiped. --> Zapping successful for OSD: 2 --> RuntimeError: Command failed with exit code 250: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 2 --monmap /var/lib/ceph/osd/ceph-2/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-2/ --osd-uuid e20021e9-5656-41f9-8386-990620ad3f09 --setuser ceph --setgroup ceph
im pretty sure all the directory and file already chown to ceph.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.
This issue has been automatically closed due to inactivity. Please re-open if this still requires investigation.