| 15 Apr 2024 |
 adamcstephens | right | 16:56:13 |
| 16 Apr 2024 |
 hexa | ok | 12:11:18 |
| hexa | killed ipv4 on the ceph cluster, reoboted, tada | 12:11:24 |
| hexa | 
Download image.png | 12:13:57 |
| adamcstephens | so ipv4 was doing something weird? | 12:58:33 |
| hexa | 0.0.0.0 addresses in the osdmap, multiples actually | 13:00:43 |
| hexa | and that confused the kernel's libceph driver | 13:00:56 |
| 17 Apr 2024 |
| hexa | I hot-added CPU cores to a VM … wow 😄 | 09:39:08 |
| hexa | htop shows them as offlien thought, so I wonder if our nixos image is missing anything | 09:39:19 |
| hexa | oofff | 10:11:50 |
| hexa | # incus move test --target incus2.karo.tu.da.man-da.net
Error: Migration operation failure: Instance move to destination failed: Error transferring instance data: Failed migration on target: Failed restoring checkpoint from source: Monitor is disconnected
root@incus1.karo.tu.da:~# incus list
+------+---------+------+------+-----------------+-----------+------------------------------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS | LOCATION |
+------+---------+------+------+-----------------+-----------+------------------------------+
| test | STOPPED | | | VIRTUAL-MACHINE | 0 | incus1.karo.tu.da.man-da.net |
+------+---------+------+------+-----------------+-----------+------------------------------+
| 10:11:57 |
| hexa | wow | 10:14:59 |
| hexa | # incus move test --target incus2.karo.tu.da.man-da.net
Error: Migration operation failure: Instance move to destination failed on source: Failed migration on source: Failed stopping instance: Failed unmounting instance: Failed to run: rbd --id admin --cluster ceph --pool incus_rbd unmap virtual-machine_test: exit status 16 (rbd: sysfs write failed
rbd: unmap failed: (16) Device or resource busy)
root@incus1.karo.tu.da:~# incus list
+------+---------+------+------+-----------------+-----------+------------------------------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS | LOCATION |
+------+---------+------+------+-----------------+-----------+------------------------------+
| test | STOPPED | | | VIRTUAL-MACHINE | 0 | incus1.karo.tu.da.man-da.net |
+------+---------+------+------+-----------------+-----------+------------------------------+
| 10:15:02 |
| hexa | but the VM is actually up | 10:15:35 |
| hexa | and was migrated to incus2 | 10:15:56 |
| hexa | 🫠 | 10:15:58 |
| adamcstephens | Yeah we may be missing CPU hotplug | 11:02:30 |
| hexa | I'll file an issue for that as well | 11:15:42 |
| adamcstephens | I suspect that one is on our end | 11:25:17 |
| hexa | Yep | 11:35:11 |
| adamcstephens | Probably an easy one to add a test for too :) | 12:31:05 |
| hexa | SUBSYSTEM=="cpu", ACTION=="add", TEST=="online", ATTR{online}=="0", ATTR{online}="1"
| 15:11:39 |
| adamcstephens | ahh so just a udev rule | 15:27:40 |
| adamcstephens | does memory hot add work or do we need something similar? | 15:27:51 |
| hexa | that works | 15:32:17 |
| hexa | 4GB -> 2GB -> 4GB tested | 15:32:25 |
| adamcstephens | cool | 15:32:29 |
| adamcstephens | so this is just CPU, and just for VMs? | 15:32:37 |
| adamcstephens | i'm done grading now so i can actually just test it myself :) | 15:32:57 |
| hexa | yes | 15:33:13 |
