| 31 Jan 2025 |
 adamcstephens | What network setup did you end up with? | 15:46:56 |
 hexa | multichassis link aggregation, where the two L3 switches use EVPN-VXLAN between each other and provide Active/Active Gateways | 15:48:26 |
| hexa | then 2x25G lacp to each host | 15:48:50 |
| hexa | * then redundant\ 2x25G lacp to each host | 15:49:00 |
| hexa | * then redundant 2x25G lacp to each host, with one leg to each switch | 15:49:10 |
| hexa | and then another non-redundant network segment with 10G uplink on each host | 15:50:21 |
| hexa | on the hosts we just use vlans and dumb bridges | 15:50:46 |
| hexa | storage is 4x4 TB zfs on each machine | 15:51:09 |
| hexa | * storage is 4x4 TB zfs raidz on each machine | 15:51:23 |
| adamcstephens | Vlan aware bridges? And attaching VMs the bridge with vlan in the guest config? | 15:52:06 |
| adamcstephens | Or not vlan aware | 15:52:17 |
| hexa | dumb bridges | 15:52:25 |
| hexa | I'm unclear on the benefits of vlan-aware bridging tbh | 15:52:47 |
| adamcstephens | I’m not convinced vlan aware is worth the extra config. Yeah :) | 15:52:52 |
| hexa | I could provide a guest with a more complex network setup | 15:52:57 |
| hexa | but that is nothing we generally do | 15:53:02 |
| adamcstephens | Unless you want to filter on an interface | 15:53:06 |
| hexa | I just pass two interfaces into the guest, if it should be a member of two network segments | 15:53:31 |
| hexa | we also use none of the addressing and dns features that incus provides | 15:53:57 |
| adamcstephens | Is there a bridge per vlan? | 15:54:05 |
| hexa | yes | 15:54:07 |
| adamcstephens | Ahh | 15:54:15 |
| hexa | L3 is usually provided by actual networking gear | 15:54:28 |
| adamcstephens | Right | 15:54:38 |
| hexa | and JunOS beats dnsmasq every day of the week | 15:54:44 |
| hexa | oh and we have a funny gigabit link connected, that leads into a managment vrf | 15:55:21 |
| hexa | kinda like a second default route, that is unlikely to be fucked up | 15:55:35 |
| hexa | that way you can ssh in over two addresses | 15:55:48 |
| hexa | anyway, five to seven years in the future I hope we can find a proper FOSS solution that natively supports EVPN-VXLAN | 15:57:14 |
| adamcstephens | Do you have any Go developers? I bet you could get it added to Incus if you wrote it :) | 15:59:50 |
