I can only recommend hard-wiring the xbox - the wifi card must be the cost saver, it doesn’t work properly...
I had the same issue for the last couple years and tried everything - literally everything you can find on the web. Sometimes it felt like it was getting better, but i think i was just fooling myself.
The only thing that can help you is a lan cable, trust me, unfortunately