Ultrafast quantum gates with fully quantized free-electron quantum optics