Cool project! Your PCB sounds awesome.
Yes I am sharing the 5V between the Tello and Raspberry Pi. I haven't had any issues with this.
What do you mean by bypassing the wifi connection? Do you mean sending motor commands to the Tello motor drivers or sending desired pitch, roll, yaw angles...