Linux and RDP have had performance and security issues for as long as I can remember and Apache Guacamole solves most of them ...
Google has patched an Android ADB bug in the May security patch set. If you have a Pixel phone you should already have the patches, and most other major manufacturers should be close behind.