How to send mouse clicks and keyboard input to a VMware VM from external Python script?

[olips59]

Hello,
I have a Windows 10 host machine running VMware Workstation with a virtual machine (VM) inside it. I run a game inside the VMware VM, and I want to perform simple visual recognition, mouse clicks, and keyboard actions inside the VM from my Windows 10 host using Python. However, I have tried popular Python libraries like pyautogui, pynput, keyboard, and mouse, but mouse movements and clicks do not get passed into the VMware VM.

Is there a reliable way to send mouse clicks and keyboard input into the VMware VM from a Python script running externally on the host machine?

Thanks in advance.

[aLBInOS1]

1. VMware VIX API - The most reliable option

import vix
host = vix.VixHost()
vm = host.open_vm("path/to/vm.vmx")
vm.login("username", "password")
vm.run_program("/path/to/script.exe")

2. RDP/SSH - Connect directly using Python libraries like pyrdp or paramiko

[olips59]

I understand that VIX API and RDP are useful for things like running programs, but what I'm trying to do is a bit different. I need to detect an image on the screen and click on that spot with the mouse. These methods don’t seem to be enough for tasks like clicking or image recognition.

Is there another way to achieve this? Do you know of any other method that could work?