I had the same issue. I found another post with the solution:
“It was the contact name that was causing the issue. It needs to be a GUID number.
But thankfully Zapier makes it easy to do a search on the name that i had and returned a GUID number that I used.”
If you do a Xero contact search, the required field is not ‘Contact’ but rather the alpha-numeric “Contact ID”