This does occasionally happen when Relative Level Matching (RLM) is enabled and shipping preferences are similar.

Since you have already been matched in the exchange you would not be able to change your match.  Support can, however, make it that you cannot match with them in the future.

All you need to do is submit a support ticket with your nickname and the nickname of the user you would not like to match with.