When you upload a target image, the platform will automatically convert it into the black and white palette, which is why the colors themselves do not play any role in recognition and tracking.
At the same time, the difference between the tones does help the system to find more tracking points in your image. High tonal ranges with distinct transitions between elements improve tracking performance, while gradients and low tonal ranges might degrade it.
Compare the images below: