Never indicate semantic differences with only color. Always use the trifecta of color, shape, and text. This way, people who can't distinguish colors see shapes and people who can't see shapes can hear text.

Add texture where that's possible.