Passives can be disabled and buffs can be stolen, so it doesn't matter at all.
So which Lord is good for farming, especially for the use in the color restricted dungeons?
Blue Lord of Light inflicts aoe Doom and Dark Ghost with his basic. He's much better to get than red one.