In the Gospels, Jesus teaches us to judge a man by his fruit. This does not mean that we judge him by his activity, but that we judge his activity by what that activity produces. This is also what he meant when he said, “I search heart and mind, yet I render to each according to his work.” God does not judge by our busyness, but by the value of our business.
Activity is good or bad based on what lasting effect comes after. While it is wrong to condemn any person, we can always judge any fruits of labor.