The all stats don't just provide a bit of wisdom, they give 18-30 points per STAT, that means physical defense from both Power and Stamina, HP from Stamina, attack speed from Agility meaning a faster casting animation, magical defense, attack + hit from Wisdom and Intelligence, heal from both Wisdom and Intelligence, MP from both Wisdom and Intelligence, crit resist from Power, Wisdom and Intelligence and a few other more beneficial things from using an all stat card.
Also bear in mind that all 75+ armours and most 75+ accessories (with the exception of the bf stuff and a couple other commonly used epics) there are 5 slots which means you would normall go for a 3 Wisdom VI and 2 Stamina Vi setup in all pieces? Thats 90 Wisdom and 60 Stamina. 5 all stat IV cards gives a grand total of 90 stats which means in every piece you have your 90 wisdom, 90 Stamina, 90 Power, 90 Agility and 90 Intelligence. You actually WIN if you choose that setup as a Saint (which is your class). If you need the nimble cards for cast speed then ofc you will lose some stats unless you use all stat VI in which case refer to the above.
Evev if you only had all stat iv/v to choose from, I'd still choose 3 all stat iv/v + 2 nimble cards over using a Wisdom/Stamina build.