Aristotelian Virtue Profiling of LLMs through Ethical Dilemmas

Short summary

VirtueMap, a new evaluation framework, measures LLM behavior across five Aristotelian virtues—Practical Wisdom, Justice, Truthfulness, Courage, and Temperance—by ranking responses to ethical dilemmas. Testing nine major LLM families revealed 90.3% rank consistency overall, with the largest differences in Courage, Temperance, and Justice. An interactive website lets users generate their own virtue profiles and compare them directly with measured LLM profiles.

• •Framework uses Aristotelian virtue ethics to systematically evaluate LLM behavior across five ethical dimensions
• •Nine LLM families tested showed 90.3% rank consistency, with largest variation in Courage, Temperance, and Justice scoring
• •Open interactive tool enables users to profile themselves and benchmark against measured LLM profiles

Generated with AI, which can make mistakes.