Perceptions of procedural fairness influence the legitimacy of the law and because procedures are mutable, reforming them can buttress support for the rule of law. Yet legal authorities have recently faced a distinct challenge: accusations of impropriety based on their ascriptive characteristics (e.g., gender, ethnicity). We study the effect of these traits in the context of the U.S. legal system, focusing on the conditions under which citizens perceive female and minority judges as exhibiting impropriety and how this compares with perceptions of their white and male counterparts. We find that Americans use a judge’s race and gender to make inferences about which groups the judge favors, whether she is inherently biased, and whether she should recuse. Notably, we find drastically different evaluations of female and Hispanic judges among the political right and left.