Job assignment and hates/dislikes lasting for years

I accidently did not realize I would really upset a character when I assigned them a job task in the job list.  I found out with a huge hate for 1 year.  I thought it was like the items (red just meant they did not like it as much as other items but not a hate you for giving it to them)  So I unassigned it and the hate stayed.  Maybe have the upset/hate leave when the job assignment is removed from their list?  Seems like a huge grudge to have when they only had it assigned for less than an hour and actually never did the task!