耿耿於懷

Idiom

 * 1) to brood on; to not forget about a matter and always be troubled or vexed by it