The Help question

I am looking for a book. There are four people in the book. These four people are wearing different colored clothes. One of the four was a former soldier. One was from a wealthy family, he had a noble speech. The noble one was the soldier's boss. He was playing a noble musical instrument. One of the four was constantly using a fan. He was a mysterious character in the fourth person. The fourth character and the fanned character were friendly. But the fourth person was the soldier and the noble and the enemy. That's all I can remember from the book. Anyone know this books name?