Characters in Sherlock Holmes series are connected with the British Empire that controlled the land and the people of uncivilized countries. The characters return to their homeland with dismally distorted figures, or with fame and riches acquired from the conquered. Conan Doyle shows his cool-headed attitude towards two distinctive groups. In the novels, any people included these two groups is not saved from their wicked acts in the uncivilized country, England. Doyle’s objective stance towards cases comes from his belief in British Empire. He believed that, though British Empire suffered from some difficulties coming from the management of the empire, the difficulties should not affect the tranquil lives of England. With the belief in the stability of British, two group’s characters, victims and murderers, should be removed in the world of Sherlock Holmes.