The second son of Hercules Sharpe, the artist was educated at Harrow. After leaving Cambridge where he read Maths he decided to become an artist and studied in Rome for three years. On the death of his elder brother he inherited the Brabazon estates (and name) in Ireland. He spent his summers in England and his winters travelling in Europe and, from the 1860s, further afield. The artist visited India three times, in 1870, 1875 and 1876.

In 1891 Sargent persuaded him to have an exhibition at the Goupil Gallery and, as a result, in his old age he was at the forefront of the modern movement.