Nonlinear Energy Sinks (NESs) have been proposed for passively reducing the amplitude of vibrations in different types of structures. The main advantage of NES over traditional Tuned Mass Dampers (TMDs) lies in its capability to redistribute the vibrating energy inside a primary structure, what effectively reduces the amplitude of the structure oscillations over a wide range of frequencies. However, the performance of an NES can be substantially affected even by small variations on input energy as in the case of buildings under seismic ground excitation. In this work it is shown that the NES energy sensibility can be significantly reduced by properly selecting the NES damping coefficient. A three stories shear building model subject to seismic ground excitation is used to numerically study the effect that NES damping has on its vibration reduction performance.