Diller was an old-time banjo player from Pocahontas County. Inspired by local musicians such as Hamp Carpenter and the Hammons family, Diller dedicated his life to preserving traditional mountain music. He taught banjo and performed at festivals across West Virginia and the country.

In the 1970s, he also became a minister, believing his mission was to teach music as a way to inspire others. Diller recorded 15 albums, created a banjo DVD set, and taught at camps in Pocahontas County and abroad. In 2019, he received the Vandalia Award, the state's highest folklife achievement.

Diller was passionate about passing on the traditions of old-time music and believed that music, like life, should be felt deeply, with its own rhythm and flow.