Nelson born outside right Enos Whittaker began his football career with Walverden United in 1905 at the age of 16 and a year later signed for hometown club Nelson where he went straight into their first team, although he spent much of his stay there in their Lancashire League side. In 1909 he joined for Haslingden, from where he signed for Southern League Exeter City in the 1910 close season. He made his first team debut for The Grecians in a Southern League match against Bristol Rovers in December 1910, scoring once in 9 appearances before the end of the season.
Whittaker was described as a youngster of much promise, of good build and a remarkable turn of speed. His second season at the club proved to be his most successful, featuring in 24 Southern League matches, scoring twice more, before joining Birmingham & District League Stoke in the summer of 1912, where he scored once in 16 first team appearances during 1912-13. He then joined Clapton Orient in 1913, but never appeared for The O’s first eleven before leaving the professional game.