Barking, Essex born centre half Jimmy Gordon began his football career with Barking Victoria from around 1901 and played for Barking in 1908, featuring in an England amateur international trial, from where he joined the books of Southern League club West Ham United on amateur forms in 1908-09, without making a first team appearance. In December 1909, he joined Grimsby Town and made his Football League debut, still an amateur, in a 4-0 win against Glossop in February 1910, but played just once more before the season end as Grimsby Town lost their League status that June.
Gordon turned professional in May 1910 and he was an ever present in Grimsby Town’s 1910-11 Midland League campaign, when they won the Midland League Championship, and at the end of the season they were re-elected to the Football League. Gordon missed one match in their 1911-12 campaign, was an ever present in 1912-13 and just two matches in 1913-14 before losing his place in November 1914, his final pair of appearances for The Mariners coming the following January, by when he had scored 7 goals in 168 appearances for Grimsby Town across his six seasons at Blundell Park. With the onset of the First World War forcing the suspension of peacetime football in May 1915, it was reported in May 1919 after its conclusion that he had already retired.