The Club's presence can be traced right back to 1866, when the Southern Argus reported a meeting at 'Smallacombe's Hotel' chaired by Mr D. Bebee to form the 'Port Elliot Cricket Club'. The South Australian Register's 11th March 1867 edition contained the Club's first match against the 'Alexandrina Club', thought to be from Milang, which was ultimately an outright win to Port Elliot. Bebee and A.R. Addison, who placed the original advertisement for the above meeting into the 'Argus', both claimed 9 wickets in the match, with the latter there when the winning runs were hit.​

Matches were organised between local towns by the Club themselves, until the 'Encounter Bay Cricket Association' was formed for the 1910/11 season. Port Elliot were declared Premiers in both that first season of the Association and also in 1911/12. It's belived that Len Hornsby struck the first century for the Club in an organised competition during that 1911/12 season. C.W. Colman, a former Port Elliot player during the previous century, served as Association President during these seasons. The calling of World War I meant that the Encounter Bay Cricket Association went into recess after the 1914/15 season.​

World War I meant that the Encounter Bay Cricket Association went into recess and it was not until the 1920/21 season that an Association was formed once again, with Port Elliot, Goolwa, Victor Harbor and Yankalilla amongst the founding members of the same 'Great Southern Cricket Association' we are familiar with today. The Club went through some seasons without fielding teams, namely for eight seasons through the 1920's and 1930's, but also for one season had two teams in the competition, which was unfamiliar at the time. The GSCA too, had a hiatus during the next World War II, but has otherwise remained the home of the Port Elliot Cricket Club ever since. Upon the competition's return after World War II, the competition expanded to include a 'B Grade', with the Club fielding a team in one or the other, or both for all bar three seasons up until the end of the 1969/70 season. From there, the Club amalgamated briefly with the 'Valleys' located at Back Valley.

The Club most familiar to today goes back to 1975/76, as the 'Valleys' amalgamation was no more. The Club began to field junior teams where possible, and first had three senior teams in 1988/89 along with a 'Colts' team. The highest team would experience success in three consecutive B Grade Grand Finals during the 1980's, along with a couple of C Grade premierships as well. There would be more premierships in the 1990's, while on the dawn of the millennium, Port Elliot and Goolwa combined to be a joint A Grade team, featuring in finals for regular seasons and featuring in two grand finals, resulting in an abandoned loss and another loss in 2005/06. Since 2009/10, the Club is in its longest period of fielding an A Grade standalone team, with healthy junior team numbers as well. The first junior grade premiership came in the Under 16's in 2013/14, followed by the Under 14's in 2014/15 and 2015/16, and more since. There was a high point of four senior teams in the 2020/21 season, which was also the first of two A Grade Grand Final appearances (that and 2022/23).