The childhood of Port was no more unusual than the average working-class child in Southern England during the mid-1970s. Port's father was a cleaner for the East London council and his mother worked as a cashier for a supermarket.
During his childhood, Port had aspirations of creative endeavors, having enrolled at an art college at age 16. However, the costs to study there proved to be too much for his family, and Stephen soon left to pursue training as a chef.
Nothing during this early period of Port's life is noteworthy in its ability to foreshadow what he would later make of his life. Though reflections of Port's personality have been remembered as 'childlike' by some, namely a previous partner, who stated that his behavior eventually led to the breakdown of their relationship.