On the theme, you want to edit click on Actions > Edit Code
Under Layout click on the theme.liquid file.