Removing files you just added and committed to git is easy with git commit --amend

git rm --cached <yourfile>
git commit --amend
git push -f

Taken from this answer on StackOverflow.