If the files are sorted:
comm -23 file1 file2
-23 suppresses the lines that are in both files, or only in file 2.
If the files are not sorted, pipe them through sort first...
sed -i '' '/pattern to match/d' ./infile
grep -v "pattern" file > temp && mv temp file
> sed '2,4d' file