If the files are sorted: comm -23 file1 file2 -23 suppresses the lines that are in both files, or only in file 2. If the files are not sorted, pipe them through sort first...
grep -v "pattern" file > temp && mv temp file
> sed '2,4d' file