Gedit will backup every file with ~ suffix.You can close this function at Edit -> Preferences,uncheck Create a backup copy of files before saving.

There is also a setting in gconf-editor to show backup files
/desktop/gnome/file_views/show_backup_files
