This error has the following cause and solution:
VSS uses the File Types Included in File Group field to create a filter string for the Share and Add Files dialog boxes. This error occurs when the combined length of the file groups is too long. The total buffer length is 511 characters. To correct this error, reduce the length of your file-type lists.