Loading into an existing BigQuery table or creating a new table might result in an error indicating that there are not enough columns in the CSV file


When you try to load into an existing Google BigQuery table or try to create a new table, an error might occur when the following is true:

The error might look similar to the following:

ERROR: Error while executing bulk load: {Location: ""; Message: "Error while reading data, error message: CSV table references column position
       3, but line starting at position:0 contains only 2 columns."; Reason: "invalid"}

 

This issue affects performance.

If the character cannot be removed, the workaround is to remove the BULKLOAD=YES option.