Troubleshooting Import – Missing data when column length is too short for the import

When loading data from an external data source (for example, JDBC, LDAP, FTP and so on), the import is successful. However, some columns are truncated causing some missing data.

Symptoms

• Data is truncated
• Data discrepancy after import 

Importing from an external data source for the first time creates the import table and sets column length based on incoming data. For follow-up imports for the same data source, the data is truncated to fit the column size if any of the fields are larger than the already created column sizes.

To solve the truncated data issue for a specific table only, resize the column manually:

1. Navigate to System Definition > Tables & Columns.
2. Select the appropriate import table from the table list.
3. Click Edit Table.
4. Find the column in the list.
5. Change the Max Length value.
6. Click Update.
7. Reload the data.

To solve the issue for all imports, set the glide property com.glide.loader.verify_target_field_size to true.