We have a dataset that needs to be imported into our RDS Postgres instance. The dataset is a text file delimited with |.
The catch is the table has 100+ columns and fails with the COPY command. This is because the row size is too large.
I want a process to import this text file into our RDS instance in a timely manner.