Reading CSV file to hash gives incorrect result - csv

Question

I have csv file containing (the SQL query is simplified):
SQL_QRY
"insert into TTL_CCL_DB_INF.D_1244_CRB_PARTY_EXT (CD_REC_PARTY, CD_REC_OBJECT_TYPE, T_FULL_NAME, ..) select * from TTL_CCL_DB_STG.D_1244_CRB_PARTY aa1 inner join TTL_CCL_DB_STG.D_1244_CRB_COMPANYFACT bb1 on aa1.CD_REC_PARTY = bb1.CD_REC_PARTY"
I have a perl script to read the file into hash:
sub somesub {
...
my $fh;
my $key;
eval { open($fh, '<', $tmp_file); };
if ($#) {
$errmsg = $#;
croak {message=>$errmsg};
};
while(my $lines = <$fh>) {
chomp $lines;
my #data = split(/|/, $lines);
$key = shift #data;
$data_rt{$key} = \#data;
};
close $fh;
unlink $tmp_file;
return %data_rt;
}
But the returned hash looks like:
RETURN >>>>$VAR1 = {
' => [], 'SQL_QRY
'"insert into TTL_CCL_DB_INF.D_1244_CRB_PARTY_EXT (CD_REC_PARTY, CD_REC_OBJECT_TYPE, T_FULL_NAME, CD_TAX_IDENTIFIER, CD_VAT_IDENTIFIER,DWH_TRANSFRM_ID, DWH_TRANSFRM_RUN_ID, DWH_BD, DWH_VSN_NO ) select aa1.CD_REC_PARTY, aa1.CD_REC_OBJECT_TYPE, aa1.T_FULL_NAME, bb1.CD_TAX_IDENTIFIER, bb1.CD_VAT_IDENTIFIER, $transfrmId, \'$transfrmRunId\', cast(\'$bnsDt\' as date format \'YYYYMMDD\'), $occNbr from TTL_CCL_DB_STG.D_1244_CRB_PARTY aa1 inner join TTL_CCL_DB_STG.D_1244_CRB_COMPANYFACT bb1 on aa1.C' => []ARTY = bb1.CD_REC_PARTY and cast(aa1.DWH_BD as date format \'YYYYMMDD\') = \'$10000050_dwh_bd\' and aa1.DWH_VSN_NO = $10000050_vsn_no and cast(bb1.DWH_BD as date format \'YYYYMMDD\') = \'$10000034_dwh_bd\' and bb1.DWH_VSN_NO = $10000034_vsn_no"
};
Would anybody help me how to do that correctly? I need to have it as much flexible as possible (csv file can contain more rows and more columns)

Answer 1

The sample data that you show us doesn't seem to match your code. The code wants to split the data on pipe symbols. But the data doesn't contain any pipe symbols. So I'm not sure how that's going to work.
However, I'm pretty confident that the problem is on this line:
my #data = split(/|/, $lines);
The first argument to split() is a regex. And a pipe symbol is a regex metacharacter. In order to use a metacharacter as itself, you need to escape it with a backslash.
my #data = split(/\|/, $lines);