2015-04-23 109 views
4

我有一个包含多个csv文件的文件夹。每个文件都由一个日期和一个值列组成。我想合并所有的文件到第一列由数值日期(每个文件相同)和其他列由每个单独的邪恶值(即日期,value_file1,value_file2 ... )加入多个CSV文件

有关如何通过一个简单的python脚本或通过unix命令可能实现这个任何建议吗?

谢谢你的帮助!

+1

可能重复http://stackoverflow.com/questions/11786094/python-joining-two-csv-工具文件) –

+0

第二个文件的列只是附加到第一个的列。我希望第二个文件的列放置在合并文件的新列中,而不是附加到当前列。 – user3551674

+0

这并不完全清楚 - 你能更清楚地解释输入的csv文件是什么样子吗?日期在哪里/何时相同? – StackG

回答

2

我建议使用像csvkit's csvjoin

pip install csvkit 
$ csvjoin --help 
usage: csvjoin [-h] [-d DELIMITER] [-t] [-q QUOTECHAR] [-u {0,1,2,3}] [-b] 
       [-p ESCAPECHAR] [-z MAXFIELDSIZE] [-e ENCODING] [-S] [-v] [-l] 
       [--zero] [-c COLUMNS] [--outer] [--left] [--right] 
       [FILE [FILE ...]] 

Execute a SQL-like join to merge CSV files on a specified column or columns. 

positional arguments: 
    FILE     The CSV files to operate on. If only one is specified, 
         it will be copied to STDOUT. 

optional arguments: 
    -h, --help   show this help message and exit 
    -d DELIMITER, --delimiter DELIMITER 
         Delimiting character of the input CSV file. 
    -t, --tabs   Specifies that the input CSV file is delimited with 
         tabs. Overrides "-d". 
    -q QUOTECHAR, --quotechar QUOTECHAR 
         Character used to quote strings in the input CSV file. 
    -u {0,1,2,3}, --quoting {0,1,2,3} 
         Quoting style used in the input CSV file. 0 = Quote 
         Minimal, 1 = Quote All, 2 = Quote Non-numeric, 3 = 
         Quote None. 
    -b, --doublequote  Whether or not double quotes are doubled in the input 
         CSV file. 
    -p ESCAPECHAR, --escapechar ESCAPECHAR 
         Character used to escape the delimiter if --quoting 3 
         ("Quote None") is specified and to escape the 
         QUOTECHAR if --doublequote is not specified. 
    -z MAXFIELDSIZE, --maxfieldsize MAXFIELDSIZE 
         Maximum length of a single field in the input CSV 
         file. 
    -e ENCODING, --encoding ENCODING 
         Specify the encoding the input CSV file. 
    -S, --skipinitialspace 
         Ignore whitespace immediately following the delimiter. 
    -v, --verbose   Print detailed tracebacks when errors occur. 
    -l, --linenumbers  Insert a column of line numbers at the front of the 
         output. Useful when piping to grep or as a simple 
         primary key. 
    --zero    When interpreting or displaying column numbers, use 
         zero-based numbering instead of the default 1-based 
         numbering. 
    -c COLUMNS, --columns COLUMNS 
         The column name(s) on which to join. Should be either 
         one name (or index) or a comma-separated list with one 
         name (or index) for each file, in the same order that 
         the files were specified. May also be left 
         unspecified, in which case the two files will be 
         joined sequentially without performing any matching. 
    --outer    Perform a full outer join, rather than the default 
         inner join. 
    --left    Perform a left outer join, rather than the default 
         inner join. If more than two files are provided this 
         will be executed as a sequence of left outer joins, 
         starting at the left. 
    --right    Perform a right outer join, rather than the default 
         inner join. If more than two files are provided this 
         will be executed as a sequence of right outer joins, 
         starting at the right. 

Note that the join operation requires reading all files into memory. Don't try 
this on very large files. 
[蟒蛇连接两个的CSV文件(的
+0

非常感谢!这正是我期待的! – user3551674