2012-03-19 76 views
-1

我实现了两个函数reshape_longreshape_wide(请参阅下面的完整工作示例)以重新塑造数据帧。 我创建了几个小例子,这两个函数似乎正常工作。使用dcast重构数据帧并融化

但是,在我的真实数据集(大约200.000到300.000行)上使用reshape_wide函数 失败。会发生什么情况是将X,Y和Z的所有值都设置为1. 我的实际数据结构与下面的小示例完全相同。工作2天后,我认为 的问题是,“主键”(test_name,group_nameid)只是在广泛的形式是唯一的。在应用 reshape_long函数后,主键不再是唯一的。我想知道,有谁能告诉我d1 -> reshape_wide -> d2的步骤 是否可以工作,因为d1的非唯一性?

library(reshape2) 
library(taRifx) 

reshape_long <- function(data, ids) {  
     # Bring data into long form 
     data_long <- melt(data, id.vars = ids, 
          variable.name="Data_Points", value.name="value") 
     data_long$value <- as.numeric(data_long$value) 
     # Remove rows were analyte value is NA 
     data_long <- data_long[!is.na(data_long$value), ] 
     # Resort data 
     formula_sort <- as.formula(paste("~", paste(ids, collapse="+"))) 
     data_long <- sort(data_long, f = formula_sort) 
     return(data_long) 
} 

reshape_wide <- function(data, ids) { 
     # Bring data into wide form 
     formula_wide <- as.formula(paste(paste(ids, collapse="+"), 
            "~ Data_Points")) 
     data_wide <- dcast(data, formula_wide) 
     # Resort data 
     formula_sort <- as.formula(paste("~", paste(ids, collapse="+"))) 
     data_wide <- sort(data_wide, f = formula_sort) 
     return(data_wide) 
} 

d <- data.frame( 
     test_name = c(rep("Test_A", 6), rep("Test_B", 6)), 
     group_name = c(rep("Group_C", 3), rep("Group_D", 3), 
         rep("Group_C", 3), rep("Group_D", 3)), 
     id = c("I1", "I2", "I3", "I4", "I5", "I6",       
       "I1", "I2", "I3", "I7", "I8", "I9"), 
     X = c(NA,NA,1,2,3,4,5,6,NA,7,8,9), 
     Y = as.numeric(10:21), 
     Z = c(NA,22,23,NA,24,NA,25,26,NA,27,28,29) 
) 

d 
d1 <- reshape_long(d, ids=c("test_name", "group_name", "id")) 
d1 
d2 <- reshape_wide(d1, ids=c("test_name", "group_name", "id")) 
d2 

identical(d,d2) 

回答

1

你写你的职责的方式,有一个假设,即idstest_namegroup_name,并且id在你的例子)的组合是在原始数据是唯一的。最简单的方法是取你的d和重复行。

> ddup <- rbind(d,d) 
> ddup1 <- reshape_long(ddup, ids=c("test_name", "group_name", "id")) 
> ddup2 <- reshape_wide(ddup1, ids=c("test_name", "group_name", "id")) 
Aggregation function missing: defaulting to length 
> 
> identical(ddup,ddup2) 
[1] FALSE 

请注意,您reshape_wide假定idsData_Points在一起是唯一的。在这个例子中,他们不是。警告消息指示dcast已使用length将每个组合的多个值汇总为单个值。