平鋪數據來創建一個熊貓數據框

Question

我是python熊貓的新手。只是一個簡單而快速的問題。假設我有兩列，分別是「周」和「機」：

weeks = [1,3,5] 
machine = [M1, M1, M2, M2] 

我的計劃是把這些名單的數據幀，但我得到「ValueError異常：數組必須是相同的長度」。我正在看以下輸出：

final_weeks = [1,2,3,4,5,1,2,3,4,5] 
final_machine = [M1, M1, M1, M1, M1, M2, M2, M2, M2, M2] 

tempDict = {'weeks': final_weeks, 'machine': final_machine} 

我得到這兩個列表，但不是數據框。爲什麼我得到valueError？下面是我做的，到目前爲止：

maxWeek = df["weeks"].max() 
uniqueMachine = set(df.machine) 

unionWeeklist = [item for item in range(1, maxWeek+1)] 
# Output = [1, 2, 3, 4, 5] 

final_weeks = unionWeekList * len(uniqueMachine) 
# [1,2,3,4,5,1,2,3,4,5] 

machines = [[item]* maxWeek for item in uniqueMachine] 
# Output: [[M1,M1,M1,M1,M1], [M2,M2,M2,M2,M2]] 

final_machines = list(itertools.chain.from_iterable(machines)) 
# Flattened list = [M1,M1,M1,M1,M1,M2,M2,M2,M2,M2] 

tmpDict = {'week': final_weeks, 'machine': final_machines} 

# new dataframe 
newdf = pd.DataFrame.from_records(tmpDict) 

# ValueError: arrays must all be same length 

Answer 1

您可以使用DataFrame構造與numpy.repeat和numpy.tile重複：

#unique machines 
uniq = np.sort(np.unique(np.array(machine))) 
#repeated range 
rng = np.arange(min(weeks), max(weeks)+1) 

df = pd.DataFrame({'machine': np.repeat(uniq, len(rng)), 
        'week':np.tile(rng, len(uniq))}, columns=['week','machine']) 

print (df) 
    week machine 
0  1  M1 
1  2  M1 
2  3  M1 
3  4  M1 
4  5  M1 
5  1  M2 
6  2  M2 
7  3  M2 
8  4  M2 
9  5  M2 

與cᴏʟᴅsᴘᴇᴇᴅ's solution比較：

weeks = [1, 3, 5, 8, 13, 15, 17, 23, 24, 26] 
machine = ['M{}'.format(x) for x in range(1, 51)] 
print (machine) 

In [29]: %%timeit 
    ...: uniq = np.sort(np.unique(np.array(machine))) 
    ...: #repeated range 
    ...: rng = np.arange(min(weeks), max(weeks)+1) 
    ...: 
    ...: df = pd.DataFrame({'machine': np.repeat(uniq, len(rng)), 
    ...:     'week':np.tile(rng, len(uniq))}, columns=['week','machine']) 
    ...: 
1000 loops, best of 3: 636 µs per loop 

In [30]: %%timeit 
    ...: uniq_machine = sorted(set(machine)) 
    ...: df = pd.DataFrame(np.repeat(np.array(uniq_machine)\ 
    ...:       .reshape(1, len(uniq_machine)), max(weeks), 0), 
    ...:     index=range(1, max(weeks) + 1)) 
    ...: 
    ...: out = df.unstack().reset_index(level=0, drop=True) 
    ...: out = out.reset_index() 
    ...: out.columns = ['week', 'machine'] 
    ...: 
1000 loops, best of 3: 1.46 ms per loop 

Answer 2

試試這個..我想我得到了你所需要的（PS：爲了得到你想要的東西，請按照cᴏʟᴅsᴘᴇᴇᴅ的答案）

weeks = [1,3,5] 
machine = ['M1', 'M1', 'M2', 'M2'] 
newdf = pd.DataFrame(machine) 
newdf.groupby(0).apply(lambda x : (x.reindex(range(1,max(weeks)+1)).ffill().bfill())) 
Out[364]: 
     0 
0  
M1 1 M1 
    2 M1 
    3 M1 
    4 M1 
    5 M1 
M2 1 M2 
    2 M2 
    3 M2 
    4 M2 
    5 M2 

Answer 3

一種選擇，使用np.repeat和df.unstack

weeks = [1, 3, 5] 
machine = ['M1' 'M1', 'M2', 'M2'] 

uniq_machine = sorted(set(machine)) 

df = pd.DataFrame(np.repeat(np.array(uniq_machine)\ 
          .reshape(1, len(uniq_machine)), max(weeks), 0), 
        index=range(1, max(weeks) + 1)) 

out = df.unstack().reset_index(level=0, drop=True) 
print(out) 

1 M1 
2 M1 
3 M1 
4 M1 
5 M1 
1 M2 
2 M2 
3 M2 
4 M2 
5 M2 
dtype: object 

這是一個pd.Series對象，但你可以叫.reset_index拿到2列：

out = out.reset_index() 
out.columns = ['week', 'machine'] 
print(out) 

    week machine 
0  1  M1 
1  2  M1 
2  3  M1 
3  4  M1 
4  5  M1 
5  1  M2 
6  2  M2 
7  3  M2 
8  4  M2 
9  5  M2