Использование pandas
>>> d = pd.read_csv('file.csv', sep=';', header=None).set_index(0).agg(np.array,1).to_dict()
{'E1': array([4, 6, 7, 1, 3, 6]),
'E2': array([5, 4, 3, 5, 0, 0]),
'E3': array([2, 3, 3, 0, 0, 0])}
Использование чистого питона:
with open('file.csv', 'r') as f:
d = {}
for line in f:
l = line.strip().split(';')
d[l[0]] = np.array(list(map(int, l[1:])))
{'E1': array([4, 6, 7, 1, 3, 6]),
'E2': array([5, 4, 3, 5, 0, 0]),
'E3': array([2, 3, 3, 0, 0, 0])}