麻省理工學院的Starcluster錯誤，節點超過200個

Question

有沒有人遇到了大於200個節點的簇大小問題？每當我嘗試，我得到以下錯誤：

7/dist-packages/boto/ec2/connection.py", line 585, in get_all_instances 
     max_results=max_results) 
 File "/usr/local/lib/python2.7/dist-packages/boto/ec2/connection.py", line 681, in get_all_reservations 
   [('item', Reservation)], verb='POST') 
 File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1186, in get_list 
   raise self.ResponseError(response.status, response.reason, body) 
EC2ResponseError: EC2ResponseError: 400 Bad Request 
<?xml version="1.0" encoding="UTF-8"?> 
<Response><Errors><Error><Code>FilterLimitExceeded</Code><Message>The maximum number of filter values specified on a single call is 200</Message></Error></Errors><RequestID>290b6e93-22b4-4450-b487-64d9174d166e</RequestID></Response> 

我使用starcluster開發分支0.95.6，因爲它支持較新C4 EC2實例。

貝婁是我的明星羣集配置了XXXX落實到位私人信息：

#################################### 
## StarCluster Configuration File ## 
#################################### 
[global] 

DEFAULT_TEMPLATE=cluster 

############################################# 
## AWS Credentials and Connection Settings ## 
############################################# 
[aws info] 

AWS_ACCESS_KEY_ID = XXXXXXX 
AWS_SECRET_ACCESS_KEY = XXXXXXXX 
AWS_USER_ID=XXXXXX 

AWS_REGION_NAME = eu-east-1 


########################### 
## Defining EC2 Keypairs ## 
########################### 

[key mykey] 
KEY_LOCATION= XXXXXX 


################################ 
## Defining Cluster Templates ## 
################################ 


[cluster cluster] 
KEYNAME = mykey 
CLUSTER_SIZE = 400 
CLUSTER_USER = sgeadmin 

CLUSTER_SHELL = bash 

NODE_IMAGE_ID = ami-52a0c53b 

NODE_INSTANCE_TYPE = c4.large 

AVAILABILITY_ZONE = us-east-1a 

VOLUMES = cluster, datastore 

PERMISSIONS = ssh 

SPOT_BID = 0.07 



############################# 
## Configuring EBS Volumes ## 
############################# 

[volume cluster] 
VOLUME_ID = xxxxx 
MOUNT_PATH = /home 

[volume datastore] 
VOLUME_ID = xxxxx 
MOUNT_PATH = /data/ 


############################################ 
## Configuring Security Group Permissions ## 
############################################ 

[permission ssh] 
IP_PROTOCOL = tcp 
FROM_PORT = 22 
TO_PORT = 22 

Answer 1

這看起來像所引起的AWS API中的限制的StarCluster錯誤。 StarCluster發送一個包含200多個項目並被AWS拒絕的過濾列表。應該創建一個補丁，以便StarCluster可以發送多個請求。