tcmalloc：大ALLOC了內存在蒙戈

Question

我看到蒙戈2.4.1以下錯誤在linux

的錯誤似乎是隨機的，我還是無法將它追蹤到特定的查詢。

我沒有檢查大跳過值，並沒有任何 https://jira.mongodb.org/browse/SERVER-10136

一個抽樣誤差是相同的查詢在此之後它並不總是失敗

Fri Oct 11 15:16:52.780 [conn3429148] end connection 10.11.32.100:39274 (82 connections now open) 
Fri Oct 11 15:16:52.781 [initandlisten] connection accepted from 10.11.32.100:39276 #3429150 (83 connections now open) 
Fri Oct 11 15:16:53.661 [initandlisten] connection accepted from 10.11.32.98:59418 #3429151 (84 connections now open) 
Fri Oct 11 15:16:53.694 [initandlisten] connection accepted from 10.11.32.97:39813 #3429152 (85 connections now open) 
Fri Oct 11 15:17:06.811 [conn3429152] command xrr.$cmd command: { aggregate: "VehicleReview", pipeline: [ { $match: { make: "honda", model: "accord", year: "2013", moderationStatus: "STATUS_PASSED" } }, { $sort: { created: -1 } }, { $limit: 1 }, { $skip: 0 }, { $project: { _id: 1, _class: 1, author: 1, created: 1, updated: 1, title: 1, legacyId: 1, targetId: 1, text: 1, favoriteFeatures: 1, suggestedImprovements: 1, thumbsUpDownCounter: 1, ratings: 1, averageRating: 1, make: 1, model: 1, year: 1, subModels: 1, comments: { $ifNull: [ "$comments.comments", [ { moderationStatus: "STATUS_REJECTED" } ] ] } } }, { $unwind: "$comments" }, { $group: { _id: { _id: "$_id", _class: "$_class", author: "$author", created: "$created", updated: "$updated", title: "$title", targetId: "$targetId", text: "$text", legacyId: "$legacyId", favoriteFeatures: "$favoriteFeatures", suggestedImprovements: "$suggestedImprovements", thumbsUpDownCounter: "$thumbsUpDownCounter", ratings: "$ratings", averageRating: "$averageRating" }, commentsCount: { $sum: { $cond: [ { $eq: [ "$comments.moderationStatus", "STATUS_REJECTED" ] }, 0, 1 ] } } } }, { $sort: { _id.created: -1 } } ] } ntoreturn:1 keyUpdates:0 numYields: 107 locks(micros) r:22908773 reslen:1678 13115ms 
Fri Oct 11 15:17:06.811 [conn3428793] command xrr.$cmd command: { aggregate: "VehicleReview", pipeline: [ { $match: { make: "nissan", model: "altima", year: "2013", moderationStatus: "STATUS_PASSED" } }, { $group: { _id: { _id: "$all" }, averageRating: { $avg: "$averageRating" } } } ] } ntoreturn:1 keyUpdates:0 numYields: 185 locks(micros) r:34276392 reslen:91 20340ms 
Fri Oct 11 15:17:06.811 [conn3429151] command xrr.$cmd command: { aggregate: "VehicleReview", pipeline: [ { $match: { make: "hyundai", model: "sonata", year: "2013", moderationStatus: "STATUS_PASSED" } }, { $sort: { c Oct 11 15:17:34.216 out of memory, printing stack and exiting: 
0xdc7f71 0x6cd2ae 0x11fa48d 0xaf4a4f 0xaf0e8f 0xaf17ad 0xaf189f 0xaec46e 0xaec589 0xaea92e 0xaf82e8 0xaf8549 0xae3530 0xae39ef 0xaf0b2f 0xaf17c6 0xaf189f 0xb168c0 0x8a0ad2 0x8cd0ca 
/usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71] 
/usr/bin/mongod(_ZN5mongo14my_new_handlerEv+0x3e) [0x6cd2ae] 
/usr/bin/mongod(_Znwm+0x6d) [0x11fa48d] 
/usr/bin/mongod(_ZNSt6vectorIN5mongo18DocumentSourceSort9KeyAndDocESaIS2_EE7reserveEm+0x6f) [0xaf4a4f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort12populateTopKEv+0x6f) [0xaf0e8f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort8populateEv+0x2d) [0xaf17ad] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort3eofEv+0xf) [0xaf189f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSkip7skipperEv+0x6e) [0xaec46e] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSkip3eofEv+0x9) [0xaec589] 
/usr/bin/mongod(_ZN5mongo21DocumentSourceProject3eofEv+0xe) [0xaea92e] 
/usr/bin/mongod(_ZN5mongo20DocumentSourceUnwind8lazyInitEv+0x138) [0xaf82e8] 
/usr/bin/mongod(_ZN5mongo20DocumentSourceUnwind3eofEv+0x9) [0xaf8549] 
/usr/bin/mongod(_ZN5mongo19DocumentSourceGroup8populateEv+0x30) [0xae3530] 
/usr/bin/mongod(_ZN5mongo19DocumentSourceGroup3eofEv+0xf) [0xae39ef] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort11populateAllEv+0x2f) [0xaf0b2f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort8populateEv+0x46) [0xaf17c6] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort3eofEv+0xf) [0xaf189f] 
/usr/bin/mongod(_ZN5mongo8Pipeline3runERNS_14BSONObjBuilderERSs+0x1d0) [0xb168c0] 
/usr/bin/mongod(_ZN5mongo15PipelineCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x132) [0x8a0ad2] 
/usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0x8cd0ca] 
Greated: -1 } }, { $limit: 1 }, { $skip: 0 }, { $project: { _id: 1, _class: 1, author: 1, created: 1, updated: 1, title: 1, legacyId: 1, targetId: 1, text: 1, favoriteFeatures: 1, suggestedImprovements: 1, thumbsUpDownCounter: 1, ratings: 1, averageRating: 1, make: 1, model: 1, year: 1, subModels: 1, comments: { $ifNull: [ "$comments.comments", [ { moderationStatus: "STATUS_REJECTED" } ] ] } } }, { $unwind: "$comments" }, { $group: { _id: { _id: "$_id", _class: "$_class", author: "$author", created: "$created", updated: "$updated", title: "$title", targetId: "$targetId", text: "$text", legacyId: "$legacyId", favoriteFeatures: "$favoriteFeatures", suggestedImprovements: "$suggestedImprovements", thumbsUpDownCounter: "$thumbsUpDownCounter", ratings: "$ratings", averageRating: "$averageRating" }, commentsCount: { $sum: { $cond: [ { $eq: [ "$comments.moderationStatus", "STATUS_REJECTED" ] }, 0, 1 ] } } } }, { $sort: { _id.created: -1 } } ] } ntoreturn:1 keyUpdates:0 numYields: 106 locks(micros) r:22339823 reslen:1133 13143ms 
Fri Oct 11 15:17:06.846 [conn3428793] end connection 10.11.32.97:50953 (84 connections now open) 
Fri Oct 11 15:17:13.702 [initandlisten] connection accepted from 10.11.32.101:33466 #3429154 (85 connections now open) 
Fri Oct 11 15:17:13.702 [conn3429149] end connection 10.11.32.101:33464 (83 connections now open) 
Fri Oct 11 15:17:19.310 [conn3429115] command local.$cmd command: { collstats: "oplog.rs" } ntoreturn:1 keyUpdates:0 locks(micros) r:201604 reslen:290 201ms 
Fri Oct 11 15:17:21.672 [conn3429151] command xrr.$cmd command: { aggregate: "VehicleReview", pipeline: [ { $match: { make: "hyundai", model: "sonata", year: "2013", moderationStatus: "STATUS_PASSED" } }, { $group: { _id: { _id: "$all" }, averageRating: { $avg: "$averageRating" } } } ] } ntoreturn:1 keyUpdates:0 numYields: 79 locks(micros) r:27839288 reslen:91 14859ms 
Fri Oct 11 15:17:21.672 [conn3429152] command xrr.$cmd command: { aggregate: "VehicleReview", pipeline: [ { $match: { make: "honda", model: "accord", year: "2013", moderationStatus: "STATUS_PASSED" } }, { $group: { _id: { _id: "$all" }, averageRating: { $avg: "$averageRating" } } } ] } ntoreturn:1 keyUpdates:0 numYields: 74 locks(micros) r:28227783 reslen:91 14859ms 
Fri Oct 11 15:17:22.931 [conn3429150] end connection 10.11.32.100:39276 (83 connections now open) 
Fri Oct 11 15:17:22.932 [initandlisten] connection accepted from 10.11.32.100:39278 #3429155 (85 connections now open) 
Fri Oct 11 15:17:23.691 [PeriodicTask::Runner] task: DBConnectionPool-cleaner took: 12ms 
Fri Oct 11 15:17:25.458 [initandlisten] connection accepted from 10.11.32.97:39816 #3429156 (85 connections now open) 
Fri Oct 11 15:17:25.592 [initandlisten] connection accepted from 10.11.32.98:59425 #3429157 (86 connections now open) 
Fri Oct 11 15:17:25.966 [initandlisten] connection accepted from 10.11.32.97:39817 #3429158 (87 connections now open) 
Fri Oct 11 15:17:25.993 [initandlisten] connection accepted from 10.11.32.97:39818 #3429159 (88 connections now open) 
tcmalloc: large alloc 51539607552 bytes == (nil) @ 
Fri Oct 11 15:17:34.216 out of memory, printing stack and exiting: 
0xdc7f71 0x6cd2ae 0x11fa48d 0xaf4a4f 0xaf0e8f 0xaf17ad 0xaf189f 0xaec46e 0xaec589 0xaea92e 0xaf82e8 0xaf8549 0xae3530 0xae39ef 0xaf0b2f 0xaf17c6 0xaf189f 0xb168c0 0x8a0ad2 0x8cd0ca 
/usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71] 
/usr/bin/mongod(_ZN5mongo14my_new_handlerEv+0x3e) [0x6cd2ae] 
/usr/bin/mongod(_Znwm+0x6d) [0x11fa48d] 
/usr/bin/mongod(_ZNSt6vectorIN5mongo18DocumentSourceSort9KeyAndDocESaIS2_EE7reserveEm+0x6f) [0xaf4a4f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort12populateTopKEv+0x6f) [0xaf0e8f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort8populateEv+0x2d) [0xaf17ad] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort3eofEv+0xf) [0xaf189f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSkip7skipperEv+0x6e) [0xaec46e] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSkip3eofEv+0x9) [0xaec589] 
/usr/bin/mongod(_ZN5mongo21DocumentSourceProject3eofEv+0xe) [0xaea92e] 
/usr/bin/mongod(_ZN5mongo20DocumentSourceUnwind8lazyInitEv+0x138) [0xaf82e8] 
/usr/bin/mongod(_ZN5mongo20DocumentSourceUnwind3eofEv+0x9) [0xaf8549] 
/usr/bin/mongod(_ZN5mongo19DocumentSourceGroup8populateEv+0x30) [0xae3530] 
/usr/bin/mongod(_ZN5mongo19DocumentSourceGroup3eofEv+0xf) [0xae39ef] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort11populateAllEv+0x2f) [0xaf0b2f] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort8populateEv+0x46) [0xaf17c6] 
/usr/bin/mongod(_ZN5mongo18DocumentSourceSort3eofEv+0xf) [0xaf189f] 
/usr/bin/mongod(_ZN5mongo8Pipeline3runERNS_14BSONObjBuilderERSs+0x1d0) [0xb168c0] 
/usr/bin/mongod(_ZN5mongo15PipelineCommand3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x132) [0x8a0ad2] 
?out /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0x8cd0ca] 

Answer 1

有2.4.1之間的150個錯誤修復和2.4.6（寫這個答案的當前次要版本2.4）。你可以看到完整列表here。

有幾種可能適用：

https://jira.mongodb.org/browse/SERVER-9213 https://jira.mongodb.org/browse/SERVER-9230

但是，他們並不是專門針對你正在運行的查詢類型（雖然可能有其他別的地方貢獻）。還有這個積屑瘤，仍然命中2.4.6，並適用於聚合框架（運行到前面的堆棧跟蹤崩潰）：

https://jira.mongodb.org/browse/SERVER-10554

因此，我會嘗試測試2.4.7-rc0（或2.4 .7+一旦這些版本可用），看看是否可以消除你的問題。