2017-07-25 18 views
0

我在Google雲端存儲中構建了一個非常薄的包裝,使其看起來更像localStorage。我知道同一個對象每秒只能寫入一次,但是這段代碼從來沒有寫過每秒更快的東西,我不知道爲什麼。我已經確認實際使用代碼時對象名稱是不同的。爲什麼上傳時Google雲端存儲的瘦身包裝太慢了?

(function() { 
    // a Google Cloud Storage API modeled somewhat after localStorage 
    class CloudStore { 
     constructor(name) { 
      const me = this, 
       Storage = require('@google-cloud/storage'); 
      me.storage = Storage(); 
      me.bucket = me.storage.bucket(name+"_anywhichway"); 
      me.bucket.exists().then((data) => { 
       data[0] || me.storage.createBucket(name+"_anywhichway") 
          .then((data) => me.bucket = data[0]); 
       me.bucket.getFiles((data) => { 
        !data || (me.files = data[0]); 
       }) 
      }); 
     } 
     async clear() { 
      await this.bucket.deleteFiles({force:true}); 
     } 
     async count() { 
      return (this.files ? this.files.length : 0); 
     } 
     async delete(id) { 
      this.storageProvider.removeItem(id); 
      if(!this.files) { 
       [this.files] = await this.bucket.getFiles(); 
      } else { 
       const i = this.files.findIndex((item) => item.name===id); 
       i===-1 || this.files.splice(0,i,1); 
      } 
     } 
     async get(id) { // usually around 3,300 rec/sec 
      const me = this, 
       streams = require('memory-streams'); 
      return new Promise((resolve,reject) => { 
       const writable = new streams.WritableStream(); 
       me.bucket.file(id).createReadStream({validation:false}) 
        .on('error', (err) => { console.log(id,err.message); }) 
        .on('response', (response) => { }) 
        .on('end',() => { resolve(writable.toString()); }) 
        .pipe(writable); 
      }); 
     } 
     async key(number) { 
      if(this.files[number]) return this.files[number].name; 
     } 
     async set(id,data) { // never faster than 1.01 rec/sec 
      const me = this; 
      return new Promise((resolve,reject) => { 
       const file = me.bucket.file(id), 
        stream = file.createWriteStream(); 
       stream.end(data,"utf8",async() => { 
        // only get the file list once from Google 
        // then manage a pseudo-list locally for speed 
        // tried commenting this out to see if it improved 
        // performance, it did not 
        if(!me.files) { 
         [me.files] = await me.bucket.getFiles(); 
        } else { 
         me.files.push({name:id}); 
        } 
        resolve(id); 
       }); 
      }); 
     } 
    } 
    module.exports = CloudStore; 
}).call(this); 

測試代碼:

const storage = new CloudStore("test"); 
const size = 10, 
start = Date.now(); 
for(let i=0;i<size;i++) { 
     await storage.set("Object#"+i,JSON.stringify({item:i})); 
} 
const set= Date.now(); 
let expired = set- start, 
    persec = size/(expired/1000); 
console.log("set",expired,persec); 

回答

1

事實證明,由Storage = require('@google-cloud/storage');提供的API是相當緩慢,只適合於較大的物體。在POST中使用more direct JSON API可以每秒節省150+個對象。

相關問題